-- Logs begin at Tue 2022-10-04 16:59:12 UTC, end at Tue 2022-10-04 19:32:34 UTC. -- Oct 04 17:37:22.160424 n-d-831193-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:37:22.171412 n-d-831193-17 devstack@n-api.service[112927]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:37:22 2022] *** Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: nodename: n-d-831193-17 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: machine: x86_64 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: clock source: unix Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: pcre jit disabled Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: detected number of CPU cores: 4 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: current working directory: / Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: your processes number limit is 47680 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: your memory page size is 4096 bytes Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: detected max file descriptor number: 2048 Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: lock engine: pthread robust mutexes Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: thunder lock: enabled Oct 04 17:37:22.171965 n-d-831193-17 devstack@n-api.service[112927]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:37:22.172825 n-d-831193-17 devstack@n-api.service[112927]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:37:22.211557 n-d-831193-17 devstack@n-api.service[112927]: Python main interpreter initialized at 0x55f747c6c9c0 Oct 04 17:37:22.211557 n-d-831193-17 devstack@n-api.service[112927]: python threads support enabled Oct 04 17:37:22.211557 n-d-831193-17 devstack@n-api.service[112927]: your server socket listen backlog is limited to 100 connections Oct 04 17:37:22.211557 n-d-831193-17 devstack@n-api.service[112927]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:37:22.211935 n-d-831193-17 devstack@n-api.service[112927]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:37:22.212019 n-d-831193-17 devstack@n-api.service[112927]: *** Operational MODE: preforking *** Oct 04 17:37:22.212241 n-d-831193-17 devstack@n-api.service[112927]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:37:22.212241 n-d-831193-17 devstack@n-api.service[112927]: spawned uWSGI master process (pid: 112927) Oct 04 17:37:22.212443 n-d-831193-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:37:22.213571 n-d-831193-17 devstack@n-api.service[112927]: spawned uWSGI worker 1 (pid: 112928, cores: 1) Oct 04 17:37:22.213571 n-d-831193-17 devstack@n-api.service[112927]: spawned uWSGI worker 2 (pid: 112929, cores: 1) Oct 04 17:37:22.213571 n-d-831193-17 devstack@n-api.service[112927]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:37:22.869591 n-d-831193-17 devstack@n-api.service[112928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:37:22.877422 n-d-831193-17 devstack@n-api.service[112929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:37:23.945755 n-d-831193-17 devstack@n-api.service[112928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:37:23.945755 n-d-831193-17 devstack@n-api.service[112928]: from cryptography.utils import int_from_bytes Oct 04 17:37:23.946321 n-d-831193-17 devstack@n-api.service[112928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:37:23.946321 n-d-831193-17 devstack@n-api.service[112928]: from cryptography.utils import int_from_bytes Oct 04 17:37:23.950000 n-d-831193-17 devstack@n-api.service[112929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:37:23.950000 n-d-831193-17 devstack@n-api.service[112929]: from cryptography.utils import int_from_bytes Oct 04 17:37:23.950434 n-d-831193-17 devstack@n-api.service[112929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:37:23.950434 n-d-831193-17 devstack@n-api.service[112929]: from cryptography.utils import int_from_bytes Oct 04 17:37:26.419535 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:37:26.420193 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:37:26.420193 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:37:26.420634 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:37:26.420751 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:37:26.420834 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:37:26.420921 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:37:26.421009 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:37:26.421009 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:37:26.421164 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:37:26.421259 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.421345 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.421553 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.421655 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.421873 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.421973 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422188 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422283 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422509 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422596 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422813 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.422918 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423153 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423251 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423513 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423606 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423840 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.423927 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424096 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424187 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424404 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424501 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424721 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831193-17 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.424812 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831193-17 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425032 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425117 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425330 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425424 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425637 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425733 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.425947 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426038 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426243 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426342 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426555 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426644 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426854 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.426950 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.427373 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.427832 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.427832 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428080 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428225 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428345 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428451 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428561 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428735 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.428863 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429047 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429296 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429462 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429576 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429680 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429791 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.429947 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430076 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430266 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430379 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430570 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430689 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.430964 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831193-17 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431126 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831193-17 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431308 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431444 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431616 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431734 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.431926 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.432036 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433371 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433500 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433500 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433663 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433757 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433837 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.433921 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434000 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434078 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434162 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434249 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434337 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434418 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434496 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434581 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434670 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434761 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.434841 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435020 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435169 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435337 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435468 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435646 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435734 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.435948 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436035 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436258 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436353 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436558 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436644 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436855 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.436940 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437099 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437197 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437398 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437484 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437712 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.437797 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438025 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438129 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438338 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438426 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438588 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438686 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438832 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.438934 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439168 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439278 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439487 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439583 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439793 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.439879 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440097 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440191 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440399 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440497 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440700 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440786 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.440999 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441084 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441298 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441395 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441599 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441692 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441899 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.441992 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442209 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442308 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442609 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442829 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.442921 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443153 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443242 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443466 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443564 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443855 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.443941 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444100 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444192 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444428 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444517 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444762 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.444856 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445075 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445163 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445379 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445464 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445692 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.445781 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446006 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446093 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446308 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446403 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446611 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446706 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446911 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.446995 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447248 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447335 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447573 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447673 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447873 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.447967 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448116 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448202 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448413 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448508 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448712 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.448798 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449022 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449107 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449324 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449417 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449622 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449707 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.449921 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450008 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450213 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450300 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450598 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450813 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.450905 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451135 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451237 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451436 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451529 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451737 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.451833 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452037 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452124 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452332 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452423 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452630 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452716 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.452928 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453020 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453226 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453319 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453535 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453621 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453846 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.453933 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454143 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454228 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454442 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454605 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454738 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.454833 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455098 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455201 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455374 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455469 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455677 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455769 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.455976 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456061 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456290 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456375 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456590 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456676 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456887 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.456975 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457198 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457325 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457501 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457634 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457802 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.457938 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458113 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458250 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458407 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458546 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458707 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.458848 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459016 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459186 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459339 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459490 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459639 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.459791 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.460466 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.460717 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.460812 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461024 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461110 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461326 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461413 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461624 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461710 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.461924 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462011 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462218 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462312 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462511 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462605 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462826 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.462920 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463156 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463258 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463461 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463549 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463759 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.463863 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.464057 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.464157 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.464369 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:37:26.464456 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.464700 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.464794 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465029 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465128 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465342 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465428 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465665 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465786 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.465989 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466075 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466304 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466391 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466614 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466700 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.466926 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467020 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467268 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467367 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467575 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467660 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467885 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.467988 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468191 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468277 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468501 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468596 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468817 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.468913 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469132 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469219 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469442 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469527 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469754 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.469842 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470067 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470153 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470373 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470466 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470682 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470769 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.470998 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471146 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471337 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471436 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471646 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471740 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.471958 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472044 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472296 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472392 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472608 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472705 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.472928 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473078 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473245 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473341 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473552 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473640 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473857 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.473944 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474160 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474246 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474466 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474552 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474795 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.474879 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.475124 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.475215 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.475454 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476150 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476308 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476396 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476620 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476717 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.476929 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477017 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477237 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477324 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477543 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477630 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477849 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.477952 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478157 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478253 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478463 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478558 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478786 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.478871 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479118 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479236 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479439 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479526 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479747 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.479833 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480054 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480151 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480361 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480446 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480669 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480755 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.480976 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481070 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481273 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481366 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481576 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481663 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481874 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.481971 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482174 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482260 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482470 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482555 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482768 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.482862 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483107 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483210 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483415 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483500 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483727 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.483824 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484035 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484120 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484342 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484427 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484646 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484733 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.484952 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485037 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485253 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485339 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485555 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485642 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485861 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.485946 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486162 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486262 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486461 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486553 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486775 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.486869 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487096 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487197 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487401 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487488 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487707 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.487791 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488009 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488104 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488309 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488403 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488615 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488701 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.488921 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489055 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489228 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489314 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489535 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489621 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489839 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.489933 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490146 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490238 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490452 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490545 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490761 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.490849 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491132 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491240 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491436 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491521 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491749 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.491844 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492071 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492157 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492386 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492472 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492689 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492776 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.492986 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493072 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493286 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493379 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493584 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493669 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.493881 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494012 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494177 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494273 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494474 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494566 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494770 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.494866 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.495087 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.495189 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.495391 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.495737 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.495942 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496029 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496243 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496342 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496548 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496634 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496849 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.496936 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497147 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497284 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497444 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497530 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497742 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.497827 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498069 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498155 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498370 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498456 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498707 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.498796 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499074 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499164 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499366 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499464 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499673 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499766 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.499981 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500068 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500286 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500373 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500592 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500686 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500898 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.500983 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501204 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501326 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501613 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501820 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.501905 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502132 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502224 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502437 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502532 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502743 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.502829 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503066 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503155 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503378 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503477 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503678 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503771 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.503983 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504114 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504294 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504390 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504629 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504724 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.504941 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505026 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505286 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505384 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505562 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505649 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505868 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.505955 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506170 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506257 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506472 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506609 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506798 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.506891 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507125 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507229 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507433 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507530 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507741 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.507827 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508047 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508140 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508350 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508435 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508654 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508739 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.508958 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509045 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509267 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509352 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509563 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509660 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509872 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.509959 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510183 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510269 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510505 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510599 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510811 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.510897 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511145 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511236 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511453 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511552 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511758 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.511845 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512064 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512151 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512368 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512461 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512667 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512752 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.512965 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513057 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513267 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513355 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513573 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513671 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513877 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.513963 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514180 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514267 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514478 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514568 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514776 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.514862 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515101 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515190 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515407 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515493 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515704 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.515799 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516000 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516194 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516309 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516404 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516614 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516707 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.516919 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517006 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517235 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517331 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517536 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517634 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517835 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.517928 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518134 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518220 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518448 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518544 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518749 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.518835 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519069 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519200 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519376 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519500 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519682 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.519771 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520005 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520105 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520307 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520404 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520607 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520693 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.520924 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521009 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521231 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521319 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521534 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521628 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521839 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.521925 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.522145 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.522232 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.522981 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523103 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523317 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523403 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523624 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523712 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.523928 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524053 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524234 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524334 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524540 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524627 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524847 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.524931 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525153 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525249 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525464 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525548 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525767 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.525852 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526072 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526165 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526374 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526467 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526674 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526816 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.526982 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.527101 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.527321 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.527569 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.527878 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.527966 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528203 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528290 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528600 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528830 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.528925 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529158 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529253 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529478 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529641 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529802 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.529888 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530115 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530208 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530419 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530720 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.530811 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531023 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531165 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531347 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531436 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531647 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531733 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.531950 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532044 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532251 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532338 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532549 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532723 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.532856 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533035 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533155 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533345 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533456 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533647 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533755 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.533949 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534048 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534250 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534340 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534551 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534637 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534860 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.534947 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535185 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535287 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535497 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535585 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535797 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.535885 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536116 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536204 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536421 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536506 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536721 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.536808 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537021 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537107 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537321 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537407 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537660 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.537747 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.538020 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.538600 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.538859 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.539114 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.539205 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.539475 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.539646 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.539795 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540094 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540187 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540395 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540490 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540695 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.540781 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541000 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541096 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541305 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541398 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541601 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541689 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.541903 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542003 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542206 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542301 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542509 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542596 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542808 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.542895 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543125 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543215 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543431 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543535 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543731 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.543819 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544037 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544123 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544338 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544427 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544638 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544728 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.544935 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545022 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545243 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545327 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545546 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545635 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545842 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.545927 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546138 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546233 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546435 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546524 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546739 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.546825 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547047 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547158 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547351 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547446 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547667 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547802 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.547954 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548049 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548251 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548337 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548546 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548637 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548843 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.548937 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549149 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549236 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549445 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549532 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549742 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.549830 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550043 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550127 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550341 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550434 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550640 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550728 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.550935 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551021 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551272 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551359 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551569 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551662 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551868 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.551956 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552169 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552266 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552469 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552557 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552768 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.552855 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553067 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553162 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553369 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553456 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553687 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553772 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.553984 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554080 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554281 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554375 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554579 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554666 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554874 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.554968 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555198 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555300 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555500 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555594 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555799 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.555893 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556097 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556184 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556394 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556479 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556708 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.556794 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557008 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557094 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557309 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557395 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557609 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557704 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.557945 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558031 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558243 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558328 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558554 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558641 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558860 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.558948 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559192 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559292 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559494 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559582 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559803 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.559891 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560110 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560204 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560416 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560501 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560713 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.560798 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561009 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561104 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561324 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561411 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561632 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561720 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.561937 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562039 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562252 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562343 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562567 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562654 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562878 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.562973 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563210 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563297 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563516 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563613 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563822 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.563917 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564128 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564215 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564424 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564510 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564727 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.564813 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565032 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565125 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565337 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565426 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565641 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565728 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.565944 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566037 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566248 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566341 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566550 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566639 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566855 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.566940 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567185 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567283 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567484 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567573 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567781 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.567868 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568089 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568187 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568385 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568470 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568683 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568770 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.568980 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.569079 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.569797 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.569888 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570097 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570183 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570399 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570520 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570702 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.570833 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571007 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571151 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571330 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571459 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571754 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.571848 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572064 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572148 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572371 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572458 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572673 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572759 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.572972 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573056 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573280 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573367 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573593 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573678 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573906 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.573992 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574209 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574297 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574546 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574630 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574844 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.574931 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575188 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575279 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575507 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575593 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575813 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.575909 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576109 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576194 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576406 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576490 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576722 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.576816 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577024 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577111 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577340 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577427 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577660 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577758 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.577981 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.578124 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.578283 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.578370 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.578602 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.578729 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579012 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579153 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579346 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579433 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579650 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579745 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.579963 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580070 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580281 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580370 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580582 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580670 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580891 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.580979 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581197 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581291 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581515 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581601 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581831 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.581919 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582138 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582224 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582443 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582535 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582738 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.582825 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583071 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583174 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583388 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583475 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583697 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583791 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.583995 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.584167 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.584311 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.584409 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.584630 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.584717 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.585474 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.585578 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.585795 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.585891 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586173 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586259 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586479 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586568 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586784 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.586880 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587120 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587222 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587426 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587514 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587730 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.587819 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588030 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588116 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588339 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588429 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588641 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588731 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.588946 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589051 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589250 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589336 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589552 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589640 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589852 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.589939 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590157 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590249 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590459 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590554 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590759 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.590844 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591077 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591168 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591401 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591491 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591703 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.591791 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592005 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592100 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592318 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592403 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592623 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592708 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.592924 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593021 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593224 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593312 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593526 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593623 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593833 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.593937 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594135 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594222 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594436 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594531 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594736 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.594832 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595094 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595185 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595399 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595486 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595716 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.595884 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596039 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596127 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596351 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596437 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596656 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596744 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.596967 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597053 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597287 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597374 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597589 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597676 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597888 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.597974 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598193 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598353 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598494 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598582 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598794 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.598882 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599111 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599215 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599419 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599506 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599716 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.599802 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600014 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600114 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600311 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600416 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600640 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600728 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.600937 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601033 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601235 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601347 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601533 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601629 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601833 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.601920 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602133 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602222 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602432 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602520 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602734 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.602822 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603075 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603177 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603358 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603454 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603658 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603746 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.603992 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604078 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604293 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604386 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604606 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604692 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604911 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.604997 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605220 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605320 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605531 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605628 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605842 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.605937 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606149 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606244 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606455 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606543 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606765 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.606858 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607095 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607199 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607411 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607499 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607719 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.607922 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608029 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608249 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608338 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608559 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608650 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.608868 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609143 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609243 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609469 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609557 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609777 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.609863 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610084 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610171 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610389 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610475 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610697 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.610783 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611003 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611131 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611332 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611418 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611640 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611726 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.611947 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612042 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612252 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612339 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612572 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612674 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612884 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.612970 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613193 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613286 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613501 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613597 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613820 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.613906 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614131 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614219 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614440 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614529 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614749 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.614848 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615083 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615174 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615397 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615494 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615707 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.615794 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616016 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616129 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616361 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616471 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616660 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616751 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.616965 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617060 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617270 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617363 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617578 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617672 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617887 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.617983 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618191 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618278 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618498 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618585 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618807 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.618896 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619139 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619240 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619464 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619569 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619771 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.619867 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.620094 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.620287 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.620407 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.620857 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.620957 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.621190 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.621278 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.621515 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.621772 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.621938 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622088 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622176 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622418 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622507 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622739 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.622835 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623072 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623175 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623368 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623458 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623678 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623774 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.623985 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624072 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624285 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624381 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624586 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624681 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624896 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.624987 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625195 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625293 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625493 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625581 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625810 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.625895 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626117 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626335 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626435 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626676 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626763 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.626990 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627094 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627335 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627564 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627663 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627909 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.627988 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628224 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628318 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628548 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628683 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628851 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.628945 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629155 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629252 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629464 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629558 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629769 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.629856 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630072 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630168 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630375 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630462 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630678 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630773 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.630984 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.631107 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.631308 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.631402 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.631609 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.632196 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.632423 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.632519 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.632748 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.632836 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633049 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633134 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633349 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633436 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633651 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633783 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.633961 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634048 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634261 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634348 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634559 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634644 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634859 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.634945 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635180 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635280 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635485 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635571 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635788 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.635876 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636091 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636180 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636389 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636473 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636697 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636793 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.636997 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637084 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637302 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637390 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637603 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637699 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.637913 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638000 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638215 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638303 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638516 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638614 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638831 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.638918 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639161 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639252 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639465 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639569 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639766 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.639854 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640073 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640165 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640376 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640471 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640693 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.640784 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641002 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641230 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641326 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641559 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641646 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641877 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.641964 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.642207 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.642452 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.642541 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.642780 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.642867 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643121 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643211 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643424 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643512 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643745 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.643833 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644051 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644147 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644351 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644439 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644652 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644741 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.644958 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645053 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645265 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645352 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645571 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645658 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645877 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.645973 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646180 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646267 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646485 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646578 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646787 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.646874 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.647112 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.647202 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.647946 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648039 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648261 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648349 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648566 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648653 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648873 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.648961 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649180 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649268 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649484 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649580 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649791 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.649926 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650103 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650198 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650415 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650502 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650722 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.650855 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651079 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651172 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651353 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651439 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651659 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651759 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.651964 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652052 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652271 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652357 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652578 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652674 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652875 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.652961 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.653188 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.653518 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.653618 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.653826 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.653921 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.654126 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.654220 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.654535 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.654775 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.654854 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655115 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655196 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655437 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655514 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655757 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.655837 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656065 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656142 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656386 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656471 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656707 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.656785 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657018 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657096 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657336 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657488 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657643 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657721 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.657948 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658024 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658249 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658340 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658550 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658635 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658855 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.658939 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659218 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659298 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659522 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659599 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659825 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.659902 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660131 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660210 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660435 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660510 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660738 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.660815 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661038 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661115 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661336 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661411 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661638 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661714 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.661938 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662015 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662241 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662406 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662633 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662718 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.662958 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663087 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663300 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663387 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663602 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663701 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.663901 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664040 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664199 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664287 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664499 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664594 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664798 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.664891 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665098 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665185 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665405 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665573 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665708 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.665874 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666012 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666209 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666306 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666539 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666627 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666852 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.666939 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667194 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667304 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667506 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667594 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667823 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.667918 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668154 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668315 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668465 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668635 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668782 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.668953 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.669088 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.669269 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.669407 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.669622 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.669717 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670024 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670125 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670332 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670421 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670662 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670749 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.670968 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671078 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671305 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671422 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671611 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671919 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.671998 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672244 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672331 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672566 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672654 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672869 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.672964 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.673189 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.673277 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.673517 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.673694 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.673823 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674013 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674147 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674325 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674465 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674633 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674783 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.674958 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.675121 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.675291 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.675433 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.675600 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.675759 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676069 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676155 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676379 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676466 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676686 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676831 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.676995 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677083 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677303 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677398 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677616 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677713 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.677923 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678011 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678232 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678328 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678547 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678726 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678905 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.678994 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679252 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679339 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679573 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679668 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679879 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.679975 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680200 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680288 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680516 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680603 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680856 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.680944 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681165 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681287 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681477 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681574 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681787 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.681874 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.682088 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.682185 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.682328 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:37:26.682416 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.682700 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:37:26.682942 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:37:26.834679 n-d-831193-17 devstack@n-api.service[112929]: INFO dbcounter [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Registered counter for database nova_api Oct 04 17:37:26.836039 n-d-831193-17 devstack@n-api.service[112928]: INFO dbcounter [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Registered counter for database nova_api Oct 04 17:37:26.855451 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:26.856848 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:26.862175 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writer thread running {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:26.863253 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writer thread running {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:26.919719 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.context [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=112929) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:37:26.919887 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.context [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=112928) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:37:26.923470 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:37:26.923576 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:37:26.923936 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:37:26.924054 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:37:26.925481 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:37:26.925575 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:37:26.926196 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:37:26.926299 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:37:26.926632 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:37:26.926736 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:37:26.929160 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_concurrency.lockutils [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:37:26.929265 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:37:26.931156 n-d-831193-17 devstack@n-api.service[112929]: INFO dbcounter [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Registered counter for database nova_cell0 Oct 04 17:37:26.931263 n-d-831193-17 devstack@n-api.service[112928]: INFO dbcounter [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Registered counter for database nova_cell0 Oct 04 17:37:26.935122 n-d-831193-17 devstack@n-api.service[112928]: INFO dbcounter [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Registered counter for database nova_cell1 Oct 04 17:37:26.935244 n-d-831193-17 devstack@n-api.service[112929]: INFO dbcounter [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Registered counter for database nova_cell1 Oct 04 17:37:26.942134 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:26.943766 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:26.948523 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writer thread running {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:26.948694 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:26.953868 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writer thread running {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:26.955364 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writer thread running {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:27.091614 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:27.097157 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writer thread running {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:27.104881 n-d-831193-17 devstack@n-api.service[112929]: INFO dbcounter [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Registered counter for database nova_cell0 Oct 04 17:37:27.105995 n-d-831193-17 devstack@n-api.service[112928]: INFO dbcounter [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Registered counter for database nova_cell0 Oct 04 17:37:27.111812 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:27.115339 n-d-831193-17 devstack@n-api.service[112928]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:37:27.116696 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writer thread running {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:27.120159 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writer thread running {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:37:27.456376 n-d-831193-17 devstack@n-api.service[112929]: WARNING keystonemiddleware.auth_token [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:37:27.464275 n-d-831193-17 devstack@n-api.service[112929]: WARNING keystonemiddleware.auth_token [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:37:27.467381 n-d-831193-17 devstack@n-api.service[112928]: WARNING keystonemiddleware.auth_token [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:37:27.474964 n-d-831193-17 devstack@n-api.service[112928]: WARNING keystonemiddleware.auth_token [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:37:27.806384 n-d-831193-17 devstack@n-api.service[112929]: WARNING keystonemiddleware.auth_token [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:37:27.812244 n-d-831193-17 devstack@n-api.service[112929]: WARNING keystonemiddleware.auth_token [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:37:27.817457 n-d-831193-17 devstack@n-api.service[112929]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f747c6c9c0 pid: 112929 (default app) Oct 04 17:37:27.820442 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:37:27.821329 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002354 Oct 04 17:37:27.821737 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Tue Oct 4 17:37:27 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:37:27.824986 n-d-831193-17 devstack@n-api.service[112928]: WARNING keystonemiddleware.auth_token [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:37:27.831128 n-d-831193-17 devstack@n-api.service[112928]: WARNING keystonemiddleware.auth_token [None req-7e4be025-818d-445b-8cae-121a4b69a546 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:37:27.836404 n-d-831193-17 devstack@n-api.service[112928]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f747c6c9c0 pid: 112928 (default app) Oct 04 17:38:47.974336 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:47.976253 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Oct 04 17:38:47.976644 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:38:47.991269 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_api:SELECT=3 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:47.992244 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_cell1:SELECT=3 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:47.993097 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_cell0:SELECT=3 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:47.994132 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:48.877861 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-8beda8b9-d02e-4930-a16e-cf2be644a00c admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:48.910310 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-8beda8b9-d02e-4930-a16e-cf2be644a00c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926712 Oct 04 17:38:48.911194 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 17:38:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:38:51.514935 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:51.515927 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-c7c892ab-3ae0-49e0-a4af-b5f43eadccb9 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 04 17:38:51.516490 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:38:51.971719 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-dbde4582-68d1-40b2-b817-06414a2da251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:52.019720 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-dbde4582-68d1-40b2-b817-06414a2da251 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496536 Oct 04 17:38:52.020551 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:38:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:38:52.035264 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_api:SELECT=3 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:52.036186 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_cell0:SELECT=3 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:52.036941 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_cell1:SELECT=3 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:52.038306 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:38:52.243373 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-b8fcc745-6f24-46eb-824c-688ae6551721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:52.311587 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-b8fcc745-6f24-46eb-824c-688ae6551721 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282650 Oct 04 17:38:52.312189 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 17:38:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:38:54.995488 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-dbde4582-68d1-40b2-b817-06414a2da251 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:54.996678 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-dbde4582-68d1-40b2-b817-06414a2da251 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Oct 04 17:38:54.997595 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:38:55.785300 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-f51f3390-2025-44f7-994f-ff31f192391d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:55.836360 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-f51f3390-2025-44f7-994f-ff31f192391d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.831699 Oct 04 17:38:55.836494 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:38:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:38:55.850730 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-624df97c-5348-426c-aa0b-9b7475e48eb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:55.913930 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-624df97c-5348-426c-aa0b-9b7475e48eb3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067435 Oct 04 17:38:55.915128 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 17:38:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:38:58.823515 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-f51f3390-2025-44f7-994f-ff31f192391d admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:58.824539 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-f51f3390-2025-44f7-994f-ff31f192391d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 04 17:38:58.830429 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:38:59.361805 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-b88d0cbe-71e2-4a6d-b912-b1ce688c5baf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:59.381363 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-b88d0cbe-71e2-4a6d-b912-b1ce688c5baf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548400 Oct 04 17:38:59.382232 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:38:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:38:59.395231 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-5292704d-8808-4a0d-85ed-e7a21e06f1c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:38:59.426670 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-5292704d-8808-4a0d-85ed-e7a21e06f1c8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035975 Oct 04 17:38:59.427285 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 17:38:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:02.094958 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-b88d0cbe-71e2-4a6d-b912-b1ce688c5baf admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:02.096054 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-b88d0cbe-71e2-4a6d-b912-b1ce688c5baf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Oct 04 17:39:02.096472 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:02.556835 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-fda5bca3-74b7-457a-a723-768bdcee8d0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:02.578571 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-fda5bca3-74b7-457a-a723-768bdcee8d0e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475214 Oct 04 17:39:02.579523 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:02.593129 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-cad53eb0-2e1d-49ef-b7d8-126dc188e715 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:02.626047 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-cad53eb0-2e1d-49ef-b7d8-126dc188e715 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036796 Oct 04 17:39:02.626493 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 17:39:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:39:05.317229 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-fda5bca3-74b7-457a-a723-768bdcee8d0e admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:05.319453 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-fda5bca3-74b7-457a-a723-768bdcee8d0e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002643 Oct 04 17:39:05.335698 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:05.745162 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:05.770206 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444012 Oct 04 17:39:05.784215 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-c15729f0-915b-4cad-a92f-24d0d0ce54d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:05.794238 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:05.832542 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-c15729f0-915b-4cad-a92f-24d0d0ce54d0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052311 Oct 04 17:39:05.833655 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 17:39:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:08.455117 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:08.456131 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 04 17:39:08.456535 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:08.942105 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-aeabf39e-9361-44f1-96ef-67d6cc06dc5d admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:08.967015 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-aeabf39e-9361-44f1-96ef-67d6cc06dc5d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.503987 Oct 04 17:39:08.967585 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 17:39:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:39:12.265075 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:12.266035 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-de9c026b-85aa-47b4-a57b-fcc5721ad993 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 04 17:39:12.266035 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:39:12.692979 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-1d6a4392-eb77-4184-ad67-0b7e45da00b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:12.715268 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-1d6a4392-eb77-4184-ad67-0b7e45da00b3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.442664 Oct 04 17:39:12.715804 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:39:12.730287 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-184b86d2-2934-4832-919e-393e4e8262b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:12.764900 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-184b86d2-2934-4832-919e-393e4e8262b3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040309 Oct 04 17:39:12.765519 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 17:39:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:15.440363 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-1d6a4392-eb77-4184-ad67-0b7e45da00b3 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:15.441285 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-1d6a4392-eb77-4184-ad67-0b7e45da00b3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 04 17:39:15.441821 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:15.875579 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-ff359885-7bae-401a-9aad-169ed220a9d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:15.895725 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-ff359885-7bae-401a-9aad-169ed220a9d3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448111 Oct 04 17:39:15.896278 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:15.908853 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-0a06b697-ec1d-4580-8091-d02eda905b6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:15.934048 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-0a06b697-ec1d-4580-8091-d02eda905b6e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028749 Oct 04 17:39:15.934623 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 17:39:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:18.542865 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-ff359885-7bae-401a-9aad-169ed220a9d3 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:18.543911 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-ff359885-7bae-401a-9aad-169ed220a9d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 04 17:39:18.544334 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:18.900753 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-ca5e29e8-4843-4f6f-89ef-3d826c70d1bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:18.920657 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-ca5e29e8-4843-4f6f-89ef-3d826c70d1bf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.370245 Oct 04 17:39:18.921319 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:18.935385 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-7c41f16a-f05c-47ad-bb96-d9247b8c82c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:18.940042 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:39:18.966533 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-7c41f16a-f05c-47ad-bb96-d9247b8c82c9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035442 Oct 04 17:39:18.967733 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 17:39:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:21.595326 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-ca5e29e8-4843-4f6f-89ef-3d826c70d1bf admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:21.596512 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-ca5e29e8-4843-4f6f-89ef-3d826c70d1bf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Oct 04 17:39:21.596995 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:22.076674 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-92f7240d-a185-4452-9c0c-8d4a994e2a12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:22.102867 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-92f7240d-a185-4452-9c0c-8d4a994e2a12 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.499406 Oct 04 17:39:22.106466 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:39:22.119053 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-7fd52562-1b27-42c6-a38f-63e07c70c29e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:22.147516 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-7fd52562-1b27-42c6-a38f-63e07c70c29e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032605 Oct 04 17:39:22.148412 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 17:39:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:39:24.777060 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-92f7240d-a185-4452-9c0c-8d4a994e2a12 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:24.778068 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-92f7240d-a185-4452-9c0c-8d4a994e2a12 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 04 17:39:24.778653 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:25.228177 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "id": "5"}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:25.234275 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:39:25.250646 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466070 Oct 04 17:39:25.252141 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 17:39:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:39:25.266279 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-addee683-b431-41bd-a63d-7e8410e9571e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:25.293638 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-addee683-b431-41bd-a63d-7e8410e9571e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031203 Oct 04 17:39:25.294216 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 17:39:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:39:46.198594 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:46.199639 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 04 17:39:46.200032 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:46.210531 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:39:46.601290 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-f49a0646-e1e9-4595-ac4d-f828c49662e6 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:46.619774 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-f49a0646-e1e9-4595-ac4d-f828c49662e6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413680 Oct 04 17:39:46.620305 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 17:39:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:47.916336 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:47.917342 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-cfc5559a-0ddd-4b83-b55e-c73c027adfee admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 04 17:39:47.917744 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:48.449927 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-8316948d-9ef6-4c67-8266-ab9c39d472e0 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:48.455246 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.wsgi [None req-8316948d-9ef6-4c67-8266-ab9c39d472e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-8316948d-9ef6-4c67-8266-ab9c39d472e0 admin admin] Request method failure captured: Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Accept: application/json Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Accept-Encoding: gzip, deflate Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Connection: keep-alive Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Content-Length: 0 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Host: 10.222.0.33 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: Openstack-System-Scope: None Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: User-Agent: python-novaclient Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Auth-Token: gAAAAABjPG_jpvobdF-QWsNdJFSKjdnY1mE4MUKh5NC2aCONJFFZ2eXpp3k_kYuF6cbD0hL3ulVX6E6GUcbycRHPLMU7Uc0-I5nUBznYZI8yaRgnq96DRTOgJT9GvU0oshDcKM55JkCaKHyMYHP5QgnUuIwCQW1y27IZQWl_ogjB10xtHoVn_6c Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Id: None Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Name: None Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Identity-Status: Confirmed Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Is-Admin-Project: True Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Id: default Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Name: Default Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Name: admin Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Role: reader,member,admin Oct 04 17:39:48.458448 n-d-831193-17 devstack@n-api.service[112928]: X-Roles: reader,member,admin Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant: admin Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Name: admin Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-User: admin Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Id: default Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Name: Default Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: X-User-Name: admin Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: method: > Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: exception: Flavor 42 could not be found. Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: action_args: {'id': '42'} Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:48.460723 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:48.461883 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.463356 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-8316948d-9ef6-4c67-8266-ab9c39d472e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:48.464640 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-8316948d-9ef6-4c67-8266-ab9c39d472e0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389707 Oct 04 17:39:48.464640 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:39:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:39:48.470515 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-7f44ecd0-2b42-450a-beac-a1db7650a7ae admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:48.493397 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-7f44ecd0-2b42-450a-beac-a1db7650a7ae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026413 Oct 04 17:39:48.494032 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:48.511466 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-4719a42d-04f9-40b6-88b0-f9d0071a76a8 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:48.533892 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-4719a42d-04f9-40b6-88b0-f9d0071a76a8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026881 Oct 04 17:39:48.534432 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:48.544131 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-9c4dcb6d-a983-431d-aeda-f543ca2d1181 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:48.549460 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.wsgi [None req-9c4dcb6d-a983-431d-aeda-f543ca2d1181 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-9c4dcb6d-a983-431d-aeda-f543ca2d1181 admin admin] Request method failure captured: Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Accept: application/json Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Accept-Encoding: gzip, deflate Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Connection: keep-alive Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Content-Length: 0 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Host: 10.222.0.33 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: Openstack-System-Scope: None Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: User-Agent: python-novaclient Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Auth-Token: gAAAAABjPG_jpvobdF-QWsNdJFSKjdnY1mE4MUKh5NC2aCONJFFZ2eXpp3k_kYuF6cbD0hL3ulVX6E6GUcbycRHPLMU7Uc0-I5nUBznYZI8yaRgnq96DRTOgJT9GvU0oshDcKM55JkCaKHyMYHP5QgnUuIwCQW1y27IZQWl_ogjB10xtHoVn_6c Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Id: None Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Name: None Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Identity-Status: Confirmed Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Is-Admin-Project: True Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Id: default Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Name: Default Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Name: admin Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Role: reader,member,admin Oct 04 17:39:48.553477 n-d-831193-17 devstack@n-api.service[112929]: X-Roles: reader,member,admin Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant: admin Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Name: admin Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-User: admin Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Id: default Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Name: Default Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: X-User-Name: admin Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: method: > Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: exception: Flavor 42 could not be found. Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: action_args: {'id': '42'} Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:48.554967 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:48.555977 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:48.557020 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-9c4dcb6d-a983-431d-aeda-f543ca2d1181 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:48.558011 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-9c4dcb6d-a983-431d-aeda-f543ca2d1181 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014210 Oct 04 17:39:48.558011 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:39:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:39:49.764441 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-4719a42d-04f9-40b6-88b0-f9d0071a76a8 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:49.765489 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-4719a42d-04f9-40b6-88b0-f9d0071a76a8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 04 17:39:49.765881 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:50.282196 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-1f22ece6-8691-49e1-a994-55f404e431b2 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:50.287853 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.wsgi [None req-1f22ece6-8691-49e1-a994-55f404e431b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-1f22ece6-8691-49e1-a994-55f404e431b2 admin admin] Request method failure captured: Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Accept: application/json Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Accept-Encoding: gzip, deflate Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Connection: keep-alive Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Content-Length: 0 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Host: 10.222.0.33 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: Openstack-System-Scope: None Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: User-Agent: python-novaclient Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Auth-Token: gAAAAABjPG_ldiTOW_9CypAEAryZ-Q_JiPMa9riZoM15C5o3HuRgR0jwZiMUo-US3k9wYXfN4s1SNGI95oBgQt7bOaMBsHuNcdnPs9fEx3Qwgvaw8ar30-m2T6ELXg6MISxR5_cY99nRJeSV8Hwm_AuLz5j4mtaX5PTntQg-UEa2Bd01lOnI3_o Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Id: None Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Name: None Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Identity-Status: Confirmed Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Is-Admin-Project: True Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Id: default Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Name: Default Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Name: admin Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Role: reader,member,admin Oct 04 17:39:50.289333 n-d-831193-17 devstack@n-api.service[112929]: X-Roles: reader,member,admin Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant: admin Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Name: admin Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-User: admin Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Id: default Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Name: Default Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: X-User-Name: admin Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: method: > Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: exception: Flavor 84 could not be found. Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: action_args: {'id': '84'} Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:50.290871 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:50.291897 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.293050 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-1f22ece6-8691-49e1-a994-55f404e431b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:50.294058 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-1f22ece6-8691-49e1-a994-55f404e431b2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388968 Oct 04 17:39:50.294058 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:39:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:39:50.300456 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-4b4d3b11-4348-4fca-937b-7c439287d7a8 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:50.314995 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-4b4d3b11-4348-4fca-937b-7c439287d7a8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018111 Oct 04 17:39:50.315536 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:39:50.324632 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-77bbec95-c310-4d01-9da4-9d0cfefdab6a admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:50.339921 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-77bbec95-c310-4d01-9da4-9d0cfefdab6a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018691 Oct 04 17:39:50.340422 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:50.349183 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-d47ca601-d9f8-406b-ae6f-9f61c7cfaa0c admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:50.354618 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.wsgi [None req-d47ca601-d9f8-406b-ae6f-9f61c7cfaa0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-d47ca601-d9f8-406b-ae6f-9f61c7cfaa0c admin admin] Request method failure captured: Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Accept: application/json Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Accept-Encoding: gzip, deflate Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Connection: keep-alive Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Content-Length: 0 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Host: 10.222.0.33 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: Openstack-System-Scope: None Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: User-Agent: python-novaclient Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Auth-Token: gAAAAABjPG_ldiTOW_9CypAEAryZ-Q_JiPMa9riZoM15C5o3HuRgR0jwZiMUo-US3k9wYXfN4s1SNGI95oBgQt7bOaMBsHuNcdnPs9fEx3Qwgvaw8ar30-m2T6ELXg6MISxR5_cY99nRJeSV8Hwm_AuLz5j4mtaX5PTntQg-UEa2Bd01lOnI3_o Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Id: None Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Name: None Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Identity-Status: Confirmed Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Is-Admin-Project: True Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Id: default Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Name: Default Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Name: admin Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Role: reader,member,admin Oct 04 17:39:50.356152 n-d-831193-17 devstack@n-api.service[112928]: X-Roles: reader,member,admin Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant: admin Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Name: admin Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-User: admin Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Id: default Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Name: Default Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: X-User-Name: admin Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: method: > Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: exception: Flavor 84 could not be found. Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: action_args: {'id': '84'} Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:50.357682 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:50.358660 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:50.360037 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-d47ca601-d9f8-406b-ae6f-9f61c7cfaa0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:50.361287 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-d47ca601-d9f8-406b-ae6f-9f61c7cfaa0c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011700 Oct 04 17:39:50.361287 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:39:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:39:51.573806 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-77bbec95-c310-4d01-9da4-9d0cfefdab6a admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:51.574808 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-77bbec95-c310-4d01-9da4-9d0cfefdab6a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 04 17:39:51.575221 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:52.087442 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-0302b85a-4b1d-422a-ae66-448f600b3201 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:52.093191 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.wsgi [None req-0302b85a-4b1d-422a-ae66-448f600b3201 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-0302b85a-4b1d-422a-ae66-448f600b3201 admin admin] Request method failure captured: Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Accept: application/json Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Accept-Encoding: gzip, deflate Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Connection: keep-alive Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Content-Length: 0 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Host: 10.222.0.33 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: Openstack-System-Scope: None Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: User-Agent: python-novaclient Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Auth-Token: gAAAAABjPG_n-7HM8pSp24geuLpF6hLHdf1uPMNFr5Chi8Ni6lVltcQeF3Y3m0MA8o6x_EAF78bKdf4s4ZKldC9Q8Vh4hcfJGnHnyJTjNzEnegmOzsFa9mj6gB0XpWvLvrK9i5sKAgG7kHR0CUPM3NRtG7cqCXpDQpwGD2S-n2gmseaX5MqYpA8 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Id: None Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Domain-Name: None Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Identity-Status: Confirmed Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Is-Admin-Project: True Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Id: default Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Domain-Name: Default Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Project-Name: admin Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Role: reader,member,admin Oct 04 17:39:52.094687 n-d-831193-17 devstack@n-api.service[112928]: X-Roles: reader,member,admin Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant: admin Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-Tenant-Name: admin Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-User: admin Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Id: default Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-User-Domain-Name: Default Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: X-User-Name: admin Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: method: > Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: exception: Flavor 451 could not be found. Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: action_args: {'id': '451'} Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:52.096249 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:52.097175 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.098467 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-0302b85a-4b1d-422a-ae66-448f600b3201 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:52.100325 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-0302b85a-4b1d-422a-ae66-448f600b3201 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385705 Oct 04 17:39:52.100325 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:39:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:39:52.106639 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-519b28d2-3d74-498c-9d1f-957bc8753bb5 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:52.121891 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-519b28d2-3d74-498c-9d1f-957bc8753bb5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018926 Oct 04 17:39:52.122410 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:52.131768 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:52.146281 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018026 Oct 04 17:39:52.146838 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 17:39:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:39:52.155701 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-66eb6593-17a5-4820-bc1b-54a8a087f1cc admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:52.160503 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.wsgi [None req-66eb6593-17a5-4820-bc1b-54a8a087f1cc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-66eb6593-17a5-4820-bc1b-54a8a087f1cc admin admin] Request method failure captured: Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Accept: application/json Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Accept-Encoding: gzip, deflate Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Connection: keep-alive Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Content-Length: 0 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Host: 10.222.0.33 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Openstack-Api-Version: compute 2.92 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: Openstack-System-Scope: None Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: User-Agent: python-novaclient Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Auth-Token: gAAAAABjPG_n-7HM8pSp24geuLpF6hLHdf1uPMNFr5Chi8Ni6lVltcQeF3Y3m0MA8o6x_EAF78bKdf4s4ZKldC9Q8Vh4hcfJGnHnyJTjNzEnegmOzsFa9mj6gB0XpWvLvrK9i5sKAgG7kHR0CUPM3NRtG7cqCXpDQpwGD2S-n2gmseaX5MqYpA8 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Id: None Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Domain-Name: None Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Identity-Status: Confirmed Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Is-Admin-Project: True Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Id: default Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Domain-Name: Default Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Project-Name: admin Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Role: reader,member,admin Oct 04 17:39:52.162011 n-d-831193-17 devstack@n-api.service[112929]: X-Roles: reader,member,admin Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6194811899fe4185acee7448d85ed857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6194811899fe4185acee7448d85ed857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6194811899fe4185acee7448d85ed857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant: admin Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Id: 6194811899fe4185acee7448d85ed857 Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-Tenant-Name: admin Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-User: admin Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Id: default Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-User-Domain-Name: Default Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-User-Id: 67f1cea8289b48e590c7442d122f38bd Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: X-User-Name: admin Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: method: > Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: exception: Flavor 451 could not be found. Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: action_args: {'id': '451'} Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:39:52.164080 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:52.165015 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: ERROR nova.api.openstack.wsgi Oct 04 17:39:52.166387 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-66eb6593-17a5-4820-bc1b-54a8a087f1cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:39:52.167604 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-66eb6593-17a5-4820-bc1b-54a8a087f1cc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011689 Oct 04 17:39:52.167604 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:39:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:39:53.366257 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:53.367307 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 04 17:39:53.367737 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:53.883102 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-777f7681-b589-4b90-abd6-e8120f6a063b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:53.901993 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-777f7681-b589-4b90-abd6-e8120f6a063b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398301 Oct 04 17:39:53.902522 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 17:39:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:55.119416 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:55.120426 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 17:39:55.120814 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:55.634691 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-9378d383-cefe-4d44-88fa-cd943d634485 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:55.657546 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-9378d383-cefe-4d44-88fa-cd943d634485 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398386 Oct 04 17:39:55.658089 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 17:39:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:56.868709 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:56.869709 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 04 17:39:56.870095 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:57.385747 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-f9cabbcd-fbd8-4e51-8989-d922931f30b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:57.406208 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-f9cabbcd-fbd8-4e51-8989-d922931f30b3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400134 Oct 04 17:39:57.406747 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 17:39:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:39:58.622823 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:39:58.623868 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Oct 04 17:39:58.624249 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:39:59.139676 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-0217381a-698a-4e96-ab58-d0e15a3223df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:39:59.157418 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-0217381a-698a-4e96-ab58-d0e15a3223df admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395817 Oct 04 17:39:59.157948 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 17:39:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:00.361255 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:00.362257 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 04 17:40:00.362652 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:00.876829 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-7cc89c5a-dec2-4908-b162-0bf369773704 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:00.897814 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-7cc89c5a-dec2-4908-b162-0bf369773704 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400995 Oct 04 17:40:00.898341 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 17:40:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:40:58.477717 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.478727 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-5a7a7661-2a3b-4464-9687-9b6d3318df30 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 04 17:40:58.479144 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:58.490022 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:58.865018 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-2917df25-be83-474c-bf24-eefeb028d004 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.885896 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-2917df25-be83-474c-bf24-eefeb028d004 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400801 Oct 04 17:40:58.886421 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:40:58.907329 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_api:SELECT=14 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:58.910994 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-92c21bcf-e560-4704-9981-5b78df2998b1 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.918140 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-92c21bcf-e560-4704-9981-5b78df2998b1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012371 Oct 04 17:40:58.918647 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:40:58.930022 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-7b55833d-2020-4c3f-946e-29000e9e52d4 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.937140 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-7b55833d-2020-4c3f-946e-29000e9e52d4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010639 Oct 04 17:40:58.937631 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:58.949108 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.956408 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010798 Oct 04 17:40:58.957478 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:58.968534 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-5bc74de2-62ad-44a6-a424-4597ee4cca65 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:58.975510 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-5bc74de2-62ad-44a6-a424-4597ee4cca65 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010414 Oct 04 17:40:58.976003 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Tue Oct 4 17:40:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:46:18.622651 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:46:18.623692 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 04 17:46:18.624077 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:46:18.762622 n-d-831193-17 devstack@n-api.service[112929]: DEBUG dbcounter [-] [112929] Writing DB stats nova_api:SELECT=6 {{(pid=112929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:46:18.906216 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:46:18.911087 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:46:18.911561 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:46:18.911981 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:46:18.912684 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:46:18.913122 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:46:18.913533 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:46:18.950870 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-5ecb85e3-63f5-45bb-9531-7ae1c8e16f14 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.189612 Oct 04 17:46:18.951960 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:46:18 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:46:20.032709 n-d-831193-17 devstack@n-api.service[112928]: DEBUG nova.api.openstack.wsgi [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] Calling method '>' {{(pid=112928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:46:20.033723 n-d-831193-17 devstack@n-api.service[112928]: INFO nova.api.openstack.requestlog [None req-fb0d5dc3-02ba-4285-9616-bc5126e5eec7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 04 17:46:20.034117 n-d-831193-17 devstack@n-api.service[112928]: [pid: 112928|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 17:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:46:20.223840 n-d-831193-17 devstack@n-api.service[112929]: DEBUG nova.api.openstack.wsgi [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Calling method '>' {{(pid=112929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:46:20.227464 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:46:20.227931 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:46:20.228350 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:46:20.229045 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:46:20.229482 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:46:20.229889 n-d-831193-17 devstack@n-api.service[112929]: DEBUG oslo_concurrency.lockutils [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:46:20.252513 n-d-831193-17 devstack@n-api.service[112929]: INFO nova.api.openstack.requestlog [None req-e3bb6b0c-2f0f-4ea8-9538-4204b56b8534 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.079934 Oct 04 17:46:20.253047 n-d-831193-17 devstack@n-api.service[112929]: [pid: 112929|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:46:20 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:47:10.298172 n-d-831193-17 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 17:47:10.298723 n-d-831193-17 devstack@n-api.service[112927]: Tue Oct 4 17:47:10 2022 - graceful shutdown triggered... Oct 04 17:47:10.299341 n-d-831193-17 devstack@n-api.service[112928]: Gracefully killing worker 1 (pid: 112928)... Oct 04 17:47:10.299701 n-d-831193-17 devstack@n-api.service[112929]: Gracefully killing worker 2 (pid: 112929)... Oct 04 17:47:10.425830 n-d-831193-17 devstack@n-api.service[112928]: DEBUG dbcounter [-] [112928] Writing DB stats nova_api:SELECT=4 {{(pid=112928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:47:11.299159 n-d-831193-17 devstack@n-api.service[112927]: worker 1 buried after 1 seconds Oct 04 17:47:11.299159 n-d-831193-17 devstack@n-api.service[112927]: worker 2 buried after 1 seconds Oct 04 17:47:11.299159 n-d-831193-17 devstack@n-api.service[112927]: goodbye to uWSGI. Oct 04 17:47:11.300761 n-d-831193-17 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 17:47:11.301314 n-d-831193-17 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 17:47:11.304070 n-d-831193-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:47:11.317568 n-d-831193-17 devstack@n-api.service[128755]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:47:11 2022] *** Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: nodename: n-d-831193-17 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: machine: x86_64 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: clock source: unix Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: pcre jit disabled Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: detected number of CPU cores: 4 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: current working directory: / Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: your processes number limit is 47680 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: your memory page size is 4096 bytes Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: detected max file descriptor number: 2048 Oct 04 17:47:11.330479 n-d-831193-17 devstack@n-api.service[128755]: lock engine: pthread robust mutexes Oct 04 17:47:11.331682 n-d-831193-17 devstack@n-api.service[128755]: thunder lock: enabled Oct 04 17:47:11.331682 n-d-831193-17 devstack@n-api.service[128755]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:47:11.331682 n-d-831193-17 devstack@n-api.service[128755]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:47:11.374211 n-d-831193-17 devstack@n-api.service[128755]: Python main interpreter initialized at 0x5560136d19c0 Oct 04 17:47:11.374211 n-d-831193-17 devstack@n-api.service[128755]: python threads support enabled Oct 04 17:47:11.374211 n-d-831193-17 devstack@n-api.service[128755]: your server socket listen backlog is limited to 100 connections Oct 04 17:47:11.374211 n-d-831193-17 devstack@n-api.service[128755]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:47:11.374682 n-d-831193-17 devstack@n-api.service[128755]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:47:11.374682 n-d-831193-17 devstack@n-api.service[128755]: *** Operational MODE: preforking *** Oct 04 17:47:11.374902 n-d-831193-17 devstack@n-api.service[128755]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:47:11.374902 n-d-831193-17 devstack@n-api.service[128755]: spawned uWSGI master process (pid: 128755) Oct 04 17:47:11.375160 n-d-831193-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:47:11.376700 n-d-831193-17 devstack@n-api.service[128755]: spawned uWSGI worker 1 (pid: 128770, cores: 1) Oct 04 17:47:11.376700 n-d-831193-17 devstack@n-api.service[128755]: spawned uWSGI worker 2 (pid: 128771, cores: 1) Oct 04 17:47:11.376700 n-d-831193-17 devstack@n-api.service[128755]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:47:12.042335 n-d-831193-17 devstack@n-api.service[128770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:47:12.055052 n-d-831193-17 devstack@n-api.service[128771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:47:13.238869 n-d-831193-17 devstack@n-api.service[128771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:47:13.238869 n-d-831193-17 devstack@n-api.service[128771]: from cryptography.utils import int_from_bytes Oct 04 17:47:13.239694 n-d-831193-17 devstack@n-api.service[128771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:47:13.239694 n-d-831193-17 devstack@n-api.service[128771]: from cryptography.utils import int_from_bytes Oct 04 17:47:13.266440 n-d-831193-17 devstack@n-api.service[128770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:47:13.266440 n-d-831193-17 devstack@n-api.service[128770]: from cryptography.utils import int_from_bytes Oct 04 17:47:13.267118 n-d-831193-17 devstack@n-api.service[128770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:47:13.267118 n-d-831193-17 devstack@n-api.service[128770]: from cryptography.utils import int_from_bytes Oct 04 17:47:15.722247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:47:15.722841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:47:15.723062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:47:15.723436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:47:15.723700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:47:15.724090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.724423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.724746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.725234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.725576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.725893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.726218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.726546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.726882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.727176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.727496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.727825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831193-17 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.728204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.728475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.728782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.729111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.729418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.729745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.730062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.730589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.731917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.731917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.731917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.732200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.732332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.732638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.733083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.733294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.733703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.733907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.734340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831193-17 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.734662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.734975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.735322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.735746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.736061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.736374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.736697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.737036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.737348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.737680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.738003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.738325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.738649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.738955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.739300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.739609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.739930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.740240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.740548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.740803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.741113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.741439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.741763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.742090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.742346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.742601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.742923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.743272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.743590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.743904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.744216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.744534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.744838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.745146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.745455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.745774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.746103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.746467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.746794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.747074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.747399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.748066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.748497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.748816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.749194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.749496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.749814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.750171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.750498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.751089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.751407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.751723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.752100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.752556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.752710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.752937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.753246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.753557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.753890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.754197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.754508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.754819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.755173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.755467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.755774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.756088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.756395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.756708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.757015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.757324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.757636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.757946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.758255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.758578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.758906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.759242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.759555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.759868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.760179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.760512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.760825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.761142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.761479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.761794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.762103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.762427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.763018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.763357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.763688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.763999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.764310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.764633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.764949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.765255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.766086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.766400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.766706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.767014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.767341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.767648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.767953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.768277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.768601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.768917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.769229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.769537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.769860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.770206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.770547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.770899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.771245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.771584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.771921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.772243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.772562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.772881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.773212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.773526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.773841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.774160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.774482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.774801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.775164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.775487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.775806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.776129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.776450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.776776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.777346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.777705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.777844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.778104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.778425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.778746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.779106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.779441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.779760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.780074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.780388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.780736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.781054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.782114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.782446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.782766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.783119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.783442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.783758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.784075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.784401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.784712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.785057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.785376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.785706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.786027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.786345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.786673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.786992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.787335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.787652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.787965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.788277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.788588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.788903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.789213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.789538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.789873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.790194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.790530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.790843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.791179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.791496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.791813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.792125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.792442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.792755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.793065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.793392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.793705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.794014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.794352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.794659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.794972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.795317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.795633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.795949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.796265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.796581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.796941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.797257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.797573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.797915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.798323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.798633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.798966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.799321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.799761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.799929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.800244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.800554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.800867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.801183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.801499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.801814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.802131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.802441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.802751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.803308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.803464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.803714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.804025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.804341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.804650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.805003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.805309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.805660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.806002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.806332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.806658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.806980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.807327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.807643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.807959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.808275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.808592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.808917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.809232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.809556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.809870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.810198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.810519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.810840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.811251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.811571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.811917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.812260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.812620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.812948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.813269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.813590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.813908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.814222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.814543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.814866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.815217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.815535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.815860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.816183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.816510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.816825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.817152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.817461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.817780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.818118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.818456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.818769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.819305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.819649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.819957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.820276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.821121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.821121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.821261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.821502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.821835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.822143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.822459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.822776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.823116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.823440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.823753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.824066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.824399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.824732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.825050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.825455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.825720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.825996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.826328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.827085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.827085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.827570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.827570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.827897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.828794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.829092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.829412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.829727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.830053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.830370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.830722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.831013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.831368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.831706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.832174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.832339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.832638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.832958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.833270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.833586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.833916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.834233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.834549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.834865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.835204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.835535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.835857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.836444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.836783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.837100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.837426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.837781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.838098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.838439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.838770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.839119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.839445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.839753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.840065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.840375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.840692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.841000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.841310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.841620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.841937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.842474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.842639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.842882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.843291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.843609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.843977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.844305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.844616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.844949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.845265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.846082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.846393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.846704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.847826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.847826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.847826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.848317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.848462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.848664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.848981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.849414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.849604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.849905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.850256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.850620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.850836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.851169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.851577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.851835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.852120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.853974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.854216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.854528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.854842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.855205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.855488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.855804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.856113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.856434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.856745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.857054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.857360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.857721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.857985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.858295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.858623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.858939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.859272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.859612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.859925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.860235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.860543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.860855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.861184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.861507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.861816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.862131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.862441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.862751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.863088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.863407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.863716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.864026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.864334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.864644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.864950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.865277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.865593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.865899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.866190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.866502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.866852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.867186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.867552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.867866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.868183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.868507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.868826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.869143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.869463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.869774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.870093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.870409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.870727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.871071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.871375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.871703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.872021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.872338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.872662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.872986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.873319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.873632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.873950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.874271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.874585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.874904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.876258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.876258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.876258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.877088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.877088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.877088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.877491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.877693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.878015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.878332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.878687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.878986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.879322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.879636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.879948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.880267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.880578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.881031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.881349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.881666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.881977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.882293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.884897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.885705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.885705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.885873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.886131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.886442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.886753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.887084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.887417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.887729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.888062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.888504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.888828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.889142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.889570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.889890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.890208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.891066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.891427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.891766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.892080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.892406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.892725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.893059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.893391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.893713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.894037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.894352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.894685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.895024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.895383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.895715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.896156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.896487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.896810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.897139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.897471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.897783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.898093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.898409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.898722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.899085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.899383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.899695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.900018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.900337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.900651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.900962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.901273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.901601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.901910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.902239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.902560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.902889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.903247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.903562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.903892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.904209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.904521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.904839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.905150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.905501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.905814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.906144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.907073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.907421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.907742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.908086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.908428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.908756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.909073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.909397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.909729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.910043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.910355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.910672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.910986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.911326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.911637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.911950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.912261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.912573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.912888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.913221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.913534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.913864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.914178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.914489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.914806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.915145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.915501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.915811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.916152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.916466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.916804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.917131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.917451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.917769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.918091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.918410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.918732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.919074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.919471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.919715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.920033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.920358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.920948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.921280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.921601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.921952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.922269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.922588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.922907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.923248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.923566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.923885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.924204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.924544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.924881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.925215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.925560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.925886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.926209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.926531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.926850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.927259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.927580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.927892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.928217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.928537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.928856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.929173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.929487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.929807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.930123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.930440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.930752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.931091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.931413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.931753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.932097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.932425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.932744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.933062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.933387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.933969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.934289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.934633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.934971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.935330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.935657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.935983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.936414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.936728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.937040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.937360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.937774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.938088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.938421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.938739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.939073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.939404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.939723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.940322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.940680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.941021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.941356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.941689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.942016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.942331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.942662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.942977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.943333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.943657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.943975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.944288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.944600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.944924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.945241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.945552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.945868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.946179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.946515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.946828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.947171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.947515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.947807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.948198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.948599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.948949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.949106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.949318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.949632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.949949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.950258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.950576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.950944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.951288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.951601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.951940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.952252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.952564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.952893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.953767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.954099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.954421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.954742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.955135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.955468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.956074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.956418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.956749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.957101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.957441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.957754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.958070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.958383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.958716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.959051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.959374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.959694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.960007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.960324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.960804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.961013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.961258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.961572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.961885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.962200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.962516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.962831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.963172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.963497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.963855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.964179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.964501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.964823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.965145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.965468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.965785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.966100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.966415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.966733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.967092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.967418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.967733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.968173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.968492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.969374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.969701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.970018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.970346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.970679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.970998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.971420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.971736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.972073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.972428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.972764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.973172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.973485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.973797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.974109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.974422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.974744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.975079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.975398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.975707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.976020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.976625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.976625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.976935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.977246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.977557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.977866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.978175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.978540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.978793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.979128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.979440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.979755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.980063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.980194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:47:15.980777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:47:15.980909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.980909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.981275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:47:15.981469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.981605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:47:15.981730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.981869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:47:15.981999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.982126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.982255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.982389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.982575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.982764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.982947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.982947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.983335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.983527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.983672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.983803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.983927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.984048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.984168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.984317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.984465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.984614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.984742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.984929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.985059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.985183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.985367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.985493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831193-17 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.985613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.985795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.985930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.986114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.986276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.986414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.986540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.986745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.986881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.987082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.987218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.987426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.987582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.987732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.987883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.988039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.988244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.988409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.988555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.988691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.988869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.989013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.989210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.989360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.989505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.989651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.989845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.989985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.990130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.990267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.990445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.990589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.990762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.990902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.991127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.991344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.991546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.991705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.991842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.991977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831193-17 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.992114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.992252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.992408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.992557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.992694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.992841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.993010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.993279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.993442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.993649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.993836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.994034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.994220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.994418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.994622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.994826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.995063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.995254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.995409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.995625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.995776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.995922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.996069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.996213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.996350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.996589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.996794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.996948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.997083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.997282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:15.997469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.997671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:47:15.997841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.997841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.998198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.998198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.998541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.998733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.999250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.999490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:15.999737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.000504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.000744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.001337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.001672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.002108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.002362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.002597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.002955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.003478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.003802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.004124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.004666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.005067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.005359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.005697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.006019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.006562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.006762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.007024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.007440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.007837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.008406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.008763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.011333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.012906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.012906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.012906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.012906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.012906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.013690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.013690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.014807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.014807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.014807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.015064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.015160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.015486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.015883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.016704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.017025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.017339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.017659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.018114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.018685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.019102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.019430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.019751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.020176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.020501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.020839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.021160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.021481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.021817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.022135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.022450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.023464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.023793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.024117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.024454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.024768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.025089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.025495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.025731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.026044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.027359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.027359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.027359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.027825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.027825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.028383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.028563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.028847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.029190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.029514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.029837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.030589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.030589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:47:16.030972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.031345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.031640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.031969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.032316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.032660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.032989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.033313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.033650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.033984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.034498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.034659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.034972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.035591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.035923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.036276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.036605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.036932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.037265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.037592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.037922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.038264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.038600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.038931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.040880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.040880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.040880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.040880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.040880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.041581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.041581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.041776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.042017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.042341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.042664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.042996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.043611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.043951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.044273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.044593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.044913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.045232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.045589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.045903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.046229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.046561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.046916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.047271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.047602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.047923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.048249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.048566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.048882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.049201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.049518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.049838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.050155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.050488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.050831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.051179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.051529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.051848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.052168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.052489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.052815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.053134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.053459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.053778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.054094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.054431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.054755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.055094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.055432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.055748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.056066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.056394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.056714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.057063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.057411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.057844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.058189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.058514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.058839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.059224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.059572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.059888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.060229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.060565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.060892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.061208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.061531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.061746 n-d-831193-17 devstack@n-api.service[128771]: INFO dbcounter [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Registered counter for database nova_api Oct 04 17:47:16.061935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.062151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.063014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.063362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.063681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.064000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.064318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.064641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.064962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.065305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.065626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.065943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.066257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.066573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.066928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.067291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.067651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.068000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.068341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.068668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.068996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.069321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.069642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.069962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.070282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.070603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.070934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.071289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.071620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.071941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.072276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.072601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.079951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.081250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.082966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.083308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.083629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.083958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.084279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.084457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_db.sqlalchemy.engines [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.084583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.085004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.085231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.085558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.085939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.086184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.086507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.086846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.087348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.087534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.087875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.088175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.088490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.090706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.091571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.091571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.091868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.092021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writer thread running {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.092173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.092271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.092590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.092907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.093241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.093565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.093915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.094303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.094559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.094885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.095273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.095586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.095938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.096500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.096880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.096880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.097272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.097497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.098046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.098390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.098718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.099117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.099483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.099829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.100137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.100478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.100821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.101147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.101468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.101758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.102073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.102394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.102708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.103133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.103367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.103688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.104008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.104326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.104641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.104955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.105287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.105600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.105922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.106237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.106582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.106905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.107252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.107568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.107883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.108238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.108553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.108910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.109248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.109633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.109948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.110264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.110600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.110915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.111257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.111575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.111894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.112212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.112588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.112919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.113239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.113558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.113876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.114187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.114502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.114815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.115168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.115489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.115801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.116113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.116430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.116752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.117067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.143798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.146531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.147769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.149125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.150329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.151855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.153337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.154625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.155903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.157435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.158559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.159870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.160214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.160214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.160214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.160546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.160870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.161222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.161566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.161970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.162309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.162690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.163008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.163391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.163468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.context [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128771) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:47:16.163731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.164144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.164491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.164832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.165168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.165507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.165947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.166288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.166614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.166954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.167323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.167643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.167960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.168285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.168608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.168874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:16.169120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.169325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.169503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:16.170840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.170840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.170840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.170840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.171606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.171894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:16.172421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.172421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.172836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:16.173061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.173295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:16.173529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.173529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.173529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:16.175667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.175844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.176168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.176580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.176682 n-d-831193-17 devstack@n-api.service[128771]: INFO dbcounter [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Registered counter for database nova_cell0 Oct 04 17:47:16.176904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.177363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.177594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.177944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.178273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.178625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.178979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.179383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.179993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.180404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.180752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.181073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.181392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.181716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.181917 n-d-831193-17 devstack@n-api.service[128771]: INFO dbcounter [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Registered counter for database nova_cell1 Oct 04 17:47:16.182023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.182357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.182655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.182981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.183329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.183694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.184197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.184555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.184659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.185026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.185490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.185691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.187123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.187123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.187123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.187123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.187958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.188087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.188574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.188907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.189412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.189836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.190065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.190396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.190727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_db.sqlalchemy.engines [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.192477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.192963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.193051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_db.sqlalchemy.engines [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.193345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.193660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.193942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.194220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.194542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.194868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.195308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.195632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.195937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.196262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.196605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.196941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.197337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.197627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.197959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.198285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.198617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.198930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.199440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.199659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.200027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.200301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.200447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writer thread running {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.200629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.200995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.201272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.201593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.201918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.202000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writer thread running {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.202243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.202597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.203720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.204368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.204640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.204988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.205346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.205685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.206019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.206347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.206678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.207285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.207647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.207962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.208304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.208641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.208973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.209391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.210251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.210774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.211367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.212121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.212714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.213254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.213843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.214316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.214580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.214971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.215253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.215842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.216228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.216547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.216897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.217241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.217578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.217900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.218241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.218565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.218919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.219278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.219715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.220257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.220257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.220888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.220888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.221312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.221550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.221774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.222068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.222382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.222698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.223020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.223367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.223684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.224003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.224323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.224641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.225011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.225281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.225609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.225927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.226291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.226613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.226941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.227289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.227800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.228224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.228674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.228968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.229208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.229535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.229915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.230437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.230661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.230896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.231468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.231816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.232150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.232506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.232854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.233171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.233491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.233808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.234144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.234500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.234826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.235261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.235491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.235799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.236120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.236496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.236753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.237075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.237394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.237715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.238033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.238355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.238676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.239014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.239498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.239990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.240350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.240716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.240963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.241467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.241977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.242343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.242671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.243154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.243607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.243952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.244276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.244732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.245061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.245418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.245780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.246000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.246377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.246837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.247193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.247515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.247837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.248179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.248541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.248884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.249224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.249542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.249858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.251869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.251869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.251869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.252496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.252496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.252932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.253151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.253374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.253612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.253885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.254206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.254528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.254843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.255181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.255496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.255892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.256139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.256422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.256762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.257117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.257337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.257640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.257956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.258271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.258623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.258968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.259318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.259653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.260076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.260346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.260840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.261049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.261416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.262147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.262147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.262601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.262826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.263074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.263404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.263725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.264268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.264491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.264705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.265020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.265340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.266377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.266606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.266934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.267288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.267611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.267956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.268279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.268602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.268924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.269247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.269565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.269893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.270216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.270535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.271109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.271360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.271738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.271958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.272366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.272578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.272851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.273226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.273578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.273902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.274241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.274632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.274873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.275219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:47:16.275474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:47:16.340108 n-d-831193-17 devstack@n-api.service[128770]: INFO dbcounter [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Registered counter for database nova_api Oct 04 17:47:16.363052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_db.sqlalchemy.engines [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.370394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writer thread running {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.378895 n-d-831193-17 devstack@n-api.service[128771]: INFO dbcounter [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Registered counter for database nova_cell0 Oct 04 17:47:16.386423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_db.sqlalchemy.engines [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.391587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writer thread running {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.429230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.context [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128770) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:47:16.433382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:16.433789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:16.435420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:16.436173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:16.436630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:16.439292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:16.441338 n-d-831193-17 devstack@n-api.service[128770]: INFO dbcounter [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Registered counter for database nova_cell0 Oct 04 17:47:16.445709 n-d-831193-17 devstack@n-api.service[128770]: INFO dbcounter [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Registered counter for database nova_cell1 Oct 04 17:47:16.453837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_db.sqlalchemy.engines [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.456259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_db.sqlalchemy.engines [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.461595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writer thread running {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.464491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writer thread running {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.625611 n-d-831193-17 devstack@n-api.service[128770]: INFO dbcounter [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Registered counter for database nova_cell0 Oct 04 17:47:16.636073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_db.sqlalchemy.engines [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:47:16.641273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writer thread running {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:47:16.716299 n-d-831193-17 devstack@n-api.service[128771]: WARNING keystonemiddleware.auth_token [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:47:16.724371 n-d-831193-17 devstack@n-api.service[128771]: WARNING keystonemiddleware.auth_token [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:47:16.980631 n-d-831193-17 devstack@n-api.service[128770]: WARNING keystonemiddleware.auth_token [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:47:16.989328 n-d-831193-17 devstack@n-api.service[128770]: WARNING keystonemiddleware.auth_token [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:47:17.068199 n-d-831193-17 devstack@n-api.service[128771]: WARNING keystonemiddleware.auth_token [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:47:17.074298 n-d-831193-17 devstack@n-api.service[128771]: WARNING keystonemiddleware.auth_token [None req-5a5841b8-4455-49e6-b0ad-c47e71dcab2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:47:17.080218 n-d-831193-17 devstack@n-api.service[128771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560136d19c0 pid: 128771 (default app) Oct 04 17:47:17.347378 n-d-831193-17 devstack@n-api.service[128770]: WARNING keystonemiddleware.auth_token [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:47:17.353962 n-d-831193-17 devstack@n-api.service[128770]: WARNING keystonemiddleware.auth_token [None req-cc3f5933-a441-4508-8a03-984a0071afbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:47:17.359974 n-d-831193-17 devstack@n-api.service[128770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560136d19c0 pid: 128770 (default app) Oct 04 17:48:00.453262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.454944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.457546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.460082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.701613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.705350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.708832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:00.709675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:02.106069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:02.108686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.109312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.109914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.110943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.111590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.112173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.180938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1940da50-ad52-435f-b15f-4a53e9460e32 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-499110710", "id": 681155483, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:02.182252 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01945727-7b83-48b7-823e-b046baca3a81 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.494819 Oct 04 17:48:02.183219 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 17:48:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:48:02.271743 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1940da50-ad52-435f-b15f-4a53e9460e32 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.835847 Oct 04 17:48:02.276633 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:00 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:02.321789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ad10fe9-25e5-4e1a-9bb4-8c09653375ae tempest-AZAdminNegativeTestJSON-648653472 tempest-AZAdminNegativeTestJSON-648653472-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:02.325993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ad10fe9-25e5-4e1a-9bb4-8c09653375ae tempest-AZAdminNegativeTestJSON-648653472 tempest-AZAdminNegativeTestJSON-648653472-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '78e5324be9714bcab657546a16a3023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d825c270264468c90f316fc20e18fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ad10fe9-25e5-4e1a-9bb4-8c09653375ae tempest-AZAdminNegativeTestJSON-648653472 tempest-AZAdminNegativeTestJSON-648653472-project] Request method failure captured: Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHNRAmeoJfaWYcJ82GvJPBJBXqMHnfN9xSXVKypGvofjga7eWPR-dM4d-XZMxEQpCvZzgldvJuzrCN2WWVgh_8CCqpIEUzmhFJD7TTqJcS82AtKy4g7YdKezehKvyO_mU4BZRUehp8wZXwHrTLdKi05Y-XU8m3G2kTV3TDE9qH4VNw Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 4d825c270264468c90f316fc20e18fef Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AZAdminNegativeTestJSON-648653472 Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:02.340392 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d825c270264468c90f316fc20e18fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d825c270264468c90f316fc20e18fef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d825c270264468c90f316fc20e18fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d825c270264468c90f316fc20e18fef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AZAdminNegativeTestJSON-648653472 Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 4d825c270264468c90f316fc20e18fef Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-648653472 Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AZAdminNegativeTestJSON-648653472-project Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 78e5324be9714bcab657546a16a3023b Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AZAdminNegativeTestJSON-648653472-project Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:48:02.342506 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:02.344852 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:02.347000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ad10fe9-25e5-4e1a-9bb4-8c09653375ae tempest-AZAdminNegativeTestJSON-648653472 tempest-AZAdminNegativeTestJSON-648653472-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:02.349369 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ad10fe9-25e5-4e1a-9bb4-8c09653375ae tempest-AZAdminNegativeTestJSON-648653472 tempest-AZAdminNegativeTestJSON-648653472-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.160513 Oct 04 17:48:02.349975 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:48:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:02.481920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '.version_select at 0x7f6343410d30>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:02.492014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128771) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 17:48:02.495573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.496414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.496893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.554426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.556153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.556698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.599256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.600922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.601526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.614708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dc6e7b4f-9f7d-4888-af7e-dc3b49f97bc8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.335304 Oct 04 17:48:02.627101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 17:48:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:02.648533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d14b6785-effd-4271-921e-3064fe1e9869 tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1210605769", "id": 1605522083, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:02.734428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d14b6785-effd-4271-921e-3064fe1e9869 tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.376815 Oct 04 17:48:02.735055 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3/5] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:48:02 2022] POST /compute/v2.1/flavors => generated 471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:02.918216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Calling method '.version_select at 0x7f6343386ee0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:02.924021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.924545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.924983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.943020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.943541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.944094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.960357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.961260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.961975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.972454 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae01f183-3e9e-43e3-b33b-373bfe11a616 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.330679 Oct 04 17:48:02.983114 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 3/6] 10.222.0.33 () {60 vars in 1208 bytes} [Tue Oct 4 17:48:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:02.983114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:02.983114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.983114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.984421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:02.984421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:02.984421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:02.984421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:03.034483 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be1399ec-85b4-42dc-b328-069ddd679640 tempest-AZAdminV2TestJSON-1640024744 tempest-AZAdminV2TestJSON-1640024744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.060085 Oct 04 17:48:03.035416 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:48:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:03.040112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d72a8671-a010-44b2-b0bd-02ac4a3c920a tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:03.062808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbfb4de8-6d6a-44ff-adf5-81d4737ff3e4 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-4665529", "id": 1748482038, "os-flavor-access:is_public": "False"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.078063 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d72a8671-a010-44b2-b0bd-02ac4a3c920a tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/681155483" status: 202 len: 0 microversion: 2.1 time: 0.041455 Oct 04 17:48:03.079052 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:48:03 2022] DELETE /compute/v2.1/flavors/681155483 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:03.084342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8a276a5-b539-4f68-89f4-5d61028c63dc tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1843787110", "name": "tempest-test_aggregate-1988457374"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.086760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbfb4de8-6d6a-44ff-adf5-81d4737ff3e4 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.348525 Oct 04 17:48:03.088001 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4/9] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:02 2022] POST /compute/v2.1/flavors => generated 436 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:03.092732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb7e4c7f-d2fa-46c2-88c7-dcef2d789542 tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.122668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-e8a276a5-b539-4f68-89f4-5d61028c63dc tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 11747309-5983-4a1f-b4ee-ff27157b1355 for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:48:03.213148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8a276a5-b539-4f68-89f4-5d61028c63dc tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.132789 Oct 04 17:48:03.215216 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 6/10] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 17:48:03 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:03.226361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69a677dc-a323-4720-8904-77fe3a015614 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:03.277557 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-69a677dc-a323-4720-8904-77fe3a015614 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.058824 Oct 04 17:48:03.278717 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:03 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:03.304375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8150c786-a7e1-4f3a-a8b5-d53e8461beea tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.306568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb7e4c7f-d2fa-46c2-88c7-dcef2d789542 tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1605522083/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.217340 Oct 04 17:48:03.313765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 5/12] 10.222.0.33 () {62 vars in 1265 bytes} [Tue Oct 4 17:48:03 2022] POST /compute/v2.1/flavors/1605522083/os-extra_specs => generated 62 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:03.320338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca6f86a8-c709-4603-b0ac-cd823243fc76 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:03.337881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca6f86a8-c709-4603-b0ac-cd823243fc76 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.021962 Oct 04 17:48:03.341106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:48:03 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:03.347015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-527529dc-fafe-4358-9276-7efa61e6f325 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-922808788", "id": 1703515358, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.372664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-527529dc-fafe-4358-9276-7efa61e6f325 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.029659 Oct 04 17:48:03.375595 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 7/14] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:03 2022] POST /compute/v2.1/flavors => generated 416 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:03.381461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb6d1657-302c-47ce-bb6e-76228fd1525f tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:03.422093 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb6d1657-302c-47ce-bb6e-76228fd1525f tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1605522083" status: 202 len: 0 microversion: 2.86 time: 0.044213 Oct 04 17:48:03.423187 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 8/15] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 17:48:03 2022] DELETE /compute/v2.1/flavors/1605522083 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:48:03.431479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2df85c67-6472-4426-a85a-03e8c7637398 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:03.478733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df85c67-6472-4426-a85a-03e8c7637398 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:03.479656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df85c67-6472-4426-a85a-03e8c7637398 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:03.480365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df85c67-6472-4426-a85a-03e8c7637398 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:03.979752 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8150c786-a7e1-4f3a-a8b5-d53e8461beea tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1748482038/action" status: 200 len: 97 microversion: 2.1 time: 0.699023 Oct 04 17:48:03.992755 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 8/16] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:48:03 2022] POST /compute/v2.1/flavors/1748482038/action => generated 97 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:48:04.019252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-afa9f469-cabf-4f02-b8f6-5ff652512a48 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.070151 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-afa9f469-cabf-4f02-b8f6-5ff652512a48 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.076068 Oct 04 17:48:04.070750 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:03 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:04.075822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54d80fd3-d102-4b5b-b727-b7ca76eb520d tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.115761 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54d80fd3-d102-4b5b-b727-b7ca76eb520d tempest-FlavorMetadataValidation-1302729300 tempest-FlavorMetadataValidation-1302729300-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.86 time: 0.043374 Oct 04 17:48:04.117313 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 10/18] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:48:04 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:04.124842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19866d72-974a-4c9e-a89c-acc879e5e588 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:04.379765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2df85c67-6472-4426-a85a-03e8c7637398 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 0.955294 Oct 04 17:48:04.395548 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 9/19] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:04.402369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9dfc55d7-b0aa-478c-b93e-5e55a0dd18c4 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.441213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9dfc55d7-b0aa-478c-b93e-5e55a0dd18c4 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1703515358" status: 202 len: 0 microversion: 2.1 time: 0.043257 Oct 04 17:48:04.442876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:04 2022] DELETE /compute/v2.1/flavors/1703515358 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:04.452138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32bc994c-8600-46cb-82d8-f4136174dafe tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.530233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32bc994c-8600-46cb-82d8-f4136174dafe tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083235 Oct 04 17:48:04.531369 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:04.565766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68803e0a-e8a4-4e42-8a34-f94ecdd78881 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1968746972", "id": 1260145247, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:04.646545 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68803e0a-e8a4-4e42-8a34-f94ecdd78881 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.091962 Oct 04 17:48:04.663411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 12/22] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:04.677759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce8a17cb-f716-4540-b1ac-684da8de6c15 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.747391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce8a17cb-f716-4540-b1ac-684da8de6c15 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1260145247" status: 202 len: 0 microversion: 2.1 time: 0.078533 Oct 04 17:48:04.760036 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 13/23] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:04 2022] DELETE /compute/v2.1/flavors/1260145247 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:04.765895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b84a49b4-408d-40ca-99fe-987469d68f81 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:04.791958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b84a49b4-408d-40ca-99fe-987469d68f81 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030272 Oct 04 17:48:04.795084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 14/24] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:04.820208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5cbe195a-d6ec-4315-b159-e7da5d319919 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1895693414", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:04.904552 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-19866d72-974a-4c9e-a89c-acc879e5e588 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. Oct 04 17:48:04.907142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5cbe195a-d6ec-4315-b159-e7da5d319919 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.086877 Oct 04 17:48:04.963873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 15/25] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:04 2022] POST /compute/v2.1/flavors => generated 507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:04.983172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-03a88e08-7a92-43f7-a916-4c6551bd6544 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19866d72-974a-4c9e-a89c-acc879e5e588 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Request method failure captured: Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/flavors/1748482038/action HTTP/1.1 Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 67 Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHPjyJn5cM_5pLJCZkynJBemEH6rm6D7FQX5yir99jrS0NJEwWqiNda3JnhpptdYvVQS8Fv4KVuL4sghkA8YHnGpPlpxZ0BJRq4Wzyog7hshhhtp7aGGuFjr5KR-ljffa_dLqoq652haG1dtkF2uf746_J9p_hwxEz-oMF02HOXG3U Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:05.009688 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1461396f43ad4c06a5cb160da53bd419 Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} Oct 04 17:48:05.011230 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1748482038', 'body': {'addTenantAccess': {'tenant': 'a4f28a578ccd46daaa8f760f4b9426b2'}}} Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:48:05.011967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-a4f28a578ccd46daaa8f760f4b9426b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 17:48:05.013131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 17:48:05.014273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:48:05.015440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-a4f28a578ccd46daaa8f760f4b9426b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 17, 48, 4, 887826), 'updated_at': None, 'flavor_id': 17, 'project_id': 'a4f28a578ccd46daaa8f760f4b9426b2'}] Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:05.016455 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:05.017418 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:05.020121 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:05.023120 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. Oct 04 17:48:05.023120 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:05.029005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19866d72-974a-4c9e-a89c-acc879e5e588 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project a4f28a578ccd46daaa8f760f4b9426b2 combination. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:05.030994 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-19866d72-974a-4c9e-a89c-acc879e5e588 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1748482038/action" status: 409 len: 152 microversion: 2.1 time: 0.911264 Oct 04 17:48:05.032134 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 11/26] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:48:04 2022] POST /compute/v2.1/flavors/1748482038/action => generated 152 bytes in 914 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:05.056668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8f7de0c-5c48-4e94-bee3-ac44bfcbfdad tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:05.060510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-03a88e08-7a92-43f7-a916-4c6551bd6544 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/52cc41d3-196c-48d8-b588-32d67aee88b9" status: 202 len: 0 microversion: 2.1 time: 0.093379 Oct 04 17:48:05.061131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 16/27] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:48:04 2022] DELETE /compute/v2.1/flavors/52cc41d3-196c-48d8-b588-32d67aee88b9 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:05.084498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b20c722b-b2b3-46c6-a876-e07c358c98cd tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:05.154893 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b20c722b-b2b3-46c6-a876-e07c358c98cd tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088977 Oct 04 17:48:05.176086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 17/28] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:05.792032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1506910115", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "availability_zone": "tempest-test_az-1843787110"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:05.851160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:05.852190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:05.855266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:05.857953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:05.859122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:05.859578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:05.929888 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a8f7de0c-5c48-4e94-bee3-ac44bfcbfdad tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1748482038/action" status: 200 len: 21 microversion: 2.1 time: 0.885597 Oct 04 17:48:05.933067 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 12/29] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:48:05 2022] POST /compute/v2.1/flavors/1748482038/action => generated 21 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:48:05.961900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5ebd5e14-acb7-44f6-b483-57cfa34a4845 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1528939751", "id": "997c858b-2f15-4288-bdf7-93f8a17811af", "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:06.009198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5ebd5e14-acb7-44f6-b483-57cfa34a4845 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.074964 Oct 04 17:48:06.009801 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 13/30] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:05 2022] POST /compute/v2.1/flavors => generated 507 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:06.021085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94a9c314-d2ee-4ceb-808c-d8ce911b4240 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.046522 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94a9c314-d2ee-4ceb-808c-d8ce911b4240 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1748482038" status: 202 len: 0 microversion: 2.1 time: 0.029221 Oct 04 17:48:06.050084 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 14/31] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:06 2022] DELETE /compute/v2.1/flavors/1748482038 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:06.056685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a992a95e-6753-4fec-8cc0-f02eb1879d4c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.087388 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a992a95e-6753-4fec-8cc0-f02eb1879d4c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/997c858b-2f15-4288-bdf7-93f8a17811af" status: 202 len: 0 microversion: 2.1 time: 0.035750 Oct 04 17:48:06.088522 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 15/32] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:48:06 2022] DELETE /compute/v2.1/flavors/997c858b-2f15-4288-bdf7-93f8a17811af => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:06.097026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9982a0c7-076b-49d0-ad11-cefe741cec3b tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.151968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9982a0c7-076b-49d0-ad11-cefe741cec3b tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062095 Oct 04 17:48:06.152879 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 16/33] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:06.173984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e51d15d4-7b08-448e-8f8f-783ec05c8ba0 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.217065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e51d15d4-7b08-448e-8f8f-783ec05c8ba0 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062028 Oct 04 17:48:06.247848 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 17/34] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:06.268059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b80e5c4-c719-44fe-a91f-3cb56f2c50db tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-583589925", "id": 355722984, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:06.310283 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b80e5c4-c719-44fe-a91f-3cb56f2c50db tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.060313 Oct 04 17:48:06.311395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 18/35] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:06 2022] POST /compute/v2.1/flavors => generated 434 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:06.337744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-13b2e8d7-36c4-4bde-bfa1-d479fd86d29e tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1747025720", "id": 115473088, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:06.453389 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-13b2e8d7-36c4-4bde-bfa1-d479fd86d29e tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.136503 Oct 04 17:48:06.464617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 19/36] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:06 2022] POST /compute/v2.1/flavors => generated 411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:06.470629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60114a75-a3c6-48eb-b633-e93622c5e43f tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.481459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-60114a75-a3c6-48eb-b633-e93622c5e43f tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60114a75-a3c6-48eb-b633-e93622c5e43f tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Request method failure captured: Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/flavors/355722984/os-flavor-access HTTP/1.1 Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHPjyJn5cM_5pLJCZkynJBemEH6rm6D7FQX5yir99jrS0NJEwWqiNda3JnhpptdYvVQS8Fv4KVuL4sghkA8YHnGpPlpxZ0BJRq4Wzyog7hshhhtp7aGGuFjr5KR-ljffa_dLqoq652haG1dtkF2uf746_J9p_hwxEz-oMF02HOXG3U Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:06.488363 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1461396f43ad4c06a5cb160da53bd419 Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: exception: Access list not available for public flavors. Oct 04 17:48:06.489432 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'flavor_id': '355722984'} Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 17:48:06.490013 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:06.492632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60114a75-a3c6-48eb-b633-e93622c5e43f tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:06.493818 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60114a75-a3c6-48eb-b633-e93622c5e43f tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/355722984/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027594 Oct 04 17:48:06.495773 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 20/37] 10.222.0.33 () {58 vars in 1206 bytes} [Tue Oct 4 17:48:06 2022] GET /compute/v2.1/flavors/355722984/os-flavor-access => generated 91 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:06.510266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7819ad76-b880-4cc2-9889-d4633f85e1ee tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.536079 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7819ad76-b880-4cc2-9889-d4633f85e1ee tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/115473088" status: 200 len: 411 microversion: 2.1 time: 0.037585 Oct 04 17:48:06.547434 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 21/38] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:48:06 2022] GET /compute/v2.1/flavors/115473088 => generated 411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:06.553041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-48af9d7b-1474-4ff5-99ee-85e63e00742a tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:06.606598 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-48af9d7b-1474-4ff5-99ee-85e63e00742a tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/355722984" status: 202 len: 0 microversion: 2.1 time: 0.055670 Oct 04 17:48:06.610037 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 22/39] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:48:06 2022] DELETE /compute/v2.1/flavors/355722984 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:07.063822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2a3a8bc-83eb-4205-b77c-9d752b86790a tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:07.131167 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2a3a8bc-83eb-4205-b77c-9d752b86790a tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.519217 Oct 04 17:48:07.150093 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 23/40] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:06 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:07.160750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0f71d5d-b3ea-4385-9ef3-4d9f85c019e9 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:07.209062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=13 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:07.235066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:48:07.273352 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0f71d5d-b3ea-4385-9ef3-4d9f85c019e9 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.117837 Oct 04 17:48:07.283353 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 24/41] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:07 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:07.302924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3057a180-d968-4c87-9cae-0d101f39926b tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:07.365972 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3057a180-d968-4c87-9cae-0d101f39926b tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/115473088" status: 202 len: 0 microversion: 2.1 time: 0.086130 Oct 04 17:48:07.370056 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 25/42] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:48:07 2022] DELETE /compute/v2.1/flavors/115473088 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:07.383289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c1cca90c-5413-4683-a149-1fff184b807e tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1474431695", "id": 1344132004, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:07.420416 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c1cca90c-5413-4683-a149-1fff184b807e tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.048547 Oct 04 17:48:07.423399 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 26/43] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:07.442313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-95c093e2-bae8-4987-8812-00b4efdebeee tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:07.477393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-95c093e2-bae8-4987-8812-00b4efdebeee tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051806 Oct 04 17:48:07.492651 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 27/44] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:07.762322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d1cccd4-0b90-4931-a464-fb9f37fcaba1 tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:07.769527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d1cccd4-0b90-4931-a464-fb9f37fcaba1 tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4376f482250d45578c58e0c0dd3c49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f28a578ccd46daaa8f760f4b9426b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d1cccd4-0b90-4931-a464-fb9f37fcaba1 tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Request method failure captured: Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/flavors/1344132004/action HTTP/1.1 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 67 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHM3MRisc5MlIamGtIAkA-b21X0QBMRDLhsx5_sIZkviRo2yV69EBOlWniUDhQ_zxntnKFeiRpX1Z2w5jIgeRLPd790BgbkbBEhBmSbBsyu1PpM6Qrvc3p4C6zq6qWwxZ2uTGmOSdqaV6uljX5Cam_wV1Hmqmk1zqdrAAI7ecr7bgM Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a4f28a578ccd46daaa8f760f4b9426b2 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:07.777431 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a4f28a578ccd46daaa8f760f4b9426b2 Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsAccessNegativeTestJSON-1331293936-project Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4376f482250d45578c58e0c0dd3c49ca Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936-project Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} Oct 04 17:48:07.778581 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1344132004', 'body': {'addTenantAccess': {'tenant': 'a4f28a578ccd46daaa8f760f4b9426b2'}}} Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:07.779388 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:48:07.780341 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.782018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d1cccd4-0b90-4931-a464-fb9f37fcaba1 tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:07.782018 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d1cccd4-0b90-4931-a464-fb9f37fcaba1 tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] 10.222.0.33 "POST /compute/v2.1/flavors/1344132004/action" status: 403 len: 130 microversion: 2.1 time: 0.286364 Oct 04 17:48:07.785849 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 28/45] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:48:07 2022] POST /compute/v2.1/flavors/1344132004/action => generated 130 bytes in 292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:07.794990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3c7b159f-9b21-42a6-bb3c-7453ea808629 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1858273646", "id": 952381018, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:07.851974 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3c7b159f-9b21-42a6-bb3c-7453ea808629 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.064988 Oct 04 17:48:07.856600 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 29/46] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:07 2022] POST /compute/v2.1/flavors => generated 427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:07.864859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c438ccf-230b-45c2-9f26-91b01eb93d7e tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:07.904580 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c438ccf-230b-45c2-9f26-91b01eb93d7e tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1344132004" status: 202 len: 0 microversion: 2.1 time: 0.045729 Oct 04 17:48:07.907686 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 30/47] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:07 2022] DELETE /compute/v2.1/flavors/1344132004 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:07.916183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33aa5590-50d9-4f18-ba64-a9798b9ae809 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "952381018"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:07.959635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:48:07.960059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:48:07.961609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:48:07.962200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:48:07.962756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:48:07.969346 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-33aa5590-50d9-4f18-ba64-a9798b9ae809 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] HTTP exception thrown: Flavor 952381018 could not be found. Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33aa5590-50d9-4f18-ba64-a9798b9ae809 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Request method failure captured: Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 106 Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHNYxHmfykqcH8CtBEN_BWjcMAU-7HGfN4dH2yUVRZjljHV59Elb46uPnzZKdCKnwtSiA44U8KfJIPVj5lbqISbYG0qq3Kv_TZ6TyQu-fmlAGsuajCdF6N3ZNw_e6kD6hmi47n0QlPemYOx53PTsYC_97boU35HnJ95tytvWuL3UwY Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f0e585613d2940e4a99663deee7e1f1f Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsAdminTestJSON-1407857008 Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:07.975941 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0e585613d2940e4a99663deee7e1f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0e585613d2940e4a99663deee7e1f1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0e585613d2940e4a99663deee7e1f1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0e585613d2940e4a99663deee7e1f1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsAdminTestJSON-1407857008 Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f0e585613d2940e4a99663deee7e1f1f Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1407857008 Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsAdminTestJSON-1407857008-project Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 26ae95099e27453bb313d9a66eeed64a Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsAdminTestJSON-1407857008-project Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "test", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "952381018"}} Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:07.977135 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor 952381018 could not be found. Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '952381018'}}} Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 952381018 could not be found. Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.977828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 952381018 could not be found. Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:07.978811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:07.979892 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:07.979892 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:07.979892 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:07.979892 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 952381018 could not be found. Oct 04 17:48:07.979892 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:07.984469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33aa5590-50d9-4f18-ba64-a9798b9ae809 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Returning 400 to user: Flavor 952381018 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:07.986180 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-33aa5590-50d9-4f18-ba64-a9798b9ae809 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.076963 Oct 04 17:48:07.988001 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 31/48] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:07 2022] POST /compute/v2.1/servers => generated 80 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:48:07.991008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:07.994621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:07.995876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2ddce24d-a1b2-44ee-ba51-db8b7cb7b27a tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.000121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:08.001270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:08.003385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:08.004057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:08.063671 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2ddce24d-a1b2-44ee-ba51-db8b7cb7b27a tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072695 Oct 04 17:48:08.066482 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 32/49] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:08.073533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7434cdd5-f7c5-435f-9d79-40f908d72277 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.104695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Getting quotas for project 4a8401eab61d46e7a8e694b8009de6a3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:08.126478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Getting quotas for user 6a6a7f8c5a6c46bfbf218c6d94d59739 and project 4a8401eab61d46e7a8e694b8009de6a3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:08.135342 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7434cdd5-f7c5-435f-9d79-40f908d72277 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/952381018" status: 202 len: 0 microversion: 2.1 time: 0.066831 Oct 04 17:48:08.136354 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 33/50] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:48:08 2022] DELETE /compute/v2.1/flavors/952381018 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:08.152597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d8d68659-0969-4105-890f-8672facf9efb tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1135715289", "id": 9296645, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:08.164644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:48:08.169713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:48:08.188403 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d8d68659-0969-4105-890f-8672facf9efb tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.050720 Oct 04 17:48:08.189264 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 34/51] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:08 2022] POST /compute/v2.1/flavors => generated 430 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.194003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6e31e2c-fc4c-4560-ba59-cdab6d7c925f tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.227604 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6e31e2c-fc4c-4560-ba59-cdab6d7c925f tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036785 Oct 04 17:48:08.244711 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 35/52] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:08.250618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57eb4ed5-c9b5-4461-bfa8-c3ba216bdbf3 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:08.325346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:08.430678 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc041093-e0df-4cb2-91cd-a3df4e0c245a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.250460 Oct 04 17:48:08.440566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 18/53] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:48:08.474003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ab11ee4-10c6-46dc-a961-722702f6d0ce tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1059893520", "id": 1983530885, "os-flavor-access:is_public": "False"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:08.529669 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ab11ee4-10c6-46dc-a961-722702f6d0ce tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.074347 Oct 04 17:48:08.541774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 19/54] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:08 2022] POST /compute/v2.1/flavors => generated 415 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.554529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70af0dfc-ba2c-48a2-ba5c-9780ad1c9a30 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.560394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70af0dfc-ba2c-48a2-ba5c-9780ad1c9a30 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:08.688254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70af0dfc-ba2c-48a2-ba5c-9780ad1c9a30 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:08.717385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70af0dfc-ba2c-48a2-ba5c-9780ad1c9a30 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1243 microversion: 2.1 time: 0.174098 Oct 04 17:48:08.721437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 20/55] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1243 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:08.728057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d0c1ac5-8689-465e-9ca0-293d0173bc60 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1378664894", "id": 781488338, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:08.760996 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d0c1ac5-8689-465e-9ca0-293d0173bc60 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.038395 Oct 04 17:48:08.763450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 21/56] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:08 2022] POST /compute/v2.1/flavors => generated 411 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.788527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cdd0fc3-991c-4396-b322-7967c827044c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.844633 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cdd0fc3-991c-4396-b322-7967c827044c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 838 microversion: 2.1 time: 0.068518 Oct 04 17:48:08.854312 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 22/57] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 838 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.865827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-345cc566-4aeb-4fe6-8703-68d3c512b988 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.884460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-345cc566-4aeb-4fe6-8703-68d3c512b988 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 838 microversion: 2.1 time: 0.025757 Oct 04 17:48:08.890419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 23/58] 10.222.0.33 () {58 vars in 1177 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 838 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.903213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a45b23f4-32ab-46ad-97b7-8a967fdbd420 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.920789 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a45b23f4-32ab-46ad-97b7-8a967fdbd420 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 838 microversion: 2.1 time: 0.021157 Oct 04 17:48:08.930483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 24/59] 10.222.0.33 () {58 vars in 1171 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 838 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.935259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-439a8166-850d-4363-8f38-94a3c8931e86 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.947490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-439a8166-850d-4363-8f38-94a3c8931e86 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 838 microversion: 2.1 time: 0.015758 Oct 04 17:48:08.957985 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 25/60] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 838 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:08.966253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18f9f2ac-73d0-4a56-a6cf-93d36d7fefde tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:08.994587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18f9f2ac-73d0-4a56-a6cf-93d36d7fefde tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.035394 Oct 04 17:48:09.003885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 26/61] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 17:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.015744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9cd177f6-bdbc-4d4d-b207-01a291ecf643 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.040509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9cd177f6-bdbc-4d4d-b207-01a291ecf643 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.028756 Oct 04 17:48:09.055899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 27/62] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:09.061484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2196bcec-237f-48cf-b923-956b58ebb872 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.085130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2196bcec-237f-48cf-b923-956b58ebb872 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.027204 Oct 04 17:48:09.101059 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 28/63] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:09.107773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c222ac49-83cd-496d-9d09-6ca4c7ebf971 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.138172 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57eb4ed5-c9b5-4461-bfa8-c3ba216bdbf3 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/9296645/action" status: 200 len: 94 microversion: 2.1 time: 0.889878 Oct 04 17:48:09.138813 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 36/64] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:08 2022] POST /compute/v2.1/flavors/9296645/action => generated 94 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:48:09.149824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b1f54dc-5082-40b9-9b87-5e0a56eb497c tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:09.161816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0b1f54dc-5082-40b9-9b87-5e0a56eb497c tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4376f482250d45578c58e0c0dd3c49ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f28a578ccd46daaa8f760f4b9426b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b1f54dc-5082-40b9-9b87-5e0a56eb497c tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Request method failure captured: Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/flavors/9296645/action HTTP/1.1 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 70 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHM3MRisc5MlIamGtIAkA-b21X0QBMRDLhsx5_sIZkviRo2yV69EBOlWniUDhQ_zxntnKFeiRpX1Z2w5jIgeRLPd790BgbkbBEhBmSbBsyu1PpM6Qrvc3p4C6zq6qWwxZ2uTGmOSdqaV6uljX5Cam_wV1Hmqmk1zqdrAAI7ecr7bgM Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a4f28a578ccd46daaa8f760f4b9426b2 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:09.163929 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a4f28a578ccd46daaa8f760f4b9426b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a4f28a578ccd46daaa8f760f4b9426b2 Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936 Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsAccessNegativeTestJSON-1331293936-project Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4376f482250d45578c58e0c0dd3c49ca Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1331293936-project Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: {"removeTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} Oct 04 17:48:09.165023 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '9296645', 'body': {'removeTenantAccess': {'tenant': 'a4f28a578ccd46daaa8f760f4b9426b2'}}} Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can( Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:09.165629 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:48:09.166648 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:09.167589 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c222ac49-83cd-496d-9d09-6ca4c7ebf971 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.061560 Oct 04 17:48:09.169442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b1f54dc-5082-40b9-9b87-5e0a56eb497c tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:09.170643 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b1f54dc-5082-40b9-9b87-5e0a56eb497c tempest-FlavorsAccessNegativeTestJSON-1331293936 tempest-FlavorsAccessNegativeTestJSON-1331293936-project] 10.222.0.33 "POST /compute/v2.1/flavors/9296645/action" status: 403 len: 133 microversion: 2.1 time: 0.024831 Oct 04 17:48:09.176875 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 37/65] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:09 2022] POST /compute/v2.1/flavors/9296645/action => generated 133 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:48:09.183725 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 29/66] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:09.192264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-add35be0-f562-4238-8f5c-e15572da5e91 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.195568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a3303047-cb2d-4ed8-aafc-e2dee63fa010 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a4f28a578ccd46daaa8f760f4b9426b2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:09.236911 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-add35be0-f562-4238-8f5c-e15572da5e91 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/781488338" status: 202 len: 0 microversion: 2.1 time: 0.051509 Oct 04 17:48:09.237869 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 30/67] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:48:09 2022] DELETE /compute/v2.1/flavors/781488338 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:09.247218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05a38590-9098-4f65-9d18-fc20b6283f60 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.283335 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05a38590-9098-4f65-9d18-fc20b6283f60 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040371 Oct 04 17:48:09.284271 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 31/68] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.310488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43f1aedd-f031-47f0-8767-51e3eab1edaa tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.332543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43f1aedd-f031-47f0-8767-51e3eab1edaa tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1983530885" status: 202 len: 0 microversion: 2.1 time: 0.030638 Oct 04 17:48:09.339155 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 32/69] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:09 2022] DELETE /compute/v2.1/flavors/1983530885 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:48:09.344506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d77715d5-a445-4c38-a66f-8932d4a7db36 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.371627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d77715d5-a445-4c38-a66f-8932d4a7db36 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031025 Oct 04 17:48:09.392108 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 33/70] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.407232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77c2d9d0-568f-4a4e-8f42-500612bf097c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2002459413", "id": 1471176538, "os-flavor-access:is_public": "False"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:09.447444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77c2d9d0-568f-4a4e-8f42-500612bf097c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.053607 Oct 04 17:48:09.458396 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 34/71] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:09 2022] POST /compute/v2.1/flavors => generated 415 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:09.468853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4e04ce3-8446-49ef-a5e7-4444f7859d9f tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.516294 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4e04ce3-8446-49ef-a5e7-4444f7859d9f tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053718 Oct 04 17:48:09.536913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 35/72] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.557309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d99109f-6258-43db-966a-830ec9ab4d22 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.593888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d99109f-6258-43db-966a-830ec9ab4d22 tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054951 Oct 04 17:48:09.609561 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 36/73] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.619474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ddd8bcd-739b-486d-bf3a-c3c5ee1d5be9 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.642267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ddd8bcd-739b-486d-bf3a-c3c5ee1d5be9 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1471176538" status: 202 len: 0 microversion: 2.1 time: 0.030740 Oct 04 17:48:09.647671 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 37/74] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:09 2022] DELETE /compute/v2.1/flavors/1471176538 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:48:09.658786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-053ef9a4-36d4-4b1a-b763-f4a55928505e tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.704271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-053ef9a4-36d4-4b1a-b763-f4a55928505e tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055277 Oct 04 17:48:09.704876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 38/75] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:09.743833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e0d4e6d-90c7-4428-b49a-c68c1f69cfcc tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-122133540", "id": 1773134166, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:09.800817 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e0d4e6d-90c7-4428-b49a-c68c1f69cfcc tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.075177 Oct 04 17:48:09.801426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:09.827414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4232ae3-6e77-4965-865a-1d62d52117c1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:09.828033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4232ae3-6e77-4965-865a-1d62d52117c1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:09.993291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4232ae3-6e77-4965-865a-1d62d52117c1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:10.007369 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4232ae3-6e77-4965-865a-1d62d52117c1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1243 microversion: 2.1 time: 0.185529 Oct 04 17:48:10.023267 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 40/77] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:09 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1243 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:10.033232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-191cf298-ba85-446d-a384-cf1bcf8471dd tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:10.094117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-191cf298-ba85-446d-a384-cf1bcf8471dd tempest-FlavorsAdminTestJSON-1407857008 tempest-FlavorsAdminTestJSON-1407857008-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.070705 Oct 04 17:48:10.114209 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 41/78] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:10 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:10.125277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-761c2ad1-e4c6-4d2c-ade0-772dfdc45038 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:10.173319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-761c2ad1-e4c6-4d2c-ade0-772dfdc45038 tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1773134166" status: 202 len: 0 microversion: 2.1 time: 0.055860 Oct 04 17:48:10.178204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 42/79] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:10 2022] DELETE /compute/v2.1/flavors/1773134166 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:10.190904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07c25485-8024-4573-8e15-e8fe63e9543c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:10.196781 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a3303047-cb2d-4ed8-aafc-e2dee63fa010 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/9296645/action" status: 200 len: 21 microversion: 2.1 time: 1.018198 Oct 04 17:48:10.201004 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 38/80] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:09 2022] POST /compute/v2.1/flavors/9296645/action => generated 21 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:48:10.220027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf331e39-cd3a-4f5a-a3e5-825c29676dfe tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:10.278924 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07c25485-8024-4573-8e15-e8fe63e9543c tempest-FlavorsAdminTestJSON-2123858583 tempest-FlavorsAdminTestJSON-2123858583-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095317 Oct 04 17:48:10.279749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 43/81] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:10.318368 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf331e39-cd3a-4f5a-a3e5-825c29676dfe tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/9296645" status: 202 len: 0 microversion: 2.1 time: 0.109799 Oct 04 17:48:10.321952 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 39/82] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:48:10 2022] DELETE /compute/v2.1/flavors/9296645 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:10.328379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5827ba6-c1da-49f5-a679-202536594486 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:10.395257 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5827ba6-c1da-49f5-a679-202536594486 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071818 Oct 04 17:48:10.395870 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 44/83] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:10.416678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-068e394b-0cbb-4a49-9562-ff19d7dea7a6 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1712645416", "id": 1287019140, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:10.443306 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-068e394b-0cbb-4a49-9562-ff19d7dea7a6 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.029140 Oct 04 17:48:10.458205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e52c2e30-dc5b-472e-803f-25bd2cfce675 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "95d2bf2d7d2a43f9b94e2fd1a2fd97c2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:10.464765 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 40/84] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:11.037786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6d55a964-d1e6-4102-90f0-8e32b9f72df6 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:11.045048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6d55a964-d1e6-4102-90f0-8e32b9f72df6 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:11.615995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e52c2e30-dc5b-472e-803f-25bd2cfce675 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] HTTP exception thrown: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e52c2e30-dc5b-472e-803f-25bd2cfce675 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Request method failure captured: Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/flavors/1287019140/action HTTP/1.1 Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 70 Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHPjyJn5cM_5pLJCZkynJBemEH6rm6D7FQX5yir99jrS0NJEwWqiNda3JnhpptdYvVQS8Fv4KVuL4sghkA8YHnGpPlpxZ0BJRq4Wzyog7hshhhtp7aGGuFjr5KR-ljffa_dLqoq652haG1dtkF2uf746_J9p_hwxEz-oMF02HOXG3U Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:11.623777 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a2d5e8a49c1845b3bbf89553efe3245a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a2d5e8a49c1845b3bbf89553efe3245a Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081 Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1461396f43ad4c06a5cb160da53bd419 Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: {"removeTenantAccess": {"tenant": "95d2bf2d7d2a43f9b94e2fd1a2fd97c2"}} Oct 04 17:48:11.624950 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: exception: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '1287019140', 'body': {'removeTenantAccess': {'tenant': '95d2bf2d7d2a43f9b94e2fd1a2fd97c2'}}} Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 17:48:11.625534 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:11.626464 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e52c2e30-dc5b-472e-803f-25bd2cfce675 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Returning 404 to user: Flavor access not found for 31 / 95d2bf2d7d2a43f9b94e2fd1a2fd97c2 combination. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:11.627703 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e52c2e30-dc5b-472e-803f-25bd2cfce675 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1287019140/action" status: 404 len: 124 microversion: 2.1 time: 1.172847 Oct 04 17:48:11.631341 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 45/85] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:48:10 2022] POST /compute/v2.1/flavors/1287019140/action => generated 124 bytes in 1179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:11.637265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afc34748-8bb9-4726-9254-5558c892480c tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:11.737104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-afc34748-8bb9-4726-9254-5558c892480c tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1287019140" status: 202 len: 0 microversion: 2.1 time: 0.103462 Oct 04 17:48:11.737702 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 46/86] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:48:11 2022] DELETE /compute/v2.1/flavors/1287019140 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:11.772602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f79229fb-bd42-48df-885c-5a7213c222b7 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:11.808050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=77,nova_api:DELETE=16 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:11.851602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f79229fb-bd42-48df-885c-5a7213c222b7 tempest-FlavorsAccessNegativeTestJSON-1486686081 tempest-FlavorsAccessNegativeTestJSON-1486686081-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098577 Oct 04 17:48:11.852632 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 47/87] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:12.821469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Calling method '.version_select at 0x7f63429159d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:12.829877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128770) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 17:48:12.830834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:12.831922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:12.832611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:12.859569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:12.860169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:12.860685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:12.874601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:12.875467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:12.876279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:12.883379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dfc90d67-4d41-4244-ba94-23d7e39fee87 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.700675 Oct 04 17:48:12.892643 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 48/88] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:12.995956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:12.997728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:13.098481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6d55a964-d1e6-4102-90f0-8e32b9f72df6 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:13.129114 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6d55a964-d1e6-4102-90f0-8e32b9f72df6 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1243 microversion: 2.1 time: 2.099908 Oct 04 17:48:13.130423 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 41/89] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:11 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1243 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:13.393581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2455a17a-b82b-47ee-b22f-e506596fcd8c tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Calling method '.version_select at 0x7f634292ff70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:13.395531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2455a17a-b82b-47ee-b22f-e506596fcd8c tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '805c0f18b078496ca70b8ad289794f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88bc0b0c22947bf8d515a938e7cd768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2455a17a-b82b-47ee-b22f-e506596fcd8c tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Request method failure captured: Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hypervisors/n-h2-831193-17/search HTTP/1.1 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHZtpH49qiGLVGDc2nBKfx8t9V90MJU5iC0qLMb4j7nwDgmP_JS1YVhedxt1gU4q_iTcx3leDirWhQpaU_ti8SBJmoHDb7oOiTXGRzM5-jpmvVbNn5xFoScxvtPDS-D3C0d7uo5_kb-Wd1-gP_5ZLH3-Oywcsm336droizoFt7n95o Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a88bc0b0c22947bf8d515a938e7cd768 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:13.399682 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a88bc0b0c22947bf8d515a938e7cd768 Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-181488176-project Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 805c0f18b078496ca70b8ad289794f58 Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176-project Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:48:13.400969 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-h2-831193-17'} Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:13.401670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:48:13.402803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.404702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2455a17a-b82b-47ee-b22f-e506596fcd8c tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:13.406030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2455a17a-b82b-47ee-b22f-e506596fcd8c tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-831193-17/search" status: 403 len: 117 microversion: 2.1 time: 0.511096 Oct 04 17:48:13.407195 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 49/90] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 17:48:12 2022] GET /compute/v2.1/os-hypervisors/n-h2-831193-17/search => generated 117 bytes in 514 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:13.418637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Calling method '.version_select at 0x7f634281f4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:13.420469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:13.421488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:13.425152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:13.445935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Request method failure captured: Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHc4HV6gWBrvBTRnxkKJVONiiKjxxJAc9ma6zTINdTi2yzVrGVB4Q1U4g8WZbmcrwihUmIS88baCeb1iHRmxByHabxJ4GkWFqW7ZR7rIv6RlKIBrhJQg09NN-hrhckiMi7qamCNhMIL_Uc0KbE6b721RWBwU5saj3Ovi_CgRfxU6og Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: df9d80ae38c24705ab8bf55392fc297b Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:13.448068 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: df9d80ae38c24705ab8bf55392fc297b Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 40c349ac9f944fadadce416ab5bdfc5f Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:48:13.449334 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.450056 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.451219 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.451219 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:13.451219 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:13.451219 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:48:13.451219 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.452760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:13.453783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-06d65ccb-1c1c-40d2-a2d3-be598c1566ea tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.040735 Oct 04 17:48:13.454654 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 42/91] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 17:48:13 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:13.463848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Calling method '.version_select at 0x7f634283e310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:13.465794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:13.466480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:13.466922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:13.489993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:13.492667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:13.493760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:13.507577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:13.509140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:13.509762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:13.516934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3caa3103-ed9a-4cad-965a-697c5efe3098 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056983 Oct 04 17:48:13.518136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 50/92] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:48:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:13.530428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e31beb6-fddb-43b0-9e9b-f6af6e9619a6 tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Calling method '.version_select at 0x7f63427ab0d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:13.534073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e31beb6-fddb-43b0-9e9b-f6af6e9619a6 tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '805c0f18b078496ca70b8ad289794f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88bc0b0c22947bf8d515a938e7cd768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e31beb6-fddb-43b0-9e9b-f6af6e9619a6 tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Request method failure captured: Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHZtpH49qiGLVGDc2nBKfx8t9V90MJU5iC0qLMb4j7nwDgmP_JS1YVhedxt1gU4q_iTcx3leDirWhQpaU_ti8SBJmoHDb7oOiTXGRzM5-jpmvVbNn5xFoScxvtPDS-D3C0d7uo5_kb-Wd1-gP_5ZLH3-Oywcsm336droizoFt7n95o Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a88bc0b0c22947bf8d515a938e7cd768 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:13.540615 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a88bc0b0c22947bf8d515a938e7cd768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a88bc0b0c22947bf8d515a938e7cd768 Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176 Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-181488176-project Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 805c0f18b078496ca70b8ad289794f58 Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-181488176-project Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:48:13.541955 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1'} Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:13.542696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:48:13.543945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.545173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e31beb6-fddb-43b0-9e9b-f6af6e9619a6 tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:13.545173 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e31beb6-fddb-43b0-9e9b-f6af6e9619a6 tempest-HypervisorAdminNegativeUnderV252Test-181488176 tempest-HypervisorAdminNegativeUnderV252Test-181488176-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018185 Oct 04 17:48:13.548399 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 43/93] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:48:13 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:13.553741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Calling method '.version_select at 0x7f63432f7040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:13.559808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:13.560225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:13.560683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:13.581444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] HTTP exception thrown: No hypervisor matching '295b55cf-ee79-486c-8dc9-ad6e91037498' could be found. Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Request method failure captured: Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hypervisors/295b55cf-ee79-486c-8dc9-ad6e91037498/servers HTTP/1.1 Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHc4HV6gWBrvBTRnxkKJVONiiKjxxJAc9ma6zTINdTi2yzVrGVB4Q1U4g8WZbmcrwihUmIS88baCeb1iHRmxByHabxJ4GkWFqW7ZR7rIv6RlKIBrhJQg09NN-hrhckiMi7qamCNhMIL_Uc0KbE6b721RWBwU5saj3Ovi_CgRfxU6og Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: df9d80ae38c24705ab8bf55392fc297b Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:13.583025 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df9d80ae38c24705ab8bf55392fc297b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: df9d80ae38c24705ab8bf55392fc297b Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476 Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 40c349ac9f944fadadce416ab5bdfc5f Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: exception: No hypervisor matching '295b55cf-ee79-486c-8dc9-ad6e91037498' could be found. Oct 04 17:48:13.584522 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '295b55cf-ee79-486c-8dc9-ad6e91037498'} Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '295b55cf-ee79-486c-8dc9-ad6e91037498' could be found. Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.585125 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '295b55cf-ee79-486c-8dc9-ad6e91037498' could be found. Oct 04 17:48:13.586021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:13.587520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] Returning 404 to user: No hypervisor matching '295b55cf-ee79-486c-8dc9-ad6e91037498' could be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:13.589487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f53a44c-ac78-43d6-bd13-da79ecd49f85 tempest-HypervisorAdminNegativeUnderV252Test-1455023476 tempest-HypervisorAdminNegativeUnderV252Test-1455023476-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/295b55cf-ee79-486c-8dc9-ad6e91037498/servers" status: 404 len: 123 microversion: 2.1 time: 0.038854 Oct 04 17:48:13.590633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 51/94] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 17:48:13 2022] GET /compute/v2.1/os-hypervisors/295b55cf-ee79-486c-8dc9-ad6e91037498/servers => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:14.189273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:14.191379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:14.212128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:14.215284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:14.220050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:14.221982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:14.222625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:14.223196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:14.616066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:14.720344 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f8b99c46-7bd2-4463-9527-53c4fab269da tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1297 microversion: 2.1 time: 0.568993 Oct 04 17:48:14.728040 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 44/95] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:14 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1297 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:15.753776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:15.755412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:15.768826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:15.772882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:15.775593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:15.777871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:15.779472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:15.781872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:16.307108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:16.338722 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb2e08a6-6cfe-4eae-bd74-50dbe8c67571 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1297 microversion: 2.1 time: 0.589931 Oct 04 17:48:16.342778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 52/96] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:15 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1297 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:17.369727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:17.371791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:17.403286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:17.403796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:17.404563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:17.405745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:17.406221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:17.406653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:17.693833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1953773315", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:17.929799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:48:18.057870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:18.157738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:18.169654 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a17d5aa4-0faa-465c-922c-8ae5c1a360d7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.805198 Oct 04 17:48:18.190133 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 53/97] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:17 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:18.730453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:48:18.731071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:48:18.731606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:48:18.732095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:48:18.732450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:48:18.801980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:18.805620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:18.805929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:18.806522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:18.806956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:18.814505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:18.928537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Getting quotas for project eb489eee36bb40eba357a5aba5101c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:18.964540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Getting quotas for user 9f4a80d2cfce408e8e1bc355c1ecf288 and project eb489eee36bb40eba357a5aba5101c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:19.018454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:48:19.030762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:48:19.094299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Calling method '.version_select at 0x7f63427e04c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:19.103109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:19.104275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:19.114487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:19.115700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:19.116404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:19.127312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:19.218397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-baf5c748-8847-478a-839c-e104e454caba tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.025986 Oct 04 17:48:19.229241 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-786a84d3-8c32-4c97-b91d-85521e12720a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.444637 Oct 04 17:48:19.230736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 54/98] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:48:18 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:19.241449 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 45/99] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:48:19.247134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:19.269340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:19.279866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:19.281327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:19.281976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:19.283131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:19.283918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:19.284563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:19.716053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0b2f0c0-1220-4213-a956-3305d8748c39 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Calling method '.version_select at 0x7f634264bee0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:19.720641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c0b2f0c0-1220-4213-a956-3305d8748c39 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0b2f0c0-1220-4213-a956-3305d8748c39 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:19.735663 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 17:48:19.737323 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:19.738035 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:48:19.739078 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:19.743879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0b2f0c0-1220-4213-a956-3305d8748c39 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:19.747397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c0b2f0c0-1220-4213-a956-3305d8748c39 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.502169 Oct 04 17:48:19.748311 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 46/100] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:48:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 506 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:19.767141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-29b69b1b-6026-4e87-96f8-ea3d9db148af tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:19.771547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-29b69b1b-6026-4e87-96f8-ea3d9db148af tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:20.000135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:20.328679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.342221 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-345ff9ca-93e6-4d0b-8623-d2883e1ee01d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 1.110092 Oct 04 17:48:20.343735 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 55/101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:19 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:20.371772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7ea4cfa-3e3b-4781-9589-ebd236d9730e tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Calling method '.version_select at 0x7f634279a430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.379581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e7ea4cfa-3e3b-4781-9589-ebd236d9730e tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7ea4cfa-3e3b-4781-9589-ebd236d9730e tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/n-d-831193-17/reboot HTTP/1.1 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:20.381980 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17'} Oct 04 17:48:20.383337 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.384227 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:48:20.385141 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.389161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7ea4cfa-3e3b-4781-9589-ebd236d9730e tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.391997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7ea4cfa-3e3b-4781-9589-ebd236d9730e tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-831193-17/reboot" status: 403 len: 111 microversion: 2.1 time: 0.046605 Oct 04 17:48:20.396422 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 56/102] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/n-d-831193-17/reboot => generated 111 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:20.412364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dc0497a8-97f6-45df-8cbd-3bbf1c09d0ab tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Calling method '.version_select at 0x7f63427e0ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.457314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dc0497a8-97f6-45df-8cbd-3bbf1c09d0ab tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dc0497a8-97f6-45df-8cbd-3bbf1c09d0ab tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.477915 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:48:20.479367 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:20.480070 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:48:20.481032 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.481980 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.486344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dc0497a8-97f6-45df-8cbd-3bbf1c09d0ab tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.487513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dc0497a8-97f6-45df-8cbd-3bbf1c09d0ab tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.085369 Oct 04 17:48:20.488640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 57/103] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:48:20.500007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e28b409d-41bd-49cc-ada4-75cc7d486db7 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Calling method '.version_select at 0x7f634269a160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.505575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e28b409d-41bd-49cc-ada4-75cc7d486db7 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e28b409d-41bd-49cc-ada4-75cc7d486db7 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/n-d-831193-17 HTTP/1.1 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:20.509202 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17'} Oct 04 17:48:20.510384 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.511285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:48:20.512206 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.516567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e28b409d-41bd-49cc-ada4-75cc7d486db7 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.520570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e28b409d-41bd-49cc-ada4-75cc7d486db7 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-831193-17" status: 403 len: 109 microversion: 2.1 time: 0.026415 Oct 04 17:48:20.522949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 58/104] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/n-d-831193-17 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:48:20.540238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fd34e1d-db13-444b-8134-23f9b5284356 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Calling method '.version_select at 0x7f634269aca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.550874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6fd34e1d-db13-444b-8134-23f9b5284356 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fd34e1d-db13-444b-8134-23f9b5284356 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.556274 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:48:20.557438 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.558152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.559220 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.562359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fd34e1d-db13-444b-8134-23f9b5284356 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.567025 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6fd34e1d-db13-444b-8134-23f9b5284356 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038397 Oct 04 17:48:20.570040 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 59/105] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:20.582915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-635ff6ef-3a67-4496-9b69-850417c8752f tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Calling method '.version_select at 0x7f634269a310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.593150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-635ff6ef-3a67-4496-9b69-850417c8752f tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-635ff6ef-3a67-4496-9b69-850417c8752f tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/n-d-831193-17/shutdown HTTP/1.1 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:20.595939 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17'} Oct 04 17:48:20.597165 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.597956 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:48:20.598883 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.602474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-635ff6ef-3a67-4496-9b69-850417c8752f tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.604081 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-635ff6ef-3a67-4496-9b69-850417c8752f tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-831193-17/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027145 Oct 04 17:48:20.605923 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 60/106] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/n-d-831193-17/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:48:20.620013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a79df3c1-be58-4d36-8b67-2d185b24a115 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Calling method '.version_select at 0x7f63427e08b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.646987 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a79df3c1-be58-4d36-8b67-2d185b24a115 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a79df3c1-be58-4d36-8b67-2d185b24a115 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.654561 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:48:20.656319 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:20.656988 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:48:20.657939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.658849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.668052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a79df3c1-be58-4d36-8b67-2d185b24a115 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.672360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a79df3c1-be58-4d36-8b67-2d185b24a115 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.056551 Oct 04 17:48:20.673865 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 61/107] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:20.685047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66ae90b7-f9bd-47ec-8563-609c3f06bf68 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Calling method '.version_select at 0x7f634269a430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.699767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66ae90b7-f9bd-47ec-8563-609c3f06bf68 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66ae90b7-f9bd-47ec-8563-609c3f06bf68 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/n-d-831193-17/startup HTTP/1.1 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:48:20.711933 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17'} Oct 04 17:48:20.713257 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.713997 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:48:20.715354 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.722817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66ae90b7-f9bd-47ec-8563-609c3f06bf68 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.725345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66ae90b7-f9bd-47ec-8563-609c3f06bf68 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-831193-17/startup" status: 403 len: 110 microversion: 2.1 time: 0.045427 Oct 04 17:48:20.734615 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 62/108] 10.222.0.33 () {58 vars in 1194 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/n-d-831193-17/startup => generated 110 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:20.752232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29b69b1b-6026-4e87-96f8-ea3d9db148af tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.753154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c02dcb46-3155-4309-882f-b4e2bc8fc939 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Calling method '.version_select at 0x7f634269a820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:20.765572 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-29b69b1b-6026-4e87-96f8-ea3d9db148af tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1220 microversion: 2.1 time: 1.015401 Oct 04 17:48:20.771574 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 47/109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:19 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1220 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:20.783855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c02dcb46-3155-4309-882f-b4e2bc8fc939 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c02dcb46-3155-4309-882f-b4e2bc8fc939 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.792129 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:48:20.793393 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:20.794049 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:48:20.795136 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.796668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c02dcb46-3155-4309-882f-b4e2bc8fc939 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.802173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c02dcb46-3155-4309-882f-b4e2bc8fc939 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.058721 Oct 04 17:48:20.803571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 63/110] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 17:48:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:20.816581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab94d312-1ea1-40d2-b3e6-33c7acf5ab02 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Action: 'update', calling method: .version_select at 0x7f63425f7550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab94d312-1ea1-40d2-b3e6-33c7acf5ab02 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/os-hosts/n-d-831193-17 HTTP/1.1 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 51 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:20.824207 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:20.825387 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'n-d-831193-17', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.826588 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.828587 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.829574 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.829574 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:48:20.829574 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:48:20.829574 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.829574 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.832401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab94d312-1ea1-40d2-b3e6-33c7acf5ab02 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.837320 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab94d312-1ea1-40d2-b3e6-33c7acf5ab02 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-831193-17" status: 400 len: 199 microversion: 2.1 time: 0.025295 Oct 04 17:48:20.842286 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 48/111] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:48:20 2022] PUT /compute/v2.1/os-hosts/n-d-831193-17 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:20.861404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fb7160e-486e-4286-b0b8-58253a61c540 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Action: 'update', calling method: .version_select at 0x7f634269adc0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fb7160e-486e-4286-b0b8-58253a61c540 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-hosts/n-d-831193-17 HTTP/1.1 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 51 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.872266 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.873483 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.874834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.876089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.879074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fb7160e-486e-4286-b0b8-58253a61c540 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.884735 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7fb7160e-486e-4286-b0b8-58253a61c540 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-831193-17" status: 400 len: 189 microversion: 2.1 time: 0.034034 Oct 04 17:48:20.890366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 64/112] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:48:20 2022] PUT /compute/v2.1/os-hosts/n-d-831193-17 => generated 189 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:20.899575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab211e5f-c4ae-4ea0-a0e1-b57efc9fda90 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Action: 'update', calling method: .version_select at 0x7f63425fbf70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:20.916952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ab211e5f-c4ae-4ea0-a0e1-b57efc9fda90 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b908400ec5eb48828a64f0468a532461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a693c97088486688f0321bd9b20953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab211e5f-c4ae-4ea0-a0e1-b57efc9fda90 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Request method failure captured: Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/os-hosts/n-d-831193-17 HTTP/1.1 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 50 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHdyuArLsFomsWGNs01FBvPX-txZhrGBbJG7L32HVHc2MyWvs_qHdUAHgJpNe4-4SVP4-z3taluixKHYRsZi7grHexIR2dR85TNbfqymOQTKhtK90vN3lzxU1KczxuOJHk1w4Kpm43d2-yAtr_LlIvsLfHaBKCUPE37hU_IIJdcioY Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:20.924641 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47a693c97088486688f0321bd9b20953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47a693c97088486688f0321bd9b20953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47a693c97088486688f0321bd9b20953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 47a693c97088486688f0321bd9b20953 Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1784426038 Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b908400ec5eb48828a64f0468a532461 Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1784426038-project Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:48:20.925976 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'n-d-831193-17', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:20.926789 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:48:20.927963 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.931017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab211e5f-c4ae-4ea0-a0e1-b57efc9fda90 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.938374 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab211e5f-c4ae-4ea0-a0e1-b57efc9fda90 tempest-HostsAdminNegativeTestJSON-1784426038 tempest-HostsAdminNegativeTestJSON-1784426038-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-831193-17" status: 403 len: 111 microversion: 2.1 time: 0.043827 Oct 04 17:48:20.941123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 49/113] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:48:20 2022] PUT /compute/v2.1/os-hosts/n-d-831193-17 => generated 111 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:20.952682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2b27dc6-e85d-44f7-804c-e9e89b8c2b84 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Action: 'update', calling method: .version_select at 0x7f634269b820>, body: {"status": null, "maintenance_mode": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2b27dc6-e85d-44f7-804c-e9e89b8c2b84 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-hosts/n-d-831193-17 HTTP/1.1 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 42 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:20.974852 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: {"status": null, "maintenance_mode": null} Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:48:20.976821 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'n-d-831193-17', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi None Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.977578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:20.979520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2b27dc6-e85d-44f7-804c-e9e89b8c2b84 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2b27dc6-e85d-44f7-804c-e9e89b8c2b84 tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-831193-17" status: 400 len: 127 microversion: 2.1 time: 0.028977 Oct 04 17:48:20.980726 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 65/114] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:48:20 2022] PUT /compute/v2.1/os-hosts/n-d-831193-17 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:20.991504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Action: 'update', calling method: .version_select at 0x7f63432ec0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:20.997359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.hosts [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Enabling host nonexistent_hostname. Oct 04 17:48:21.018975 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Request method failure captured: Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 50 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHh5j2oB68Ow6xHHzGrm-YV_HwFuvcHjT8P_1BEddlpqBf0tsyPPMqO4cdeeZXrXOUAP9Vds0S5zzi0zXonyKMGChYoeyNQD_ww2ymeaVsNG4oYeDq4PyiWGZkDG5NaCQoxKQlxWSTPy_ALZuzcc3L-0wFLBgFai85Un6zx7VDXfB8 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:21.034910 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98af1db91674b32a33201ea8ee1e960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b98af1db91674b32a33201ea8ee1e960 Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-610918566 Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 41a81b8356fb46ee8bcc13f21ab96ac7 Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-610918566-project-admin Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:21.036392 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:48:21.037298 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:21.038425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:21.039604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:21.044238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b8f3387f-9990-426c-a0cc-e639069a18cb tempest-HostsAdminNegativeTestJSON-610918566 tempest-HostsAdminNegativeTestJSON-610918566-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056886 Oct 04 17:48:21.051360 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 50/115] 10.222.0.33 () {60 vars in 1211 bytes} [Tue Oct 4 17:48:20 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:48:21.372354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:21.373520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:21.400506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:21.405528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:21.407412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:21.410713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:21.417785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:21.418236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:21.800771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:21.803264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:21.822136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:21.826381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:21.830034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:21.831076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:21.834363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:21.835886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:21.997386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:22.007732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c792475f-eb9e-43fb-9357-559cc55bc8e1 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.641122 Oct 04 17:48:22.008323 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 66/116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:21 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:22.118467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:22.130024 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7b1ca8e9-e4c9-4c15-b6a8-be1600b85ca1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1224 microversion: 2.1 time: 0.334422 Oct 04 17:48:22.136640 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 51/117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:21 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1224 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:23.038630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:23.039377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:23.090860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:23.091896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:23.100922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:23.102267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:23.102818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:23.103913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:23.170116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:23.171783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:23.193277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:23.198505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:23.199298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:23.200127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:23.200676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:23.201145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:23.669300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:23.689032 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-390fbcff-a3da-44f2-8ece-58b093299c5f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1278 microversion: 2.1 time: 0.523050 Oct 04 17:48:23.708205 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 52/118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:23 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1278 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:24.568760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-353b4814-e4cd-48b0-ad25-27e9a9a106a1 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1492130224", "id": 1258979529, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:24.626026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=9 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:24.651809 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-353b4814-e4cd-48b0-ad25-27e9a9a106a1 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.941497 Oct 04 17:48:24.657191 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 53/119] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:48:23 2022] POST /compute/v2.1/flavors => generated 468 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:24.751406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:24.773472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9935f9fa-0fbf-4a29-a771-58e2ac222659 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 1.742031 Oct 04 17:48:24.776351 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 67/120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:23 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:24.786332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:24.788113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:24.808946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:24.826565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:24.832237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:24.833036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:24.833533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:24.833969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:24.997456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:25.010845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ec0b526-0cd3-426a-b68d-ebe338af38bf tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1278 microversion: 2.1 time: 0.230785 Oct 04 17:48:25.012077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 68/121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:24 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:25.431433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e6ca98e5-8386-43e2-91a2-0cbca59060e8 tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:25.471725 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e6ca98e5-8386-43e2-91a2-0cbca59060e8 tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] 10.222.0.33 "GET /compute/v2.1/flavors/1258979529" status: 200 len: 468 microversion: 2.61 time: 0.805122 Oct 04 17:48:25.475828 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 54/122] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Oct 4 17:48:24 2022] GET /compute/v2.1/flavors/1258979529 => generated 468 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:25.505880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-67441a8f-2c91-495a-9f5d-897019230ef8 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] Action: 'update', calling method: .version_select at 0x7f63438e5670>, body: {"flavor": {"description": "new"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:25.663452 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-67441a8f-2c91-495a-9f5d-897019230ef8 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1258979529" status: 200 len: 469 microversion: 2.61 time: 0.171485 Oct 04 17:48:25.669464 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 55/123] 10.222.0.33 () {62 vars in 1219 bytes} [Tue Oct 4 17:48:25 2022] PUT /compute/v2.1/flavors/1258979529 => generated 469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:25.719187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1fca9e5a-ddcf-4a77-b318-d1ed54f1110c tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:25.735816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852dd469-c574-4279-9728-1b0c9a725f1c", "tag": "124ea152-be67-4be1-8684-2a8377e9b444"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:25.776633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:25.778708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:25.779523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:25.814533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1fca9e5a-ddcf-4a77-b318-d1ed54f1110c tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.127651 Oct 04 17:48:25.833501 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 56/124] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:48:25 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:25.838839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:25.839867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:25.845422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Creating event network-changed:124ea152-be67-4be1-8684-2a8377e9b444 for instance 852dd469-c574-4279-9728-1b0c9a725f1c on n-h2-831193-17 Oct 04 17:48:25.845966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:48:25.846363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2264f94d-77df-46f1-9b60-d58ef61ea8d6 req-34ccaf9e-6f43-4886-a359-9e5d182760bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:48:25.847561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:25.848200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:25.848785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:25.849509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:25.849940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:25.850286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:25.850981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:25.852126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:25.852791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:25.853515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:25.862273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:25.863267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:25.892429 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.rpcapi [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 17:48:25.895574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] Releasing lock "compute-rpcapi-router" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:48:25.932516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-148d4bbd-cbcc-4314-b8bc-192216988088 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.778513 Oct 04 17:48:25.933772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 69/125] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:25.949504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-94d8b5e7-659a-4d53-b164-d9d6a23de28f tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:26.006917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-94d8b5e7-659a-4d53-b164-d9d6a23de28f tempest-FlavorsV261TestJSON-323969047 tempest-FlavorsV261TestJSON-323969047-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.068585 Oct 04 17:48:26.009778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 70/126] 10.222.0.33 () {60 vars in 1166 bytes} [Tue Oct 4 17:48:25 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:26.026348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e98cf174-a8f6-4efa-b0b5-15568e63877e tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:26.053979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e98cf174-a8f6-4efa-b0b5-15568e63877e tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1258979529" status: 202 len: 0 microversion: 2.61 time: 0.032091 Oct 04 17:48:26.054693 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 71/127] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 17:48:26 2022] DELETE /compute/v2.1/flavors/1258979529 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:48:26.062764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:26.063875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:26.075578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:26.076945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:26.078135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:26.080251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:26.080886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:26.081494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:26.281800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:26.292783 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb41871e-02f0-4286-bbc1-d133a107f8a5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1278 microversion: 2.1 time: 0.236681 Oct 04 17:48:26.298109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 72/128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:26 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:26.306529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bc30a9e-b176-4840-b2ef-035c312654c7 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:26.367629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8bc30a9e-b176-4840-b2ef-035c312654c7 tempest-FlavorsV261TestJSON-374338725 tempest-FlavorsV261TestJSON-374338725-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.067719 Oct 04 17:48:26.372870 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 73/129] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:48:26 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:26.581254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:26.598638 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4dda8a98-5d50-4ab3-b3a6-7d5d1b1326ff tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.763719 Oct 04 17:48:26.616937 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 57/130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:25 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:27.333477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:27.334896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:27.345731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:27.353996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:27.354463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:27.355261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:27.365731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:27.366325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:27.634673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:27.635337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:27.648067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:27.648699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:27.649002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:27.649719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:27.656958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:27.657427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:27.988079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:28.000478 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-459ab9a6-ca8a-457d-8157-f84de99b106e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.670557 Oct 04 17:48:28.001412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 74/131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:27 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:28.259989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:28.299430 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dccc1189-2eab-438b-ae78-0f0295722f5f tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.672285 Oct 04 17:48:28.308782 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 58/132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:27 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:29.038191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:29.039503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:29.041866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:29.060995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:29.061767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:29.064301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:29.065230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:29.066227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:29.067536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:29.848672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18958c41-3fbc-4f6e-916f-ceb50bae9625 tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:29.917757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18958c41-3fbc-4f6e-916f-ceb50bae9625 tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 17:48:28" status: 200 len: 318 microversion: 2.1 time: 1.029364 Oct 04 17:48:29.918690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 75/133] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 17:48:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017%3A48%3A28 => generated 318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:29.921512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18958c41-3fbc-4f6e-916f-ceb50bae9625 tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:29.923345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18958c41-3fbc-4f6e-916f-ceb50bae9625 tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003053 Oct 04 17:48:29.925975 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 76/134] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 17:48:29 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 17:48:29.943687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:29.944326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:29.964125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:29.966052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:29.966517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:29.969011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:29.969881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:29.970328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:30.194474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:30.212102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-486d16bc-9354-491c-a571-183eca48f65a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 1.178217 Oct 04 17:48:30.217010 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 59/135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:29 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:30.234728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f453114d-d8d2-42b9-b357-239e4d313daf tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:30.300243 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f453114d-d8d2-42b9-b357-239e4d313daf tempest-InstanceUsageAuditLogTestJSON-581330933 tempest-InstanceUsageAuditLogTestJSON-581330933-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.080448 Oct 04 17:48:30.312676 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 60/136] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:48:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:31.239432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:31.240135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:31.266513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:31.280733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:31.281549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:31.283583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:31.288281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:31.290907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:32.047435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:32.064287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=83 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:32.099255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:32.104977 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00e45459-2d20-4cb4-af01-40c4f394db8b tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 2.175484 Oct 04 17:48:32.133420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 77/137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:29 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:32.136735 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd9dfbbf-82e8-4f78-a4ce-1c204fd12622 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.898920 Oct 04 17:48:32.138566 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 61/138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:31 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:32.719566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de", "tag": "334ec30e-7ec7-4474-8bef-17777feef31f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:32.784115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:32.784115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:32.787932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:32.834010 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] Creating event network-changed:334ec30e-7ec7-4474-8bef-17777feef31f for instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de on n-h1-831193-17 Oct 04 17:48:32.845559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2a0aafa2-f68d-4ab2-a110-a742366456dc req-4eca92b7-d23d-478e-8d5a-9f3c1f094738 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709615 Oct 04 17:48:32.850962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 78/139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:33.142449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:33.143151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:33.157627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:33.160876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:33.162400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:33.165132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:33.165356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:33.165888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:33.166332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:33.167059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:33.184529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:33.188611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:33.189718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:33.195886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:33.195886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:33.195886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:33.660992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:33.689132 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bb5ccef7-d05f-4477-8f77-0b919b3d3f66 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.551960 Oct 04 17:48:33.693748 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 62/140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:33 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:34.148393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:34.173393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-072f6583-49fd-4d16-a1e0-2094605ac777 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 1.012950 Oct 04 17:48:34.176633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 79/141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:33 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:34.311789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Calling method '.version_select at 0x7f63424b5b80>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:34.316399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.324709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.328151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.367650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.368612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.369304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.484759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.485622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.486355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.526549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.527581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.528259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.575356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.576369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.580394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.599004 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9afc8294-085e-4a17-8683-548f2ab7c9cc tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.903459 Oct 04 17:48:34.602579 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 63/142] 10.222.0.33 () {60 vars in 1243 bytes} [Tue Oct 4 17:48:33 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:34.626891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Calling method '.version_select at 0x7f634269a280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:34.642459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.648172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.648895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.703700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.714097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.718214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:34.719496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:34.723127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.727435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.728489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.729282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.730386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.731311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.735536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.835583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.839409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.842206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.886652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.892386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.894166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.924292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.925657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.926712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.937076 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21e5286d-f156-48dc-bba9-33074dc36e7f tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.314163 Oct 04 17:48:34.938438 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 80/143] 10.222.0.33 () {60 vars in 1222 bytes} [Tue Oct 4 17:48:34 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:34.958286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Calling method '.version_select at 0x7f634266e5e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:34.964275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.965417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.967266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:34.990931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:34.992080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:34.992827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:35.003589 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f1b7897-f315-4ece-a445-83b9979cd7c2 tempest-HypervisorAdminV253TestBase-1064017971 tempest-HypervisorAdminV253TestBase-1064017971-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/b585517e-09f0-4ad7-a018-6fca8c322e47" status: 200 len: 794 microversion: 2.53 time: 0.055653 Oct 04 17:48:35.005428 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 81/144] 10.222.0.33 () {60 vars in 1298 bytes} [Tue Oct 4 17:48:34 2022] GET /compute/v2.1/os-hypervisors/b585517e-09f0-4ad7-a018-6fca8c322e47 => generated 794 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:35.156693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:35.182877 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2e8c7574-58df-4efd-b7a7-014cd51d4934 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.468570 Oct 04 17:48:35.199978 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 64/145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:34 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:35.202866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:35.204295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:35.217055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:35.223326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:35.226882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:35.229628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:35.237792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:35.240700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:35.884793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:36.051959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:36.085152 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26d8488e-78fc-4b34-8c5f-208ccd769e43 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.886806 Oct 04 17:48:36.098057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 82/146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:35 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:36.215294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:36.216022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:36.238083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:36.239930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:36.241256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:36.242259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:36.244356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:36.247059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:36.707422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:36.716635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b18b4108-64fb-4276-8c44-9bb231d0d554 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.506292 Oct 04 17:48:36.735173 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 65/147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:36 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:37.129084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:37.130588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:37.153315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:37.156608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:37.158765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:37.160720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:37.161451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:37.162363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:37.679604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:37.700755 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01f5af36-392c-4486-b2f2-b3aeb171ea9a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.576433 Oct 04 17:48:37.716373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 83/148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:37 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:37.745573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:37.747925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:37.776222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:37.777310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:37.778195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:37.780078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:37.781081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:37.782754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:38.095732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:38.111807 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30fbc7c8-90bb-4cb3-b5f9-2dc6c56b5c74 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.372468 Oct 04 17:48:38.113077 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 66/149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:37 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:38.734868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:38.737371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:38.745263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:38.746197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:38.746839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:38.748014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:38.750250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:38.752526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:39.177165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:39.177814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:39.179270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:39.191229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8b8d81d-d69b-4e23-aaf2-4abcf2f04ea4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.464192 Oct 04 17:48:39.191814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 84/150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:38 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:39.203499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:39.204534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:39.206127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:39.208776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:39.209508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:39.210123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:39.675153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:39.684534 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-18012be6-46d9-4e37-9cd5-5d90f8f9b656 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.543730 Oct 04 17:48:39.685477 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 67/151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:39 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:40.222983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:40.223693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:40.237817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:40.241837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:40.242357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:40.242790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:40.243819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:40.248991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:40.249830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:40.494396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:40.515470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a393e4b6-9ebf-469e-ab34-7d2391e8bded tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.299872 Oct 04 17:48:40.529444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 85/152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:40 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:40.682755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:40.711514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:40.712350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:40.734205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:40.734946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:40.735641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:40.736961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:40.737585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:40.738238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:40.937225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:40.947942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ff23ebc-5084-439a-bc28-3aacf5efcaac tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.240561 Oct 04 17:48:40.949129 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 86/153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:40 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:41.462924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f63424b5790>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:41.468441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.469380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.469992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.471131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.472091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.472527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.502555 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca478bd2-c452-4237-b8f7-ea0a97ae0bb1 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.826941 Oct 04 17:48:41.511095 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 68/154] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:48:40 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:41.518638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f634269a940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:41.522555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.523338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.523958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.524903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.525535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.526297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.564080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5b1e0c1b-6c55-483a-8236-d47411070932 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.050958 Oct 04 17:48:41.565362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:41.566169 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 87/155] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Oct 4 17:48:41 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:41.567421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:41.575379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.577053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.578679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.583168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.583507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f63427e0280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:41.583983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.587352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.588386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.589115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.589790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.590957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:41.592029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:41.592832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:41.626375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d852c04a-2c1e-49e7-b513-61980f1dd565 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.049370 Oct 04 17:48:41.628615 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 88/156] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Oct 4 17:48:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:48:41.788897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:41.798504 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4bb88cd3-79ca-4274-91b5-bad9d845ce1a tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.239014 Oct 04 17:48:41.799800 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 69/157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:41 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:41.986635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:41.987857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:42.000675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:42.001643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:42.002952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:42.003983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:42.004801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:42.005434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:42.174379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:42.185428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e5dd239-4f69-421e-b0f1-107c280a8610 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.205144 Oct 04 17:48:42.186856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 89/158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:41 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:42.836497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:42.837279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:42.841227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:42.845882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:42.846567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:42.847186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:42.848067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:42.848516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:42.849154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:43.039090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:43.051819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ec95fea-9f81-4909-a572-fd5be7234c71 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.219580 Oct 04 17:48:43.053490 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 90/159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:42 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:43.098785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-903656743", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:43.185659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:48:43.212926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:43.213744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:43.236217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:43.236786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:43.237717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:43.240923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:43.241579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:43.242129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:43.475832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:43.490192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a800f98e-3916-464f-9e50-b53f0cb94af9 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.284076 Oct 04 17:48:43.491708 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 91/160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:43 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:43.524493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:48:43.524922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:48:43.525406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:48:43.525820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:48:43.526253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:48:43.539819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:43.540956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:43.541827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:43.543175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:43.544053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:43.544866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:43.560758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:43.577367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Getting quotas for project 85499581bca640ddb0fb10c480694095. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:43.581697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Getting quotas for user 430b4885dd62404fbb1ba382c7a86d3a and project 85499581bca640ddb0fb10c480694095. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:43.594829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:48:43.597231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:48:43.678981 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0800a4af-93b1-4fb7-a14d-6e273b7cd67c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977643 Oct 04 17:48:43.689658 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 70/161] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:48:43.697129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1468b3f-036b-4ed4-9e44-6491a25baef6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:43.698006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d1468b3f-036b-4ed4-9e44-6491a25baef6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:43.785950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1468b3f-036b-4ed4-9e44-6491a25baef6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:43.801052 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1468b3f-036b-4ed4-9e44-6491a25baef6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1218 microversion: 2.1 time: 0.109327 Oct 04 17:48:43.801695 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 71/162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:43 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:44.039327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d491a1fd-b381-4113-bca4-13a71afc013c tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f634266e310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:44.219534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de", "name": "network-vif-plugged", "status": "completed", "tag": "334ec30e-7ec7-4474-8bef-17777feef31f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:44.248107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.248684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.249360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.275667 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Creating event network-vif-plugged:334ec30e-7ec7-4474-8bef-17777feef31f for instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de on n-h1-831193-17 Oct 04 17:48:44.276305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:48:44.276774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c9618a91-2ed0-4c91-84bd-716298cb38ef req-8cb77983-1936-455c-a390-2b835f46aa96 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:48:44.277944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.278483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.278987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.280516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.281360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.282138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.293211 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.compute.rpcapi [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 17:48:44.294423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] Releasing lock "compute-rpcapi-router" {{(pid=128771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:48:44.320353 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a46897ab-3406-4e13-96df-4e104783e014 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510449 Oct 04 17:48:44.321565 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 72/163] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:44.340687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:44.341659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:44.356453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.359769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.361032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.362966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.364813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.365734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.719459 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d491a1fd-b381-4113-bca4-13a71afc013c tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d" status: 200 len: 371 microversion: 2.1 time: 1.152036 Oct 04 17:48:44.723552 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 92/164] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:48:43 2022] GET /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d => generated 371 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:44.733452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:44.734869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:44.739110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:44.747477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.748741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.750174 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad32a54b-0102-4f1b-806c-844b0cd6a631 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.426386 Oct 04 17:48:44.750450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.751162 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 73/165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:44 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:44.751979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.753087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.753861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.863212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3095d393-0adf-4c4f-b318-8a580d291aee tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Action: 'create', calling method: .version_select at 0x7f63425f73a0>, body: {"keypair": {"name": "tempest-keypair-1338267180", "type": "ssh", "user_id": "ddf9b621b1b64fb3b9e8c62ae6b76d4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxujpitHlU1teFmdnphvDhVMQRMLyXqSZewSBJ94hJDvRcmN/aSlTTYzR4Xbk938AkjwFv01QksW3bGXu1mPipM5RKtHTKE121ChepNfgvDnsbpp3lJ9orbRPgpDgSFig=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:44.891199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-3095d393-0adf-4c4f-b318-8a580d291aee tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:44.896118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-3095d393-0adf-4c4f-b318-8a580d291aee tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for user e1e5433e69f44806b6ac61c7b3d61679 and project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:44.928370 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3095d393-0adf-4c4f-b318-8a580d291aee tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.175275 Oct 04 17:48:44.929686 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 74/166] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 17:48:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:48:44.934477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Action: 'update', calling method: .version_select at 0x7f6342544e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:45.027927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:45.038676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1fe6d0ba-30b7-41b4-b37b-d7b33484d6ea tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.313346 Oct 04 17:48:45.045401 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 93/167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:44 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:45.050711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.052166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:45.060512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.061327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.061922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:45.066162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.066853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.067221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:45.134063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:45.144620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b30853d-bf3a-4748-98c1-babe1034a7fc tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1292 microversion: 2.1 time: 0.103026 Oct 04 17:48:45.155326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 94/168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:45 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:45.155326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e89b2a41-75dd-413a-816a-6800a5d16f16 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Action: 'create', calling method: .version_select at 0x7f634266e310>, body: {"keypair": {"name": "tempest-keypair-1582044838", "type": "ssh", "user_id": "ddf9b621b1b64fb3b9e8c62ae6b76d4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcUkc61wEOk2liBhijjIkYkB0FbJhZs60Soca+xhr6M3M3X2zpGCEdiITQBpr8o/SQ5UeHLK3YyrQ9pzJj3KV/8248UhJf3Kolc4GSjAKW2uKvyNZvyNHVRH+35b5CObg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:45.179441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e89b2a41-75dd-413a-816a-6800a5d16f16 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:45.184647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e89b2a41-75dd-413a-816a-6800a5d16f16 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for user e1e5433e69f44806b6ac61c7b3d61679 and project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:45.213641 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e89b2a41-75dd-413a-816a-6800a5d16f16 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.065622 Oct 04 17:48:45.214923 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 95/169] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 17:48:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:48:45.231714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-902a58bd-f693-4278-ad4f-51a114fefde0 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Calling method '.version_select at 0x7f63427e0280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.243057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-902a58bd-f693-4278-ad4f-51a114fefde0 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1338267180?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f" status: 200 len: 512 microversion: 2.10 time: 0.015208 Oct 04 17:48:45.244567 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 96/170] 10.222.0.33 () {60 vars in 1340 bytes} [Tue Oct 4 17:48:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1338267180?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:48:45.260218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-339f94f4-4084-4b4d-9fa4-f02e2106b15e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Action: 'create', calling method: .version_select at 0x7f634266e550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-689824127", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhKBsvkuURRd+x62Q0CzjlWmSRxXrEEUZWxpXlU54hgym9TFmguo6gGTltwpb0IHPzdVuE2BMei+23g61Bo+duvlNzNBajkHNKy29CLwt4kmkyEKCXSOlUNGAlgmMfpOA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:45.281580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-339f94f4-4084-4b4d-9fa4-f02e2106b15e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:45.282696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.283722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.284348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:45.285300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.285942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.286614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-339f94f4-4084-4b4d-9fa4-f02e2106b15e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Getting quotas for user e1e5433e69f44806b6ac61c7b3d61679 and project 370bf40cc9554b31b0c50f5fda48219a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:45.286727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:45.323267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-339f94f4-4084-4b4d-9fa4-f02e2106b15e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.068171 Oct 04 17:48:45.324283 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 97/171] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 17:48:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 17:48:45.344084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2882e8fa-eced-4b0c-8a21-3c611fcd5e6e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Calling method '.version_select at 0x7f6342603dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.352576 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-2882e8fa-eced-4b0c-8a21-3c611fcd5e6e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 17:48:45.362957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44bd661d-e5ec-4557-b5e1-c4a1e301ee25 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d" status: 200 len: 328 microversion: 2.1 time: 0.431987 Oct 04 17:48:45.363959 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 75/172] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:48:44 2022] PUT /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d => generated 328 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:45.380897 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2882e8fa-eced-4b0c-8a21-3c611fcd5e6e tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f" status: 200 len: 726 microversion: 2.10 time: 0.048094 Oct 04 17:48:45.383347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 98/173] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 17:48:45 2022] GET /compute/v2.1/os-keypairs?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f => generated 726 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:48:45.394411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-653e6eed-c0a5-4c3e-8f3d-c1161588b794 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.398143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c168ecec-4c1b-4502-96d6-100d26f40330 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Calling method '.version_select at 0x7f634261a550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.425542 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-653e6eed-c0a5-4c3e-8f3d-c1161588b794 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d" status: 202 len: 0 microversion: 2.1 time: 0.053083 Oct 04 17:48:45.428597 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 76/174] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 17:48:45 2022] DELETE /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:48:45.443019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01350abd-075a-43ae-8855-501ad3b60de5 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f63424d2c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.445765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c168ecec-4c1b-4502-96d6-100d26f40330 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-689824127" status: 204 len: 0 microversion: 2.10 time: 0.054030 Oct 04 17:48:45.446652 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 99/175] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Oct 4 17:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-689824127 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 17:48:45.456979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-119db38d-eadc-4e3c-ab18-a9e6beb78c2d tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Calling method '.version_select at 0x7f634258a4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.497298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-119db38d-eadc-4e3c-ab18-a9e6beb78c2d tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582044838?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f" status: 204 len: 0 microversion: 2.10 time: 0.044159 Oct 04 17:48:45.498761 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 100/176] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582044838?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:48:45.515943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37574390-2994-4b06-a23a-78a3508580f3 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] Calling method '.version_select at 0x7f634269a4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.556387 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37574390-2994-4b06-a23a-78a3508580f3 tempest-KeyPairsV210TestJSON-1049881850 tempest-KeyPairsV210TestJSON-1049881850-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338267180?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f" status: 204 len: 0 microversion: 2.10 time: 0.051461 Oct 04 17:48:45.563524 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 101/177] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338267180?user_id=ddf9b621b1b64fb3b9e8c62ae6b76d4f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:48:45.723422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:45.728984 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01350abd-075a-43ae-8855-501ad3b60de5 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d" status: 200 len: 371 microversion: 2.1 time: 0.296738 Oct 04 17:48:45.738203 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 77/178] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:48:45 2022] GET /compute/v2.1/os-quota-sets/c94ec8ac9ca6455ea9aee1d6d51c5a3d => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:45.792614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:45.793405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:45.801208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.801711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.802146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:45.803001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:45.803489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:45.803916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:46.028012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:46.041503 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4179ce23-38d7-4789-ac73-61d69cb62ea5 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1320 microversion: 2.1 time: 0.252385 Oct 04 17:48:46.044476 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 102/179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:45 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:46.072363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:46.073072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:46.080095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:46.080364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:46.081015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:46.081739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:46.082208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:46.082630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:46.105458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:46.284502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:46.299075 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14e6eb9e-d63c-4a46-93be-c6f53ef360e4 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.229826 Oct 04 17:48:46.300880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 103/180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:46 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:46.307322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c11cf280-4c36-4c02-91e4-a73dd34543ee tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f634261a8b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:46.350129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1823249058", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:46.432185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:48:46.529676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c11cf280-4c36-4c02-91e4-a73dd34543ee tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.227099 Oct 04 17:48:46.531400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 104/181] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 17:48:46 2022] GET /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3/defaults => generated 371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:46.551916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:46.557563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:46.591224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:46.594953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:46.596985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:46.599838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:46.603874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:46.605069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.018146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:48:47.019982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:48:47.022060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:48:47.022928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:48:47.023810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:48:47.041128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.043152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.044151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.046616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.048399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.049445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.099297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:47.106767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:47.131610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:48:47.136062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:47.152297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eef5f43d-291d-4c80-8a03-e0614f9c3fee tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.619117 Oct 04 17:48:47.152917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 105/182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:46 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:47.163893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:48:47.180774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852dd469-c574-4279-9728-1b0c9a725f1c", "name": "network-vif-plugged", "status": "completed", "tag": "124ea152-be67-4be1-8684-2a8377e9b444"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:47.196370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.197378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.198150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.235984 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41e3d6c6-db19-4770-b026-90d71554b5a8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381077 Oct 04 17:48:47.239154 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 78/183] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:48:47.244601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Action: 'update', calling method: .version_select at 0x7f63424523a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:47.459993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] Creating event network-vif-plugged:124ea152-be67-4be1-8684-2a8377e9b444 for instance 852dd469-c574-4279-9728-1b0c9a725f1c on n-h2-831193-17 Oct 04 17:48:47.468214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-79f6dd72-34af-44cd-8a48-08320652c57c req-ef9f7ff7-dddb-425a-a458-b5e7566fd2ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294776 Oct 04 17:48:47.469817 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 106/184] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:47.479414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:47.480936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:47.515319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.517164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.518474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.520620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.521559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.522530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.538391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.542687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.544020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.545503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.546957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.547666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.636239 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-34362dc4-6e3e-4b82-9d64-ab7a9b31a392 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5" status: 200 len: 328 microversion: 2.1 time: 0.395679 Oct 04 17:48:47.638032 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 79/185] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:48:47 2022] PUT /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5 => generated 328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:47.650208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e7641792-ed0b-4c2e-bec8-aae1d91151fd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:47.651363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e7641792-ed0b-4c2e-bec8-aae1d91151fd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:47.804264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e7641792-ed0b-4c2e-bec8-aae1d91151fd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:47.819096 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e7641792-ed0b-4c2e-bec8-aae1d91151fd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1213 microversion: 2.1 time: 0.179508 Oct 04 17:48:47.836219 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 80/186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:47 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:47.841905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:47.843956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:47.852825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.853764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.854447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:47.855437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:47.856272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:47.856918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.000400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:48.019320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a29d90eb-08fb-4474-a5eb-06c9fda1601c tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1470 microversion: 2.1 time: 0.546890 Oct 04 17:48:48.023105 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 107/187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:47 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1470 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:48.039187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f6342603160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:48.126889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:48.142955 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2ea3f10e-4dc1-4c3b-b871-19d08db7cd96 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.304464 Oct 04 17:48:48.152820 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 81/188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:47 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:48.430049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.430641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.431110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.433480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.433956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.434390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.461818 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0959743f-dc72-4da8-874b-8d463f75bf18 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5/detail" status: 200 len: 916 microversion: 2.1 time: 0.436935 Oct 04 17:48:48.462425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 108/189] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:48:48 2022] GET /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5/detail => generated 916 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:48.473132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:48.474034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:48.489320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.490644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.492738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.493870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.495055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.499533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.594015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:48.595971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:48.616854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.617507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.619671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.620528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.621084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.623312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.718388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:48:48.777075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:48.785806 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6762347f-07e8-44e7-9611-31bafb00c72a tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.321976 Oct 04 17:48:48.786468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 109/190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:48 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:48.791292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5", "tag": "90d06051-e51c-4447-98d6-0992b41c0a4f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:48.802060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.802906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.803664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.824737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] Creating event network-changed:90d06051-e51c-4447-98d6-0992b41c0a4f for instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 on n-h2-831193-17 Oct 04 17:48:48.830792 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eb31b5bf-1a7e-404c-8589-a47f67791164 req-ce920e91-5a33-4c99-ab8e-d27c1b370b7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042907 Oct 04 17:48:48.831698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 110/191] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:48.838412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Action: 'update', calling method: .version_select at 0x7f63427ecca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:48.910927 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0805a46-feb7-472c-8ca7-ce3ad4e7375c tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 204 len: 0 microversion: 2.1 time: 0.747828 Oct 04 17:48:48.914382 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 82/192] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:48:48 2022] DELETE /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:48:48.926084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:48.927166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:48.933805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.934329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.934839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.936077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.937957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.938444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.953424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.954162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.954809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:48.958048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:48.958867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:48.962223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.031309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.031812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.032335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.033646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.034104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.034559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.084077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:49.096210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce7143c5-222b-4c06-95c0-4a44df988ec2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1265 microversion: 2.1 time: 0.179873 Oct 04 17:48:49.097261 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 83/193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:48 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:49.103244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:49.104355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:49.118372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.119286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.123020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.124361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.125984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.126433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.134704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f289813e-c952-4f3d-a3a3-2bdb8b96d858 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5?user_id=b8a67bafb80644428e578b4a73bad95f" status: 200 len: 328 microversion: 2.1 time: 0.301461 Oct 04 17:48:49.136150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 111/194] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:48:48 2022] PUT /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5?user_id=b8a67bafb80644428e578b4a73bad95f => generated 328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:49.149807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a673daff-c1a9-45e4-9e5e-7b70f79ed6d0 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f6342603af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:49.364249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:49.381198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d887ab72-5d4a-4fcb-9916-70c1f4fdcaaa tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1476 microversion: 2.1 time: 0.282480 Oct 04 17:48:49.382460 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 84/195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:49 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:49.400070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:49.400800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:49.408652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.409143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.409758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.410780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.411475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.412059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.498025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:49.517201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a673daff-c1a9-45e4-9e5e-7b70f79ed6d0 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5?user_id=b8a67bafb80644428e578b4a73bad95f" status: 200 len: 370 microversion: 2.1 time: 0.372453 Oct 04 17:48:49.518204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 112/196] 10.222.0.33 () {58 vars in 1323 bytes} [Tue Oct 4 17:48:49 2022] GET /compute/v2.1/os-quota-sets/70f934280b72498882525f232a78f4b5?user_id=b8a67bafb80644428e578b4a73bad95f => generated 370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:49.610389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:49.622501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82e02b3f-86bd-44aa-bf0e-29a9486eb95d tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1339 microversion: 2.1 time: 0.238494 Oct 04 17:48:49.634554 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 85/197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:49 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1339 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:49.810656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:49.812337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:49.825092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.825846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.826361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.827434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:49.828340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:49.828976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:49.922826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-32dcf615-a65c-4767-aefb-cc6df3398a5d tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Calling method '.version_select at 0x7f6342544550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:50.044606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:50.059117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c381ee7-6261-41d5-9819-90e8e2887663 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.250607 Oct 04 17:48:50.061329 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 113/198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:49 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:50.124283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:50.125198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:50.137756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.138509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.140801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.141708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.143764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.144536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.301250 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-32dcf615-a65c-4767-aefb-cc6df3398a5d tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.382494 Oct 04 17:48:50.310980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:50.312277 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 86/199] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 17:48:49 2022] GET /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3/defaults => generated 371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:50.319962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3baf044-e918-4263-89f3-aac8deee4633 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1283 microversion: 2.1 time: 0.200339 Oct 04 17:48:50.323573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Action: 'update', calling method: .version_select at 0x7f6342343dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:50.323857 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 114/200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:50 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:50.410324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.410704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:50.411348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.412211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:50.412649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.413683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.414295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.422558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.423300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.423861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.424842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.425456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.426017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.428862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.666532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:50.677530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea2469b0-3c11-47a6-8353-41ae8e334025 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1476 microversion: 2.1 time: 0.274059 Oct 04 17:48:50.678802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 115/201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:50 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:50.687848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:50.689126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:50.699946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.700906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.702267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.703266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.704565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.705901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.799634 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1b4652a-67e3-4f6f-b20b-e8de8bf0f42f tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3" status: 200 len: 329 microversion: 2.1 time: 0.482114 Oct 04 17:48:50.800550 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 87/202] 10.222.0.33 () {60 vars in 1263 bytes} [Tue Oct 4 17:48:50 2022] PUT /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3 => generated 329 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:50.813642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Action: 'update', calling method: .version_select at 0x7f63423bb5e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:50.894509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.895318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.895943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.896839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:50.904506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:50.905927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:50.933518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=18,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:51.080626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:51.096979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4954814-f8eb-48c4-9717-b9a19d17f28a tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1489 microversion: 2.1 time: 0.411969 Oct 04 17:48:51.097621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 116/203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:50 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1489 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:51.105584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:51.105584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:51.111690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.112881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.113339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.114068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.114603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.115010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.268745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:51.538791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6b0eead-41e9-43df-b5fc-77210e1a1c99 tempest-QuotasAdminTestJSON-111372421 tempest-QuotasAdminTestJSON-111372421-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3" status: 200 len: 329 microversion: 2.1 time: 0.730064 Oct 04 17:48:51.540323 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 88/204] 10.222.0.33 () {60 vars in 1263 bytes} [Tue Oct 4 17:48:50 2022] PUT /compute/v2.1/os-quota-sets/7b92887b4ee643b59a971fdb8642c7f3 => generated 329 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:51.545907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:51.548193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:51.555281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:51.573709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.576326 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cab69a3-4149-4a0b-9138-1705f4f00181 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.477470 Oct 04 17:48:51.577982 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 117/205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:51 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:51.578580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.579071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.582683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.582683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.582683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.612540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:51.617427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:51.631568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.632069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.632505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.633218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.633669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.634257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.828331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:51.847374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-426b84d1-0c5c-4377-845c-5e1aa18baf6f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1271 microversion: 2.1 time: 0.267375 Oct 04 17:48:51.849582 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 118/206] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:51 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:51.855237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:51.857314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:51.872287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.873453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.875178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:51.876460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:51.877489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:51.878178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.261188 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b70ddb6c-e230-45e8-a527-7918cfe590cb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1642 microversion: 2.1 time: 0.719649 Oct 04 17:48:52.263299 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 89/207] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:51 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1642 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:52.274097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de", "name": "network-vif-deleted", "tag": "334ec30e-7ec7-4474-8bef-17777feef31f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:52.286290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:52.294410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.297962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1e90885-4b92-43f9-b462-587cf5a4cf73 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 200 len: 1434 microversion: 2.1 time: 0.447004 Oct 04 17:48:52.298146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.298622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.313519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 119/208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:51 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 1434 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:52.324474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:52.325090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:52.332144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.334510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.335055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.335804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.336275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.336700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.360041 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] Creating event network-vif-deleted:334ec30e-7ec7-4474-8bef-17777feef31f for instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de on n-h1-831193-17 Oct 04 17:48:52.379913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-598bb9e0-7dfc-40fa-99d0-fd855ace639e req-acc1b590-295c-406c-9f7b-876e6b1ede61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115034 Oct 04 17:48:52.382064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 90/209] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:52.397959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:48:52.603131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:52.607664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:52.631215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.632036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.632919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.633907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.634030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1e40f9f-f014-4530-87f2-f38cb34814dd tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 204 len: 0 microversion: 2.1 time: 0.318636 Oct 04 17:48:52.634663 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 120/210] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:48:52 2022] DELETE /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:48:52.634940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.635629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.643726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:52.644546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:52.651701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.652468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.653069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.653931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.654644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.655785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.830884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:52.844619 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63ebfee3-0cd7-475c-91ed-9ff217a53d83 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.245706 Oct 04 17:48:52.845507 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 91/211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:52 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:52.878135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:52.878884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:52.890495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.891820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.892738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:52.893732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:52.894617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:52.895341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:53.087963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:53.097042 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdcb6d05-4603-41f4-8ee5-e1f5a890a590 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.226657 Oct 04 17:48:53.097955 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 92/212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:52 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:53.299835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:53.312090 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e51a10e9-99fb-4687-a3cf-f1d434fc4ac7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1495 microversion: 2.1 time: 0.672777 Oct 04 17:48:53.312962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 121/213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:52 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1495 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:53.331204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:53.331842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:53.351248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:53.351768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:53.352209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:53.352958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:53.353412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:53.353835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:53.374540 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de HTTP/1.1 Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:53.400570 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:48:53.401869 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de'} Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:53.402544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:48:53.403719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:53.404737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:53.404737 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-524159dc-8ab3-431e-9549-e377d7ae1d40 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 404 len: 111 microversion: 2.1 time: 0.077619 Oct 04 17:48:53.414500 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 93/214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:53 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:53.602148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1726986736", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:53.745593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:48:53.873722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:53.876133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:53.887601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:53.889298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:53.890071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:53.892944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:53.897325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:53.899344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.412422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:54.425779 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1c3ae909-e073-4d13-8b80-a5e5f55ee907 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.557968 Oct 04 17:48:54.438065 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 94/215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:53 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:54.445650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:54.447366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:54.454437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.455837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.457143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.458159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.459115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.459658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.460964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:48:54.461423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:48:54.461859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:48:54.462275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:48:54.462695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:48:54.481720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.488010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.488921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.489995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.490688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.494395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.538800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Getting quotas for project eb489eee36bb40eba357a5aba5101c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:48:54.544557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Getting quotas for user 9f4a80d2cfce408e8e1bc355c1ecf288 and project eb489eee36bb40eba357a5aba5101c5c. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:48:54.560724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:48:54.564903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:48:54.636620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12b582bf-aa54-4461-9af5-4461a2a20438 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038794 Oct 04 17:48:54.638090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 122/216] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:48:54.645623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:54.648542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:54.657746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.658763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.659565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.660631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:54.661326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:54.677646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:54.698452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:54.774828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:54.786335 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cab2f03d-a2c1-47e1-b0af-b813bbac2570 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.355957 Oct 04 17:48:54.788610 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 95/217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:54 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:54.804680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c4903837-60e3-4d9c-b7f2-d0e317ae744f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:54.805606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4903837-60e3-4d9c-b7f2-d0e317ae744f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:54.942687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c4903837-60e3-4d9c-b7f2-d0e317ae744f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:54.950442 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c4903837-60e3-4d9c-b7f2-d0e317ae744f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1220 microversion: 2.1 time: 0.160686 Oct 04 17:48:54.955358 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 96/218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:54 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:55.179630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852dd469-c574-4279-9728-1b0c9a725f1c", "name": "network-vif-deleted", "tag": "124ea152-be67-4be1-8684-2a8377e9b444"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:55.217550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.218046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.219435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.274465 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] Creating event network-vif-deleted:124ea152-be67-4be1-8684-2a8377e9b444 for instance 852dd469-c574-4279-9728-1b0c9a725f1c on n-h2-831193-17 Oct 04 17:48:55.275017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6a7f8c5a6c46bfbf218c6d94d59739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8401eab61d46e7a8e694b8009de6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:55.284139 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0dc7e743-f11e-4f03-86f0-e507e279c0a2 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 200 len: 1495 microversion: 2.1 time: 0.644428 Oct 04 17:48:55.285744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0ff9cfe7-27dd-4893-bc2e-3fba26b8da3f req-bf974de9-7f06-4575-b2b3-ba022168277e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113237 Oct 04 17:48:55.289558 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 97/219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:48:55.290582 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 123/220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:54 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 1495 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:55.452928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:55.453647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:55.465089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.465584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.469788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.470547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.471025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.471492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.506425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:55.567919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:55.588050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.588586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.590264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.625509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] Creating event network-changed:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h1-831193-17 Oct 04 17:48:55.645362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-72d9806f-af48-42ff-8476-d7a6b57f9aa2 req-f4923f1e-69ad-487e-b0c4-b80624d5bb9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081131 Oct 04 17:48:55.646339 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 124/221] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:55.750166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:55.769329 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fa5a8923-ff96-405f-99c8-d7e87c62994f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.320451 Oct 04 17:48:55.788010 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 98/222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:55 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:55.826314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:55.827582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:55.838285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.839300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.840133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.841164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:55.841983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:55.843275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:55.991914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:55.992788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:56.009890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.010444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.010897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.016015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.018600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.019948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.137205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:56.146832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c1ba7559-c5c0-4696-989d-2fe35737980e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1272 microversion: 2.1 time: 0.158742 Oct 04 17:48:56.147706 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 99/223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:55 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:56.158164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5", "name": "network-vif-plugged", "status": "completed", "tag": "90d06051-e51c-4447-98d6-0992b41c0a4f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:56.169271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.170771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.171529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.193562 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] Creating event network-vif-plugged:90d06051-e51c-4447-98d6-0992b41c0a4f for instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 on n-h2-831193-17 Oct 04 17:48:56.203494 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8ac26ea0-bb26-4039-938c-7addf065ebee req-27cf5a8c-249e-4f29-8da2-f7a9909b31e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053879 Oct 04 17:48:56.205300 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 100/224] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:56.320557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:56.321568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:56.332834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.341051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.343806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.346627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.347361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.350811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.391804 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] HTTP exception thrown: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Request method failure captured: Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c HTTP/1.1 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHNAZskNLyob5n720NMxcev_ASZ2M9so1hEqC7ctIMYge-DwnDqwzmhcgYuQKFLRDjLiJgC_1PksM15GTV0MKzMDpRHasIIHtn2LVAN-g5MWq8vIRFogb2Vt32iKGeI2WFCci8LIXHSIO8F6LI5tTRCsLwjWoSSjJB_jKWnvflOrvw Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:48:56.396807 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 6a6a7f8c5a6c46bfbf218c6d94d59739 Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:48:56.398484 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '852dd469-c574-4279-9728-1b0c9a725f1c'} Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:56.399332 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:48:56.400461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:56.403438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Returning 404 to user: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:56.405744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-839a700b-4a82-43c8-a662-22ad545c5aad tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 404 len: 111 microversion: 2.1 time: 0.090616 Oct 04 17:48:56.413020 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 101/225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:56 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:48:56.426181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4b38da0-75fe-4dff-a972-358dc65fe176 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:56.456811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b38da0-75fe-4dff-a972-358dc65fe176 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.457522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b38da0-75fe-4dff-a972-358dc65fe176 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.458466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b38da0-75fe-4dff-a972-358dc65fe176 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.505527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:56.519925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51423f29-ff23-4d35-a629-333ec5d5692b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.696484 Oct 04 17:48:56.519925 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 125/226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:55 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:56.798851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:56.799579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:56.808880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.809389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.809836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:56.810563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:56.818649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:56.819523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.020418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:57.029366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58cae5f2-f9f9-47dd-8653-0d1b207d1842 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1340 microversion: 2.1 time: 0.235227 Oct 04 17:48:57.030682 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 126/227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:56 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1340 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:57.178190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:57.180928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:57.201083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.204897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.205568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.208586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.212071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.212792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.223879 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4b38da0-75fe-4dff-a972-358dc65fe176 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.807621 Oct 04 17:48:57.226672 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 102/228] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:57.239889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-923a3a5b-f61d-4393-8af8-364a9b6dddf8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:57.269222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=14,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:57.297166 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-923a3a5b-f61d-4393-8af8-364a9b6dddf8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.061110 Oct 04 17:48:57.298359 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 103/229] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:48:57 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:48:57.320273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3c47bab2-7e35-40ce-b333-259e206aa9f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1862850902"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:57.322543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:57.324681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-3c47bab2-7e35-40ce-b333-259e206aa9f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 18fd49ed-d3d3-4afb-b2ad-24ef6219f366 for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:48:57.332509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba366918-a890-47ab-9b25-ce0516d128e9 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1278 microversion: 2.1 time: 0.164245 Oct 04 17:48:57.333424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 127/230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:57 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:48:57.367059 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3c47bab2-7e35-40ce-b333-259e206aa9f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052988 Oct 04 17:48:57.374742 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 104/231] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:48:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:57.380462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9afe2fbd-a95a-4aa7-aa60-682821398dd0 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:57.393541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9afe2fbd-a95a-4aa7-aa60-682821398dd0 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.394083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9afe2fbd-a95a-4aa7-aa60-682821398dd0 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.394667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9afe2fbd-a95a-4aa7-aa60-682821398dd0 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.560122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:57.564113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:57.568685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9afe2fbd-a95a-4aa7-aa60-682821398dd0 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.192498 Oct 04 17:48:57.569499 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 128/232] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:57.580375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.584341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.584927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.585045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5782aee-3d57-41a2-a8e6-b933735c8f40 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:57.585988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.586559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.588220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.597406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5782aee-3d57-41a2-a8e6-b933735c8f40 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.016849 Oct 04 17:48:57.602734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 129/233] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:48:57 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:57.618223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0af1fb0b-63fd-4e41-833d-cd0ae1bd4f33 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:57.648798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0af1fb0b-63fd-4e41-833d-cd0ae1bd4f33 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:57.648798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0af1fb0b-63fd-4e41-833d-cd0ae1bd4f33 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:57.649740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0af1fb0b-63fd-4e41-833d-cd0ae1bd4f33 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:57.851970 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0af1fb0b-63fd-4e41-833d-cd0ae1bd4f33 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.239248 Oct 04 17:48:57.856359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 130/234] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:57.884521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-529d970f-f094-4335-abd6-9348f9e49d3f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:57.939631 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-529d970f-f094-4335-abd6-9348f9e49d3f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.070405 Oct 04 17:48:57.940703 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 131/235] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:48:57 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:48:57.958123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f76cb0b1-3d9a-45e9-b754-4b803a44be77 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1080992617"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:57.975418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-f76cb0b1-3d9a-45e9-b754-4b803a44be77 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid be0110bf-738b-45cd-a54d-99a3e16571cb for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:48:58.039807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f76cb0b1-3d9a-45e9-b754-4b803a44be77 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090165 Oct 04 17:48:58.050460 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 132/236] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:48:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:58.056051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:58.057909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:58.065320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.066387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.067141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.068517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.069314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.070209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.335812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:58.352889 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-23601c15-c8a2-4101-a4f4-ce08360c9683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.805655 Oct 04 17:48:58.356730 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 105/237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:57 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:58.364047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-403ce173-752b-429e-9681-3c245e61df7f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:58.385086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:58.395455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403ce173-752b-429e-9681-3c245e61df7f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.398581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403ce173-752b-429e-9681-3c245e61df7f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.402576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403ce173-752b-429e-9681-3c245e61df7f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.407397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8c532f5-5179-4c73-98cd-8ab91ec15592 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1468 microversion: 2.1 time: 0.355155 Oct 04 17:48:58.408254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 133/238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:58 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:58.425796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:58.428891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:58.450064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.450698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.453822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.459580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.471012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.472154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.594993 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-403ce173-752b-429e-9681-3c245e61df7f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.236684 Oct 04 17:48:58.596024 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 106/239] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:58.662713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:58.677521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24c0c9c0-24c6-4099-9e98-eddbcd0ec595 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1278 microversion: 2.1 time: 0.265213 Oct 04 17:48:58.680473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 134/240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:58 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:58.955507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1313918668", "block_migration": true, "disk_over_commit": false}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:58.958327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:58.960845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Action: 'update', calling method: .version_select at 0x7f6342764550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:58.965428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.966154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.966455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.967096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.967396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.967905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.969334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.970100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.971021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.976805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:58.977566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:58.978219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:58.991523 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] HTTP exception thrown: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Request method failure captured: Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc HTTP/1.1 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 56 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIKEpY1XzpUvaNHwNahcVS7UkamvL2BfxXR1oPPT5iclqNtoLDk7V9e8Xn9cJxU6nlVeiM4TlECVSQLGRBXsJXv9xDzVnZ5GGrSmv-mh8yCAPSdUzs1hhuypzPv1Xfbg4GfrdFw_ho_Gud76twllVyBEiC9VjvrzMZ7aAUa4xi1AeI Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:58.993955 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6241a8eb20ec4186ba8b833ff7b88c4b Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:58.995254 n-d-831193-17 devstack@n-api.service[128770]: exception: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a8f8563c-dcba-42c5-9b3d-94916a64a6cc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.995992 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:58.997093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:58.998188 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:58.998188 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:58.998188 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.000503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Returning 404 to user: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:59.001391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9258afb0-d541-4841-a465-ae1b3a09ce11 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc" status: 404 len: 110 microversion: 2.53 time: 0.319859 Oct 04 17:48:59.001992 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 135/241] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 17:48:58 2022] PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc => generated 110 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:59.007250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15f09db5-efbc-428d-83ea-8272a8793bdf tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.016741 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15f09db5-efbc-428d-83ea-8272a8793bdf tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.013195 Oct 04 17:48:59.017612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 136/242] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:48:59 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:59.031305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Action: 'update', calling method: .version_select at 0x7f6342603670>, body: {"status": "disabled"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:59.041805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.043748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.044651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.052004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.053634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.054723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.066769 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] HTTP exception thrown: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Request method failure captured: Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc HTTP/1.1 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 22 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIKEpY1XzpUvaNHwNahcVS7UkamvL2BfxXR1oPPT5iclqNtoLDk7V9e8Xn9cJxU6nlVeiM4TlECVSQLGRBXsJXv9xDzVnZ5GGrSmv-mh8yCAPSdUzs1hhuypzPv1Xfbg4GfrdFw_ho_Gud76twllVyBEiC9VjvrzMZ7aAUa4xi1AeI Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:59.069173 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6241a8eb20ec4186ba8b833ff7b88c4b Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: {"status": "disabled"} Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: exception: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.070398 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a8f8563c-dcba-42c5-9b3d-94916a64a6cc', 'body': {'status': 'disabled'}} Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.072000 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:59.073950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:59.075025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.075025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.077751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Returning 404 to user: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:59.078664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d92fb150-6172-43d4-ba0f-1577bb14d832 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc" status: 404 len: 110 microversion: 2.53 time: 0.059805 Oct 04 17:48:59.084094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 137/243] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 17:48:59 2022] PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:59.084723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1f9589f-d726-4c61-9875-a21869f13be1 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:59.099621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1f9589f-d726-4c61-9875-a21869f13be1 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.100189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1f9589f-d726-4c61-9875-a21869f13be1 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.100642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1f9589f-d726-4c61-9875-a21869f13be1 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.360626 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1f9589f-d726-4c61-9875-a21869f13be1 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.279770 Oct 04 17:48:59.362492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 138/244] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:48:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:59.375109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Action: 'update', calling method: .version_select at 0x7f6342603550>, body: {"status": "enabled"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:59.382324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.382871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.383540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.391479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.392479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.393126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.401205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] HTTP exception thrown: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Request method failure captured: Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc HTTP/1.1 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 21 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIKEpY1XzpUvaNHwNahcVS7UkamvL2BfxXR1oPPT5iclqNtoLDk7V9e8Xn9cJxU6nlVeiM4TlECVSQLGRBXsJXv9xDzVnZ5GGrSmv-mh8yCAPSdUzs1hhuypzPv1Xfbg4GfrdFw_ho_Gud76twllVyBEiC9VjvrzMZ7aAUa4xi1AeI Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:48:59.403096 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a3c597477f4ce4b4c0631b7a9af843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a6a3c597477f4ce4b4c0631b7a9af843 Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937 Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6241a8eb20ec4186ba8b833ff7b88c4b Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: {"status": "enabled"} Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: exception: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.405699 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a8f8563c-dcba-42c5-9b3d-94916a64a6cc', 'body': {'status': 'enabled'}} Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.407415 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:59.409880 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:59.412221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. Oct 04 17:48:59.412221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.412221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Returning 404 to user: Service a8f8563c-dcba-42c5-9b3d-94916a64a6cc could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:59.412221 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0e05a92-62e4-485a-bb93-6472e8907382 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc" status: 404 len: 110 microversion: 2.53 time: 0.042115 Oct 04 17:48:59.413719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 139/245] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 17:48:59 2022] PUT /compute/v2.1/os-services/a8f8563c-dcba-42c5-9b3d-94916a64a6cc => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:59.419486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec23fd23-1326-4cee-9b97-d5b0316215ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.450016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec23fd23-1326-4cee-9b97-d5b0316215ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.035141 Oct 04 17:48:59.451127 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 140/246] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:48:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:48:59.460933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.464066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:59.472177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:59.481178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.481909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.482504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.484217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.484836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.486937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.527646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lazy-loading 'flavor' on Instance uuid 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:48:59.618662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Going to try to live migrate instance to tempest-host-1313918668 {{(pid=128771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:48:59.630210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] HTTP exception thrown: Compute host tempest-host-1313918668 could not be found. Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Request method failure captured: Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5/action HTTP/1.1 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 107 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHH6LkLphatupTZr_VUKfm3e_LQA19uJGQ6Z7outfuImqESq6JvayeutxDm-zyZt86Ix9Z6-H5l2WxNLgybiNsjO0YRYu-TL-vkZuSrpjWcuS-61fA6ak4kcEq5uW3-RF0ch3X0lfjlgvwU6HRbx3HfE3VS9tyMfEaIZQsL8WVVH1UI Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: e16dae9f6bf94ed9919225dcde2c82c9 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:48:59.634371 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: e16dae9f6bf94ed9919225dcde2c82c9 Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-LiveMigrationNegativeTest-820259963-project-admin Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 43cfb97dbd4847c4a9911b7e0f2fdd59 Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-LiveMigrationNegativeTest-820259963-project-admin Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: {"os-migrateLive": {"host": "tempest-host-1313918668", "block_migration": true, "disk_over_commit": false}} Oct 04 17:48:59.635879 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: exception: Compute host tempest-host-1313918668 could not be found. Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5', 'body': {'os-migrateLive': {'host': 'tempest-host-1313918668', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:48:59.636701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1313918668 could not be found. Oct 04 17:48:59.637922 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1313918668 could not be found. Oct 04 17:48:59.641206 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1313918668 could not be found. Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Returning 400 to user: Compute host tempest-host-1313918668 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc9d3f11-31ee-47a8-a0bb-2ca9cbd19446 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5/action" status: 400 len: 100 microversion: 2.1 time: 1.029646 Oct 04 17:48:59.642570 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 107/247] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 17:48:58 2022] POST /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5/action => generated 100 bytes in 1042 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:48:59.649611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.660921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.662162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.662813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.664150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.664796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.665421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.725900 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf74c716-0c35-49ec-8570-7f7f0a1230c5 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.085745 Oct 04 17:48:59.739236 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 108/248] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 17:48:59 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:59.739236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-76b121a7-6c8e-44f2-909c-38423d66781f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-69513737"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:48:59.739236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-76b121a7-6c8e-44f2-909c-38423d66781f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 824e2284-1fa8-483c-8a45-7fd75e3db3bd for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:48:59.817298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-76b121a7-6c8e-44f2-909c-38423d66781f tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.088605 Oct 04 17:48:59.820089 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 109/249] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:48:59 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:48:59.847564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.849387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:59.864197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:48:59.867743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.868633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.869423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.870744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.877551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.880126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.886720 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9220bccc-50d9-4d21-b98f-31f50f7e766d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.433069 Oct 04 17:48:59.887600 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 141/250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:59 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:48:59.906220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:48:59.920083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:48:59.932081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.932912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.941031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:59.942577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:59.943467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:59.944248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.205552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:00.224748 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-526583a7-800b-484d-a808-7829dd212c5b tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.335595 Oct 04 17:49:00.225876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 142/251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:59 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:00.239221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:00.255948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.256620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.257394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.258729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.259646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.260410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.310231 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e87264e3-9c54-4cfc-a5fa-173ba8abe25c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.080927 Oct 04 17:49:00.325153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 143/252] 10.222.0.33 () {60 vars in 1211 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:00.335935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5aa9f7aa-fedb-47ff-9116-64a35b85b84a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:00.354523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aa9f7aa-fedb-47ff-9116-64a35b85b84a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.355436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aa9f7aa-fedb-47ff-9116-64a35b85b84a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.356589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aa9f7aa-fedb-47ff-9116-64a35b85b84a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.412648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:00.430952 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b25f372f-f04a-4397-a46a-d33fc5af1aac tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1468 microversion: 2.1 time: 0.608753 Oct 04 17:49:00.432290 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 110/253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:48:59 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1468 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:00.441774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:00.451253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.453022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.454025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.455733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.456827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.457853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.515518 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44f18607-82cd-4833-8699-cbbc8ac04900 tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.081025 Oct 04 17:49:00.516626 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 111/254] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:00.540978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:00.548147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.549506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.550478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.551955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.553139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.554149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.607635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-169573f4-9a07-4ca0-9119-506569bb431f tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-831193-17&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.073611 Oct 04 17:49:00.621530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5aa9f7aa-fedb-47ff-9116-64a35b85b84a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.292365 Oct 04 17:49:00.621799 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 112/255] 10.222.0.33 () {60 vars in 1237 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services?host=n-d-831193-17&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:00.628073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 144/256] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:00.632399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:00.640242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.641596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.642628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.644252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.645391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.646341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.664625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aef6a053-f517-49aa-b452-62965c586f21 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:00.688398 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-046fe1bf-0d8c-4080-a700-cf179fbffe7b tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.063355 Oct 04 17:49:00.696541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aef6a053-f517-49aa-b452-62965c586f21 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.696541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aef6a053-f517-49aa-b452-62965c586f21 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.696541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aef6a053-f517-49aa-b452-62965c586f21 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.697534 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 113/257] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:49:00.713438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:00.721118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.721967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.722749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.724566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:00.725756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:00.726777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:00.766102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-58d0ff2c-fe6a-413d-8f04-78399d23cc3c tempest-ServicesAdminNegativeV253TestJSON-1528898937 tempest-ServicesAdminNegativeV253TestJSON-1528898937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.061066 Oct 04 17:49:00.768845 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 114/258] 10.222.0.33 () {60 vars in 1239 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:00.780132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-745551028", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:00.854348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:00.920312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aef6a053-f517-49aa-b452-62965c586f21 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.270212 Oct 04 17:49:00.922125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 145/259] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:01.099241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5a19134-2bbc-4d25-b2df-ae05a3637a07 tempest-ServicesAdminNegativeV253TestJSON-1361628152 tempest-ServicesAdminNegativeV253TestJSON-1361628152-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.103283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5a19134-2bbc-4d25-b2df-ae05a3637a07 tempest-ServicesAdminNegativeV253TestJSON-1361628152 tempest-ServicesAdminNegativeV253TestJSON-1361628152-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e57b8c6f65f7469385453bf14a57c56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2923cc86662e428fafe9a5007206cbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5a19134-2bbc-4d25-b2df-ae05a3637a07 tempest-ServicesAdminNegativeV253TestJSON-1361628152 tempest-ServicesAdminNegativeV253TestJSON-1361628152-project] Request method failure captured: Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIJ7o4XgvGR1sahy4-ar7X0IjygRGbJOJuOWjwIbD5S5nKH1aJS6EjDkru-Nt7Z83Ujq5n03INZXgKVs-6ibiZP9SOFCj-m-b7oXWRvkghF5C7SkwZZle5JFVn-NWwS9NaLIj3f3yYDVEZTRfltPd9itDXkugbr6NrkpEuILHRCEvU Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2923cc86662e428fafe9a5007206cbab Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1361628152 Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:01.104971 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2923cc86662e428fafe9a5007206cbab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2923cc86662e428fafe9a5007206cbab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2923cc86662e428fafe9a5007206cbab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2923cc86662e428fafe9a5007206cbab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1361628152 Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2923cc86662e428fafe9a5007206cbab Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1361628152 Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1361628152-project Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: e57b8c6f65f7469385453bf14a57c56e Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1361628152-project Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:49:01.106365 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:01.107249 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:49:01.108396 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:01.111815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5a19134-2bbc-4d25-b2df-ae05a3637a07 tempest-ServicesAdminNegativeV253TestJSON-1361628152 tempest-ServicesAdminNegativeV253TestJSON-1361628152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:01.111815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5a19134-2bbc-4d25-b2df-ae05a3637a07 tempest-ServicesAdminNegativeV253TestJSON-1361628152 tempest-ServicesAdminNegativeV253TestJSON-1361628152-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.182916 Oct 04 17:49:01.111815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 146/260] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 17:49:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:01.112353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.112969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:01.122006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.122500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.122944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.124155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.124619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.125050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.322169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:01.338319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a994549-bfac-472e-ad17-9ff85e8cb1ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.229328 Oct 04 17:49:01.339445 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 147/261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:01 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:01.348239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ccdd6f8b-b959-412f-9af3-0924c2b60a7a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.385360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ccdd6f8b-b959-412f-9af3-0924c2b60a7a tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043721 Oct 04 17:49:01.386884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 148/262] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:01.400327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.401822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:01.416066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.417391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.418100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.420180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.421498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.423088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.631056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:01.631684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:01.632278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:01.632704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:01.633240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:01.654709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.655505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.656105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.657031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.657658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.658267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.680041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Getting quotas for project 85499581bca640ddb0fb10c480694095. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:01.685520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Getting quotas for user 430b4885dd62404fbb1ba382c7a86d3a and project 85499581bca640ddb0fb10c480694095. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:01.705655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:49:01.708308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:49:01.764812 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2f78a759-aa96-4d30-8759-5b51884ad677 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994244 Oct 04 17:49:01.766721 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 115/263] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:49:01.776524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3b23783-150d-4af4-8862-1fde091e55a8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-60885440"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:01.783921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-b3b23783-150d-4af4-8862-1fde091e55a8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 38155b1e-adaf-458f-862f-abb7166c3d57 for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:01.827263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:01.831367 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3b23783-150d-4af4-8862-1fde091e55a8 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.060320 Oct 04 17:49:01.832321 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 116/264] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:01 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:01.838323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f6342277550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.843798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.844275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.845076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.848133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.848858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.849871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.855629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-36028074-58a4-47af-b525-5f6abd7aab0f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.466297 Oct 04 17:49:01.857615 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 149/265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:01 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:01.871230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e640228-c6e5-40f8-94e5-0e13449cd7f4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.887229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e640228-c6e5-40f8-94e5-0e13449cd7f4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:01.904661 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a215bc8-22ab-43bc-b6c8-9c35e03c72b2 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.070930 Oct 04 17:49:01.906022 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 117/266] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:49:01 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:01.913559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a0ee5cb3-040e-4acc-a99a-1eaf0c42b19d tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.960548 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a0ee5cb3-040e-4acc-a99a-1eaf0c42b19d tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.051135 Oct 04 17:49:01.961868 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 118/267] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:01.981593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f63425f7040>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:01.988520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.993990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.994597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:01.995432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:01.995893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:01.996324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.039479 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1c004b6-d9e9-4022-81c6-71972459b141 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.074684 Oct 04 17:49:02.049350 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 119/268] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:01 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.055094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fec403e5-b991-46bf-931a-6556a6ded400 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.058557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e640228-c6e5-40f8-94e5-0e13449cd7f4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:02.063672 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fec403e5-b991-46bf-931a-6556a6ded400 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fec403e5-b991-46bf-931a-6556a6ded400 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Request method failure captured: Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHQ0D66bI7sN4tggAblkfSW5Ti0EzeJcEEKNi89tdg4PUMq868R7qjaNCSUjAVCovRLk7Ut3HbrZaSVESKdNy9OGmjFvcDUZHVttraXRZB_R3GyU9OOE4Q2f_wmGXrQrvjICVsWs6RGsUiNnEMyEeFsyRpH9hCobtoLtXG72k1_LQM Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:02.066132 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 244d4fa184b047088b00a135f28eacab Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: exception: Aggregate 5 could not be found. Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5'} Oct 04 17:49:02.067634 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.068454 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 17:49:02.069524 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.072071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fec403e5-b991-46bf-931a-6556a6ded400 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:02.073373 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e640228-c6e5-40f8-94e5-0e13449cd7f4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1218 microversion: 2.1 time: 0.211538 Oct 04 17:49:02.074118 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fec403e5-b991-46bf-931a-6556a6ded400 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.023419 Oct 04 17:49:02.083134 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 150/269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:01 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:02.089286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f634255ddc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.089648 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 120/270] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:02.099286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d4c60382-fd7c-4139-bfa0-1156cb86c452 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1876385023"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:02.102902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-d4c60382-fd7c-4139-bfa0-1156cb86c452 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Generated uuid cb6abfad-0522-4e35-b604-b359340e84e3 for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:02.113202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.117045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.117045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.119703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.120207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.122890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.153969 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d4c60382-fd7c-4139-bfa0-1156cb86c452 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.062682 Oct 04 17:49:02.156986 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 121/271] 10.222.0.33 () {62 vars in 1205 bytes} [Tue Oct 4 17:49:02 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:02.168445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdb591d8-8f1a-4620-9721-1fd6bffbcb9c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.187572 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fdb591d8-8f1a-4620-9721-1fd6bffbcb9c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 17:49:02.189135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c343ba6c-5ac6-4ae1-98bf-ac9a2a072e66 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.113582 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdb591d8-8f1a-4620-9721-1fd6bffbcb9c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Request method failure captured: Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHQ0D66bI7sN4tggAblkfSW5Ti0EzeJcEEKNi89tdg4PUMq868R7qjaNCSUjAVCovRLk7Ut3HbrZaSVESKdNy9OGmjFvcDUZHVttraXRZB_R3GyU9OOE4Q2f_wmGXrQrvjICVsWs6RGsUiNnEMyEeFsyRpH9hCobtoLtXG72k1_LQM Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:02.190077 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 244d4fa184b047088b00a135f28eacab Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: exception: Aggregate 5 could not be found. Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5'} Oct 04 17:49:02.191733 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:02.192430 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:02.193504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdb591d8-8f1a-4620-9721-1fd6bffbcb9c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdb591d8-8f1a-4620-9721-1fd6bffbcb9c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.034789 Oct 04 17:49:02.194624 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 122/272] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:02 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:02.199296 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 151/273] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.204985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bea290e9-c37e-4ad1-895d-fefabee1688b tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-251545801"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:02.206169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b5348e-5de5-496b-8e96-cf2f4e69d9f5", "tag": "4fe80c55-900f-43ed-85dd-2f2f200409ef"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:02.233805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.234438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.237289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.271538 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] Creating event network-changed:4fe80c55-900f-43ed-85dd-2f2f200409ef for instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 on n-h1-831193-17 Oct 04 17:49:02.293354 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-25a963a2-0ef4-49da-a271-5822f001899a req-a8ca1050-7d53-48ad-83c2-6ec88f2b0da4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096216 Oct 04 17:49:02.295929 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 123/274] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.309854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f63422779d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.330134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.330631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.331104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.352079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bea290e9-c37e-4ad1-895d-fefabee1688b tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.150478 Oct 04 17:49:02.358493 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 152/275] 10.222.0.33 () {62 vars in 1210 bytes} [Tue Oct 4 17:49:02 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:02.364001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.364609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.365101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.370404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abe0d53c-b152-47e2-81fe-60d9cc6d71eb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1419370118", "name": "tempest-test_aggregate-373013633"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:02.391526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe8eec86-b83d-4b72-aff2-aeeec0f4a030 tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h2-831193-17" status: 200 len: 471 microversion: 2.1 time: 0.094099 Oct 04 17:49:02.393137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 124/276] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/os-hosts/n-h2-831193-17 => generated 471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.400611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c966b1a2-0335-4f79-8e8f-20f99c336461 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.405502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-abe0d53c-b152-47e2-81fe-60d9cc6d71eb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 16f1bc1e-ac57-447b-a91e-0943f095e18a for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:02.411784 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c966b1a2-0335-4f79-8e8f-20f99c336461 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.016866 Oct 04 17:49:02.412673 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 125/277] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:02.431460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.432037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:02.440259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=88,nova_api:INSERT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:02.449797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.451099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.454098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.455221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.455916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.456661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.459985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abe0d53c-b152-47e2-81fe-60d9cc6d71eb tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.096163 Oct 04 17:49:02.460581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 153/278] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 17:49:02 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.475932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Calling method '.version_select at 0x7f63424dcdc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.506449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.507194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.509057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.541532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.542404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.543206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.584866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e66e94d4-ed0c-4670-b3fd-9a56b64e0e3f tempest-HostsAdminTestJSON-774315256 tempest-HostsAdminTestJSON-774315256-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h1-831193-17" status: 200 len: 603 microversion: 2.1 time: 0.119939 Oct 04 17:49:02.586564 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 154/279] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/os-hosts/n-h1-831193-17 => generated 603 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:02.598231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d31ed56c-277b-4b30-880c-b62e73b40e01 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:02.633928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d31ed56c-277b-4b30-880c-b62e73b40e01 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:02.634948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d31ed56c-277b-4b30-880c-b62e73b40e01 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:02.637748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d31ed56c-277b-4b30-880c-b62e73b40e01 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:02.718814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:02.895669 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d31ed56c-277b-4b30-880c-b62e73b40e01 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.306496 Oct 04 17:49:02.897158 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 155/280] 10.222.0.33 () {62 vars in 1232 bytes} [Tue Oct 4 17:49:02 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:02.913426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bf51f3b-015b-4732-81c4-33e6be14d330 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.975947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3bf51f3b-015b-4732-81c4-33e6be14d330 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.076672 Oct 04 17:49:02.980787 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 156/281] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:02.996327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:02.997177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:03.015908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.019647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.020445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.023093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.025095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.028024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.328560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:03.342307 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d0c7885d-c9fc-4081-8b01-1b300e42b31a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.917631 Oct 04 17:49:03.347238 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 126/282] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:03.365203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea434d77-75fd-4a69-8529-58fe98918367 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:03.395770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea434d77-75fd-4a69-8529-58fe98918367 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.398477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea434d77-75fd-4a69-8529-58fe98918367 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.401943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea434d77-75fd-4a69-8529-58fe98918367 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.453114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:03.476809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3115e42a-f09b-44a4-b5c6-4321a3670027 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.489988 Oct 04 17:49:03.480366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 157/283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:02 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:03.490309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ccc8356-b289-4da1-9afd-c9fe307a18a4 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:03.520429 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0ccc8356-b289-4da1-9afd-c9fe307a18a4 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ccc8356-b289-4da1-9afd-c9fe307a18a4 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Request method failure captured: Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHQ0D66bI7sN4tggAblkfSW5Ti0EzeJcEEKNi89tdg4PUMq868R7qjaNCSUjAVCovRLk7Ut3HbrZaSVESKdNy9OGmjFvcDUZHVttraXRZB_R3GyU9OOE4Q2f_wmGXrQrvjICVsWs6RGsUiNnEMyEeFsyRpH9hCobtoLtXG72k1_LQM Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:03.534626 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 244d4fa184b047088b00a135f28eacab Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: exception: Aggregate 7 could not be found. Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7'} Oct 04 17:49:03.537040 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.538519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 17:49:03.543335 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.550165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ccc8356-b289-4da1-9afd-c9fe307a18a4 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:03.551917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ccc8356-b289-4da1-9afd-c9fe307a18a4 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.069810 Oct 04 17:49:03.552793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 158/284] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:49:03 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:03.566399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:03.568072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:03.575742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.577257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.578416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.579522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.580199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.580821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.712417 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea434d77-75fd-4a69-8529-58fe98918367 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.363039 Oct 04 17:49:03.717774 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 127/285] 10.222.0.33 () {62 vars in 1232 bytes} [Tue Oct 4 17:49:03 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:03.729391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a156da7a-e779-45bd-a6d9-c80626bd749c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:03.760488 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a156da7a-e779-45bd-a6d9-c80626bd749c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a156da7a-e779-45bd-a6d9-c80626bd749c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Request method failure captured: Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHQ0D66bI7sN4tggAblkfSW5Ti0EzeJcEEKNi89tdg4PUMq868R7qjaNCSUjAVCovRLk7Ut3HbrZaSVESKdNy9OGmjFvcDUZHVttraXRZB_R3GyU9OOE4Q2f_wmGXrQrvjICVsWs6RGsUiNnEMyEeFsyRpH9hCobtoLtXG72k1_LQM Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:03.770253 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24a0327d5e0b43008098853ccb80f5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 24a0327d5e0b43008098853ccb80f5e0 Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761599725 Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 244d4fa184b047088b00a135f28eacab Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminTestJSON-761599725-project-admin Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: exception: Aggregate 7 could not be found. Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '7'} Oct 04 17:49:03.771669 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:03.772353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:03.773366 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:03.774436 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:03.774436 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:03.774436 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:03.774436 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 17:49:03.774436 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:03.774708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:03.774797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a156da7a-e779-45bd-a6d9-c80626bd749c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:03.776731 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a156da7a-e779-45bd-a6d9-c80626bd749c tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.052945 Oct 04 17:49:03.781977 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f24baf7a-c0a3-49ee-b78e-9e7c1af600fa tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1270 microversion: 2.1 time: 0.225788 Oct 04 17:49:03.784034 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 128/286] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:03.801724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "name": "network-vif-plugged", "status": "completed", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:03.804235 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 159/287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:03 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:03.828691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f1603c9-fc5c-451a-ae0c-991e046cf9b3 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:03.832175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:03.832684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:03.833128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:03.871390 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f1603c9-fc5c-451a-ae0c-991e046cf9b3 tempest-AggregatesAdminTestV241-1896338779 tempest-AggregatesAdminTestV241-1896338779-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.065574 Oct 04 17:49:03.878697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 160/288] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:49:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:03.884432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b6f8c0f-88f5-4d5b-b2b0-846901e0b8f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1582564353"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:03.890135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-2b6f8c0f-88f5-4d5b-b2b0-846901e0b8f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid a6f8d3d9-1915-45bc-b813-b15f1187f52e for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:03.900442 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] Creating event network-vif-plugged:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h1-831193-17 Oct 04 17:49:03.926214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b6f8c0f-88f5-4d5b-b2b0-846901e0b8f2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046007 Oct 04 17:49:03.927632 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 161/289] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:03.939796 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-646c7d57-9b71-4e08-b24e-809ba243c135 req-c67e9d4d-de6a-452e-b5d5-94ecd9b1bd60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135404 Oct 04 17:49:03.941907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-832e57f0-de72-469e-b918-77102ac01689 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:03.942754 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 129/290] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:03.959698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-832e57f0-de72-469e-b918-77102ac01689 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.022544 Oct 04 17:49:03.961420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 162/291] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:49:03 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:03.979220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30fe79ac-2f2b-4154-ae05-bd8404040fb9 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:04.030677 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30fe79ac-2f2b-4154-ae05-bd8404040fb9 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.056897 Oct 04 17:49:04.035915 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 130/292] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:04.045977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-286ac0bf-f7cf-45eb-884d-0d948c6a6555 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.061035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-286ac0bf-f7cf-45eb-884d-0d948c6a6555 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.019754 Oct 04 17:49:04.066976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 163/293] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:49:04 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:04.080954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bb943fba-c8f0-4171-9de8-c1611818bcd2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.147217 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bb943fba-c8f0-4171-9de8-c1611818bcd2 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.072428 Oct 04 17:49:04.155507 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 131/294] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:04 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:04.158081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04bdd8d0-106c-4b5e-8514-f214ebc13ccd tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1107647859", "availability_zone": "tempest-test_az-884942065"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:04.167076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-04bdd8d0-106c-4b5e-8514-f214ebc13ccd tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 564540aa-fa38-48df-b070-b1a322842bce for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:04.259913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04bdd8d0-106c-4b5e-8514-f214ebc13ccd tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.105859 Oct 04 17:49:04.262645 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 164/295] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 17:49:04 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:04.273738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-575749a9-122b-4dba-b790-fa838418d0ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1107647859_new", "availability_zone": "tempest-test_az-884942065_new"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:04.382537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.383558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:04.396217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.397023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.398756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.401575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.403430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.404583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.409818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-575749a9-122b-4dba-b790-fa838418d0ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.410966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-575749a9-122b-4dba-b790-fa838418d0ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.411833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-575749a9-122b-4dba-b790-fa838418d0ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.474429 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-575749a9-122b-4dba-b790-fa838418d0ea tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.205258 Oct 04 17:49:04.482209 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 132/296] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 17:49:04 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:04.499403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c33fea7a-87bd-4dab-a07a-8b1bae413a75 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.524197 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c33fea7a-87bd-4dab-a07a-8b1bae413a75 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.040240 Oct 04 17:49:04.526739 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 133/297] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:49:04 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:04.547373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.550456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:04.570386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.572137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.574945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.576012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.578318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.578774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.683268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:04.698837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a69382b7-2024-4d80-9e63-2603fa5d8a07 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.322480 Oct 04 17:49:04.707407 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 165/298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:04 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:04.718351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2947b884-2c95-41c5-a8e1-dc8c62e872b7 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.748043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:04.799787 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2947b884-2c95-41c5-a8e1-dc8c62e872b7 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.089373 Oct 04 17:49:04.802765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 166/299] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:04.812742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:04.815523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:04.846746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.847411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.849228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.850094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:04.850964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:04.852312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:04.998183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:05.003652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:05.013794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cfa7cd7f-8b69-46e6-8cc2-5e254c6f472f tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1276 microversion: 2.1 time: 0.207073 Oct 04 17:49:05.018051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 167/300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:04 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:05.020096 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ed7dafc8-3cb7-4ee3-b418-e911018d618f tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.490306 Oct 04 17:49:05.020683 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 134/301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:04 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:05.039629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a8dbe3e-4be3-435d-a050-e7b1bf2d1534 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1670804658"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:05.043157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-0a8dbe3e-4be3-435d-a050-e7b1bf2d1534 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Generated uuid 34065989-a06f-48bc-b536-3131bc5ffbae for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:05.077992 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a8dbe3e-4be3-435d-a050-e7b1bf2d1534 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040994 Oct 04 17:49:05.078994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 168/302] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:05.090590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-05a75f1e-90f8-4474-af83-c4a11113d474 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:05.101365 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-05a75f1e-90f8-4474-af83-c4a11113d474 tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014332 Oct 04 17:49:05.104273 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 135/303] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:49:05 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:05.118005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-82263ff5-ba79-4833-9403-69424fb032dd tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:05.184288 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-82263ff5-ba79-4833-9403-69424fb032dd tempest-AggregatesAdminTestJSON-761599725 tempest-AggregatesAdminTestJSON-761599725-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.071726 Oct 04 17:49:05.189012 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 169/304] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:05 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:05.196720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:05.197319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:05.204377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.204915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.205357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:05.206136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.214437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.215300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:05.252785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] HTTP exception thrown: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Request method failure captured: Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c HTTP/1.1 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHNAZskNLyob5n720NMxcev_ASZ2M9so1hEqC7ctIMYge-DwnDqwzmhcgYuQKFLRDjLiJgC_1PksM15GTV0MKzMDpRHasIIHtn2LVAN-g5MWq8vIRFogb2Vt32iKGeI2WFCci8LIXHSIO8F6LI5tTRCsLwjWoSSjJB_jKWnvflOrvw Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:05.257766 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 6a6a7f8c5a6c46bfbf218c6d94d59739 Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.259556 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '852dd469-c574-4279-9728-1b0c9a725f1c'} Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:05.260216 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.261424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.262530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Returning 404 to user: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:05.262530 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-765c4959-adcf-4f6d-b5dd-8438b3f45a01 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 404 len: 111 microversion: 2.1 time: 0.067460 Oct 04 17:49:05.262530 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 136/305] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:05 2022] DELETE /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:05.273144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:05.274648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] [instance: 852dd469-c574-4279-9728-1b0c9a725f1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:05.303091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.305169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.309102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:05.309990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.310504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.314594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:05.335009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] HTTP exception thrown: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Request method failure captured: Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c HTTP/1.1 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHNAZskNLyob5n720NMxcev_ASZ2M9so1hEqC7ctIMYge-DwnDqwzmhcgYuQKFLRDjLiJgC_1PksM15GTV0MKzMDpRHasIIHtn2LVAN-g5MWq8vIRFogb2Vt32iKGeI2WFCci8LIXHSIO8F6LI5tTRCsLwjWoSSjJB_jKWnvflOrvw Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:05.344443 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a8401eab61d46e7a8e694b8009de6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 4a8401eab61d46e7a8e694b8009de6a3 Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-813961965 Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6a6a7f8c5a6c46bfbf218c6d94d59739 Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminTestJSON-813961965-project Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.345656 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '852dd469-c574-4279-9728-1b0c9a725f1c'} Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:05.346298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. Oct 04 17:49:05.347399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:05.348375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] Returning 404 to user: Instance 852dd469-c574-4279-9728-1b0c9a725f1c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:05.348375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb618ed6-407e-413e-a8f8-9da12c9626c7 tempest-AggregatesAdminTestJSON-813961965 tempest-AggregatesAdminTestJSON-813961965-project] 10.222.0.33 "GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c" status: 404 len: 111 microversion: 2.1 time: 0.081751 Oct 04 17:49:05.352965 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 170/306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:05 2022] GET /compute/v2.1/servers/852dd469-c574-4279-9728-1b0c9a725f1c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:05.730459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:05.731236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:05.744603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.746154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.747470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:05.752968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:05.769020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:05.772070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:06.048363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:06.050980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:06.063882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:06.064834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:06.065810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:06.066787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:06.068923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:06.069725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:06.182500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:06.191550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:06.196780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78af12a1-4d2b-4ea5-aaac-bf9256bc239e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1276 microversion: 2.1 time: 0.150228 Oct 04 17:49:06.200546 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 171/307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:06 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:06.209724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:06.215354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:06.216971 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e352b4fe-e89c-4a68-8b28-075514f84263 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1313 microversion: 2.1 time: 0.474613 Oct 04 17:49:06.221805 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 137/308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:05 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:06.250202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:06.250879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:06.251635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:06.253501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:06.254204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:06.254840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:06.942469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:06.954233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-096be8c5-25a1-4317-b295-95647f5f3707 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.752350 Oct 04 17:49:06.968799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 172/309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:06 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:07.225526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:07.226910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:07.234751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:07.235738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:07.236465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:07.237457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:07.238236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:07.238932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:07.245882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:07.247400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:07.264920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:07.266416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:07.267443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:07.269894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:07.272045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:07.276173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:07.832777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:07.851515 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2cb90be7-feb8-4a83-8af8-7bd61b597970 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.622810 Oct 04 17:49:07.852234 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 138/310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:07 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:07.983492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:07.984107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:08.003630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.005776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.007541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:08.008692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.011846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.012465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:08.017375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:08.099870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:08.113343 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5acd1e57-8a95-433d-8022-0a54ea0df751 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1463 microversion: 2.1 time: 0.871935 Oct 04 17:49:08.122615 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 173/311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:07 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1463 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:08.503141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:08.538652 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6f069b5-4f46-4fc6-9515-4f259e323c2e tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.562351 Oct 04 17:49:08.545373 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 139/312] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:07 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:08.780423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:08.781063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:08.792630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.793149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.793593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:08.796754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.797386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.800726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:08.882970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:08.884297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:08.900564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.912020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.914046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:08.915654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:08.916460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:08.927012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:09.890889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2978a973-a364-4776-8f29-a1b4f2d84c3c tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1616 microversion: 2.1 time: 1.743758 Oct 04 17:49:09.902540 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 174/313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:08 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1616 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:09.908325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3caec25-7e5b-4b1a-b580-981e1d2699b2", "tag": "b399f855-a2c4-4cd4-b71d-4fa863a49109"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:09.926899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:09.928620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:09.931080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:09.960488 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] Creating event network-changed:b399f855-a2c4-4cd4-b71d-4fa863a49109 for instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 on n-h2-831193-17 Oct 04 17:49:09.969360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fa1478d0-5a1d-4555-9651-d2aeeccdf914 req-cdda0bdf-0a3b-4058-bedd-9bd53ce9cdb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065291 Oct 04 17:49:09.974963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 175/314] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:09.981151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b5348e-5de5-496b-8e96-cf2f4e69d9f5", "name": "network-vif-plugged", "status": "completed", "tag": "4fe80c55-900f-43ed-85dd-2f2f200409ef"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:10.007177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:10.007922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:10.008595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:10.021590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:10.032826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] Creating event network-vif-plugged:4fe80c55-900f-43ed-85dd-2f2f200409ef for instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 on n-h1-831193-17 Oct 04 17:49:10.040741 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f2d8a91-f599-40aa-81e3-335611f103bb tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 1.163310 Oct 04 17:49:10.041555 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 140/315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:08 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:10.046518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-42b3fbea-186b-40eb-affd-b5ee71c5e778 req-d405f7fc-0ed8-4131-91d5-eb00b060a4a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069263 Oct 04 17:49:10.050493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:10.051248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:10.052960 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 176/316] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:10.062219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:10.062940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:10.072221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:10.080230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:10.080979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:10.081602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:10.082476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:10.083113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:10.089165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:10.095172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:10.095937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:10.101186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:10.104315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:10.105442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:10.640753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:10.652341 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0848b177-3891-4e96-9d1a-040f4d45a7a4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1320 microversion: 2.1 time: 0.605662 Oct 04 17:49:10.653162 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 141/317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:10 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1320 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:10.946065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '15a514bb8e3042169f795fd117db8886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06621baf96d541649ee96173cb87f959', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:10.946769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] flavor_id is None. Assuming migration. {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 17:49:10.947740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 17:49:11.273817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63425f7310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:11.276987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.277888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.286110 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e71cd4c-beaa-41a6-922e-07d84dfeba2b tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5/action" status: 202 len: 0 microversion: 2.1 time: 1.231648 Oct 04 17:49:11.288054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 177/318] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:49:10 2022] POST /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5/action => generated 0 bytes in 1234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:11.291954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.301853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:11.304344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:11.314214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.319330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.323989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.327111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.327985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.329738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.362519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.368671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.369304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.414407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.419899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.426663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.453043 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7cddca13-4fd1-45c6-b3af-4c817ab7da27 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.653571 Oct 04 17:49:11.455728 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 142/319] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:11.467115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:11.468424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:11.483770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.484515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.485138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.486310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.486919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.490084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:11.701198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:11.959003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:11.967208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2db57d5-9a0f-4220-9d5a-3dce22643044 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.673881 Oct 04 17:49:11.973827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 178/320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:11 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:11.980003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63423e31f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:11.993388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:11.994192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:11.994987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.005916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:12.045699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.046256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.047018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.065001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:12.105831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.106574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.107276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.124442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af574f06-802c-46da-bb7b-43821177b28a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.147260 Oct 04 17:49:12.141910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 179/321] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 17:49:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:12.164374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:12.165032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:12.172673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=23 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:12.190181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.190689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.191233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.192068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.200811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.201573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.571225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:12.598853 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-720267b9-f702-424b-b244-5a5619f6b1e9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1472 microversion: 2.1 time: 1.138054 Oct 04 17:49:12.603818 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 143/322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:11 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1472 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:12.620495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63421b0820>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:12.622777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.623926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.624347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.681848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.682494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.683450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.722443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.723298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.723757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.747232 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78aace1c-75b4-4682-9d44-d54d41349ba8 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.140118 Oct 04 17:49:12.747893 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 144/323] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:12.760906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63421b00d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:12.762831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.763568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.765295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.786273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.786997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.787672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.803663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7c46055d-eccc-4ed8-a21e-ccec2c99c490 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.039661 Oct 04 17:49:12.818159 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 145/324] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:12.833175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba7afb5f-d414-4f6d-89d9-e87d3dbecf3a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63421b0dc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:12.837206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba7afb5f-d414-4f6d-89d9-e87d3dbecf3a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.839235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba7afb5f-d414-4f6d-89d9-e87d3dbecf3a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.839921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba7afb5f-d414-4f6d-89d9-e87d3dbecf3a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.875137 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba7afb5f-d414-4f6d-89d9-e87d3dbecf3a tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.050825 Oct 04 17:49:12.887526 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 146/325] 10.222.0.33 () {58 vars in 1179 bytes} [Tue Oct 4 17:49:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:12.891349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:12.908168 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-732bc421-0493-446f-9d03-701580a7ddd4 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1470 microversion: 2.1 time: 0.763643 Oct 04 17:49:12.909354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63421b08b0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:12.929215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 180/326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:12 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1470 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:12.930387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.932287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.933975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:12.974832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:12.993424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:12.993826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:12.995946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:12.996447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.029180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.029721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.036396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.047243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.048499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.055640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.057038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.060225 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5c5e52b0-8b5a-4cf4-8530-bbf6a3dcb5f7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.165234 Oct 04 17:49:13.069322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.070484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.070645 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 147/327] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:13.122468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:13.126676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:13.179560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.182349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.184981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.189845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.194974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.196727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.478471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:13.578636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-effff13c-c38e-411a-842f-f7291a1f9a6f tempest-DeleteServersAdminTestJSON-2067394303 tempest-DeleteServersAdminTestJSON-2067394303-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.639798 Oct 04 17:49:13.582408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 181/328] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:49:12 2022] POST /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:13.601130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63424b5f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:13.607696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.612812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.614013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.705372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.714921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.719909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.757441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59e23eca-c30e-4ef2-9040-b9e89e09d3e9 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.154349 Oct 04 17:49:13.758673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 182/329] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:13.775256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:13.783086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:13.793537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.794679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.796107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.798042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.799010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.800892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.893739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:13.894821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:13.895834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:13.907296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lazy-loading 'fault' on Instance uuid 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:13.991488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:14.002329 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc281257-ac64-4f1b-b432-610b139512ba tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.928410 Oct 04 17:49:14.009683 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 148/330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:13 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:14.032769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:14.042536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:14.067291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.067837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.068289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.072997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.079017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.079844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.411472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:14.421002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85fdfd65-22dc-4171-849c-d53350dff3cc tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1453 microversion: 2.1 time: 0.659275 Oct 04 17:49:14.426040 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 183/331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:13 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1453 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:14.445728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f63422ef670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:14.449908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.450587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.451051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.485749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.486489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.487119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.503161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce903acc-9243-4fb6-9225-fc760356c0a7 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.075479 Oct 04 17:49:14.503792 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 184/332] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:14 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:14.668459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:14.672764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.676519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.677065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.677944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.678486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.679495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.746412 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-203a5a2b-0cdd-46f9-b5da-37a60692f1b4 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.224556 Oct 04 17:49:14.749252 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 185/333] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:49:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:14.755224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:14.756060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:14.768854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.770254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.770993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.772202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.774251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.775409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.817399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:49:14.856120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:14.874154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d25220b8-c59a-4269-88ca-5b5d239f77ec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1472 microversion: 2.1 time: 0.856259 Oct 04 17:49:14.886444 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 149/334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:14 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1472 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:14.915477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Calling method '.version_select at 0x7f634215b4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:14.930825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.933515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.933985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:14.983915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:14.985633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:14.999196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.058511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.061699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.062436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.072714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a182684-1b77-4689-84e4-7deaf4d8b130 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 204 len: 0 microversion: 2.1 time: 0.319358 Oct 04 17:49:15.075469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 186/335] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:14 2022] DELETE /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:15.092142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2cbaf79-5ebf-4bb7-b249-212201ae2a0f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-415070675"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:15.108507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-d2cbaf79-5ebf-4bb7-b249-212201ae2a0f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid 93880fb2-6272-43f8-876d-f437e34c04e6 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:15.121276 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7883d42c-79da-4c60-a5ce-93ca82759f43 tempest-HypervisorAdminTestJSON-1043606199 tempest-HypervisorAdminTestJSON-1043606199-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.219079 Oct 04 17:49:15.123798 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 150/336] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:14 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:15.139659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:15.141047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:15.151770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.152465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.154220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.155504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.156665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.158189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.187677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2cbaf79-5ebf-4bb7-b249-212201ae2a0f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109996 Oct 04 17:49:15.195867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 187/337] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:15.213983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:15.216664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:15.234180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.237740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.246232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.247479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.248836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.249463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.356168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.356697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.357141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.364127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lazy-loading 'fault' on Instance uuid 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:15.756881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:15.763174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:15.768036 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86a5355f-ff72-485d-80b6-49a84e9dbf7d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1459 microversion: 2.1 time: 0.568737 Oct 04 17:49:15.771341 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 188/338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:15 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1459 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:15.776688 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9cad0c12-f367-4407-87cc-0b9c8eee1ffd tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.644987 Oct 04 17:49:15.781395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 151/339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:15 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:15.783886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa248799-92d5-4007-8611-2226c6d63e97 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:15.811416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa248799-92d5-4007-8611-2226c6d63e97 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.812283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa248799-92d5-4007-8611-2226c6d63e97 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.813049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa248799-92d5-4007-8611-2226c6d63e97 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.898979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:15.899646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:15.913965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.922116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.923056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:15.924891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:15.925550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:15.926142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:16.124580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa248799-92d5-4007-8611-2226c6d63e97 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.351585 Oct 04 17:49:16.133823 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 189/340] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:15 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:16.139155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:16.153920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:16.154943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:16.155588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:16.188148 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-831193-17. Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 40 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:16.210912 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: {"add_host": {"host": "n-h2-831193-17"}} Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:16.212587 n-d-831193-17 devstack@n-api.service[128770]: exception: Aggregate 11 already has host n-h2-831193-17. Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-831193-17'}}} Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:16.213515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-831193-17-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 17:49:16.215942 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 17:49:16.217112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:16.218312 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-831193-17-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 17, 49, 16, 179218), 'updated_at': None, 'host': 'n-h2-831193-17', 'aggregate_id': 11}] Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:16.219553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-831193-17. Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.220781 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-831193-17. Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:16.226922 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-831193-17. Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-831193-17. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4843680-8041-4e07-a21f-9203c1b9a8c1 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.077464 Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 190/341] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:16 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 17:49:16.228442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65a880de-1688-4511-8fa5-e58375955f02 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:16.256763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a880de-1688-4511-8fa5-e58375955f02 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:16.258587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a880de-1688-4511-8fa5-e58375955f02 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:16.259391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a880de-1688-4511-8fa5-e58375955f02 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:16.511321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65a880de-1688-4511-8fa5-e58375955f02 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.289768 Oct 04 17:49:16.523907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 191/342] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:16 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:16.540727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e308436-81b3-477b-9ff4-165c19c89a86 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:16.621632 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e308436-81b3-477b-9ff4-165c19c89a86 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.096092 Oct 04 17:49:16.622142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 192/343] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:16 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:16.635897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77b8399b-008f-4b4b-b7d7-93ea9e6b71b8 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348098810"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:16.645850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-77b8399b-008f-4b4b-b7d7-93ea9e6b71b8 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid ab7d9c67-4446-4859-8d7f-28d4582f6077 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:16.662297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:16.699224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77b8399b-008f-4b4b-b7d7-93ea9e6b71b8 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066850 Oct 04 17:49:16.700701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 193/344] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:17.154113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05e4a46b-adc3-48e9-8201-b8fa7d7c3b4b tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:17.161559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-05e4a46b-adc3-48e9-8201-b8fa7d7c3b4b tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05e4a46b-adc3-48e9-8201-b8fa7d7c3b4b tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 40 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:17.163258 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: {"add_host": {"host": "n-h2-831193-17"}} Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:17.164951 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-831193-17'}}} Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:17.166140 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:17.167786 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:17.171885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05e4a46b-adc3-48e9-8201-b8fa7d7c3b4b tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:17.173602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05e4a46b-adc3-48e9-8201-b8fa7d7c3b4b tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.463849 Oct 04 17:49:17.179562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 194/345] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:17.203115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:17.203745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:17.210230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.210924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.212762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.213751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.214372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.214957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.252185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.253158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.254112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.254718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lazy-loading 'fault' on Instance uuid 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:17.462270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:17.542437 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-957cf3a6-cae6-4697-98f8-349a36a7d029 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1472 microversion: 2.1 time: 1.646877 Oct 04 17:49:17.559792 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 152/346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:15 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1472 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:17.585723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:17.588112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:17.599404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.600094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.600939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.602450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.603907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.604930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.614738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:17.629763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e2ad438-7a23-4360-9653-39a562040def tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1459 microversion: 2.1 time: 0.448882 Oct 04 17:49:17.630366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 195/347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:17 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1459 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:17.662051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f90ed0ff-85f5-48d1-8241-523ee921595f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:17.768350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f90ed0ff-85f5-48d1-8241-523ee921595f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.121923 Oct 04 17:49:17.774765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 196/348] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:17 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:17.786630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41556e52-3107-4cae-9f1f-b4b9daf35d2c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1747958626"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:17.798868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-41556e52-3107-4cae-9f1f-b4b9daf35d2c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid b729f365-071f-491e-bbb0-04ccebdfc695 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:17.897536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41556e52-3107-4cae-9f1f-b4b9daf35d2c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.120303 Oct 04 17:49:17.898354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 197/349] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:17.910843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1550790928"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:17.935617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.936180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.936500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.960456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:17.961508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:17.961508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:17.995455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:18.002392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1550790928 could not be found. Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 58 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:18.005265 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: {"add_host": {"host": "tempest-nonexist_host-1550790928"}} Oct 04 17:49:18.006412 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: exception: Compute host tempest-nonexist_host-1550790928 could not be found. Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1550790928'}}} Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1550790928' is not mapped to any cell Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.007073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 17:49:18.008384 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1550790928 could not be found. Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1550790928 could not be found. Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.009678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1550790928 could not be found. Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1550790928 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55d0d0e6-11fd-491d-b14b-c87284872df9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.100109 Oct 04 17:49:18.010792 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 198/350] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:17 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:18.017942 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0897f801-9d02-4e60-a2ee-fa078f1c3d0c tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.455754 Oct 04 17:49:18.018124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d34b017d-1650-4e05-a466-5ada8a08f9fa tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.019901 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 153/351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:17 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:18.073252 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d34b017d-1650-4e05-a466-5ada8a08f9fa tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.061249 Oct 04 17:49:18.074087 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 199/352] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:18 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:18.084239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-38db9d92-2095-4ec1-b467-0ec527dd927c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-38db9d92-2095-4ec1-b467-0ec527dd927c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 283 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:18.089296 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.090598 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:49:18.091195 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.092328 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.095955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.097408 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:49:18.097408 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:49:18.097408 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:18.097408 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.101970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-38db9d92-2095-4ec1-b467-0ec527dd927c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.103279 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-38db9d92-2095-4ec1-b467-0ec527dd927c tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024080 Oct 04 17:49:18.106544 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 154/353] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:18.116521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6804c6b2-c602-4d85-8c8f-6860782abb03 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6804c6b2-c602-4d85-8c8f-6860782abb03 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 27 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:18.120925 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: {"aggregate": {"name": ""}} Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:18.122204 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.122923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:18.125562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.129798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6804c6b2-c602-4d85-8c8f-6860782abb03 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.130916 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6804c6b2-c602-4d85-8c8f-6860782abb03 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018135 Oct 04 17:49:18.136158 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 200/354] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:18.144345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e27848e-b76d-4363-b30d-0961b7ec823a tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541722199"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.150410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e27848e-b76d-4363-b30d-0961b7ec823a tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e27848e-b76d-4363-b30d-0961b7ec823a tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 59 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:18.155341 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: {"aggregate": {"name": "tempest-test_aggregate-541722199"}} Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:18.156706 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-541722199'}}} Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:18.157442 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:18.158448 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:18.159520 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.168754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e27848e-b76d-4363-b30d-0961b7ec823a tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.171172 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e27848e-b76d-4363-b30d-0961b7ec823a tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.034002 Oct 04 17:49:18.176196 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 155/355] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:49:18.189089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99c9b178-36a2-46c1-ba5e-d6011214fb76 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2066658150"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.199109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-99c9b178-36a2-46c1-ba5e-d6011214fb76 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid b660b665-047c-46d0-9f4c-43cf08de89a7 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:18.263018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99c9b178-36a2-46c1-ba5e-d6011214fb76 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.076563 Oct 04 17:49:18.272044 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 201/356] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:18.297033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2066658150"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.306193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid c08cbfd0-eb12-49ca-96d1-edceda982d0e for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:18.325829 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2066658150 already exists. Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 60 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:18.328244 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: {"aggregate": {"name": "tempest-test_aggregate-2066658150"}} Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:18.329417 n-d-831193-17 devstack@n-api.service[128770]: exception: Aggregate tempest-test_aggregate-2066658150 already exists. Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2066658150'}}} Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 17:49:18.330111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2066658150 already exists. Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:18.331187 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2066658150 already exists. Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2066658150 already exists. Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.332322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2066658150 already exists. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.338179 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5201c028-23c8-43da-8b92-62e88fa3b670 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.048412 Oct 04 17:49:18.342644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 202/357] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:18.352939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-080eb641-809b-4a9d-8f92-01a6f796853a tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.418213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-080eb641-809b-4a9d-8f92-01a6f796853a tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.074376 Oct 04 17:49:18.424152 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 203/358] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:18 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:18.454608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ffc30276-e05f-4879-a450-cc3614e87dfc tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2008564733"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.464018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-ffc30276-e05f-4879-a450-cc3614e87dfc tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid 8bf79bb9-82a7-48b6-aff7-47aa9010b639 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:18.543791 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ffc30276-e05f-4879-a450-cc3614e87dfc tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.118394 Oct 04 17:49:18.547922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 204/359] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:18.568963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b63995f-dab8-4351-9c39-f2b7ca48acf7 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.570482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b63995f-dab8-4351-9c39-f2b7ca48acf7 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b63995f-dab8-4351-9c39-f2b7ca48acf7 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:18.572082 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:18.573286 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '15'} Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:18.574025 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:18.575991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b63995f-dab8-4351-9c39-f2b7ca48acf7 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:18.577684 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b63995f-dab8-4351-9c39-f2b7ca48acf7 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.014752 Oct 04 17:49:18.577684 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 205/360] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:18.596422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e91dd1d8-7a95-4be7-b80e-3efb578fea8e tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1777145199", "id": 1626985074, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:18.600459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab4d946f-aa56-411e-92ae-7befcee85b67 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.661486 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab4d946f-aa56-411e-92ae-7befcee85b67 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.072427 Oct 04 17:49:18.664116 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e91dd1d8-7a95-4be7-b80e-3efb578fea8e tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.397088 Oct 04 17:49:18.669842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 206/361] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:18.672453 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 156/362] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:18 2022] POST /compute/v2.1/flavors => generated 431 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:18.689911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.692865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:18.694497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:18.699351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:18.719714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:18.720082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:18.720514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:18.726970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:18.727210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:18.727916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:18.729200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:18.732074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:18.740535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:18.745021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:18.745693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:18.746158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:18.856715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:18.858849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:18.862133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:18.862848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lazy-loading 'fault' on Instance uuid 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:19.039895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4a80d2cfce408e8e1bc355c1ecf288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb489eee36bb40eba357a5aba5101c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:19.062161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-708ead3f-26ee-4b2d-aca8-6ec14d98f04d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 200 len: 1417 microversion: 2.1 time: 0.385843 Oct 04 17:49:19.064266 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 157/363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:18 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 1417 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:19.098365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1569196-e594-4872-98ba-89658dd50120 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:19.141092 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d1569196-e594-4872-98ba-89658dd50120 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1569196-e594-4872-98ba-89658dd50120 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:19.150077 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: exception: Aggregate -1 could not be found. Oct 04 17:49:19.151439 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '-1'} Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:19.152137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:19.153246 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1569196-e594-4872-98ba-89658dd50120 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1569196-e594-4872-98ba-89658dd50120 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.072066 Oct 04 17:49:19.155002 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 158/364] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:19 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:19.177919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caec25-7e5b-4b1a-b580-981e1d2699b2", "name": "network-vif-plugged", "status": "completed", "tag": "b399f855-a2c4-4cd4-b71d-4fa863a49109"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:19.199884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:19.202885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:19.204000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:19.226219 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] Creating event network-vif-plugged:b399f855-a2c4-4cd4-b71d-4fa863a49109 for instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 on n-h2-831193-17 Oct 04 17:49:19.233160 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2fd4743e-ada6-48bd-86ec-6d54688ecec1 req-787dd801-08e1-442a-88bf-d069a263e88b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077456 Oct 04 17:49:19.233776 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 159/365] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:19.253156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d49d158-4336-489b-a934-4ed649914bb1 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bde5117f2e1c43178d00b93d5eaf989b"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:19.366022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:19.381058 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc40a430-3cd7-4c8d-88ce-0bcfe7411330 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1472 microversion: 2.1 time: 0.705212 Oct 04 17:49:19.381830 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 207/366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:18 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1472 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:19.411634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:19.414430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:19.452069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:19.452696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:19.453148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:19.459803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:19.463634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:19.478677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:19.898858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d49d158-4336-489b-a934-4ed649914bb1 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1626985074/action" status: 200 len: 97 microversion: 2.1 time: 0.663561 Oct 04 17:49:19.905940 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 160/367] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:19 2022] POST /compute/v2.1/flavors/1626985074/action => generated 97 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:19.937853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b5348e-5de5-496b-8e96-cf2f4e69d9f5", "name": "network-vif-deleted", "tag": "4fe80c55-900f-43ed-85dd-2f2f200409ef"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:19.966435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:19.977796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:19.979797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:19.982553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:19.985284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:19.994871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5be5817-d252-4a5d-9917-41be731db383 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1318 microversion: 2.1 time: 0.598057 Oct 04 17:49:19.995549 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 208/368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:19 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:20.005381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abab17fd-ac2a-4706-a591-cae8d595a17f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2043843113"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:20.015823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-abab17fd-ac2a-4706-a591-cae8d595a17f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid ba33e8e1-3473-43e0-ac13-7c25c1cce51d for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:20.021093 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] Creating event network-vif-deleted:4fe80c55-900f-43ed-85dd-2f2f200409ef for instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 on n-h1-831193-17 Oct 04 17:49:20.033500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-bd06b113-a29f-4b1d-9f35-838caa7d131a req-49499480-108c-4378-bda9-e8928948a4ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124480 Oct 04 17:49:20.037315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 161/369] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:20.068425 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abab17fd-ac2a-4706-a591-cae8d595a17f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071585 Oct 04 17:49:20.076736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 209/370] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:20.105458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df062118-edac-4d06-8d02-9238d3831d74 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.111389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df062118-edac-4d06-8d02-9238d3831d74 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df062118-edac-4d06-8d02-9238d3831d74 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.116317 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:20.117506 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '16'} Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:20.118492 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:20.120901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.124548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df062118-edac-4d06-8d02-9238d3831d74 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.126946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df062118-edac-4d06-8d02-9238d3831d74 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.038575 Oct 04 17:49:20.129051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 210/371] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.138720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.140779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.151809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.152641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.153427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.155409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.157054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.158013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.178148 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 HTTP/1.1 Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.180643 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.181836 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '41b5348e-5de5-496b-8e96-cf2f4e69d9f5'} Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.182547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.183674 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.188687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.190568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01205071-95bd-4a36-a6f7-1ee164418cc1 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 404 len: 111 microversion: 2.1 time: 0.059486 Oct 04 17:49:20.191914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 211/372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.197054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbd4a186-583a-41f2-be47-ce856fcea5ea tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.236340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbd4a186-583a-41f2-be47-ce856fcea5ea tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.042162 Oct 04 17:49:20.237362 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 212/373] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:20.247160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.250601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.262367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.263287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.264548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.265520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.266268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.267189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.295648 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 HTTP/1.1 Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.297698 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.298940 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '41b5348e-5de5-496b-8e96-cf2f4e69d9f5'} Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.299626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.300684 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.307644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.310068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f0d176c-754a-4c2a-a654-812ffcb50e37 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 404 len: 111 microversion: 2.1 time: 0.071315 Oct 04 17:49:20.312233 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 213/374] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:20 2022] DELETE /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.324949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-22d857f2-5daa-4960-b457-ccef831af50b tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.331383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c975a69e-b072-45f2-b81c-6afc4ce68988 tempest-FlavorsAccessTestJSON-405400477 tempest-FlavorsAccessTestJSON-405400477-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.333902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-22d857f2-5daa-4960-b457-ccef831af50b tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-22d857f2-5daa-4960-b457-ccef831af50b tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:20.340810 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: exception: Aggregate -1 could not be found. Oct 04 17:49:20.342267 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '-1'} Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.343026 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 17:49:20.345815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.347125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-22d857f2-5daa-4960-b457-ccef831af50b tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.347125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-22d857f2-5daa-4960-b457-ccef831af50b tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030522 Oct 04 17:49:20.347953 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 214/375] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:20.357623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.358253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: 41b5348e-5de5-496b-8e96-cf2f4e69d9f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.366805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.367416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.368516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.369306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.370174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.370441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.384015 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c975a69e-b072-45f2-b81c-6afc4ce68988 tempest-FlavorsAccessTestJSON-405400477 tempest-FlavorsAccessTestJSON-405400477-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.345077 Oct 04 17:49:20.386993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 HTTP/1.1 Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.389389 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.390804 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '41b5348e-5de5-496b-8e96-cf2f4e69d9f5'} Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.391626 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. Oct 04 17:49:20.392716 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.393662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance 41b5348e-5de5-496b-8e96-cf2f4e69d9f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.393662 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6958e473-ce87-40e7-ad1b-ce0925ae76ce tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5" status: 404 len: 111 microversion: 2.1 time: 0.037611 Oct 04 17:49:20.393662 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 215/376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/servers/41b5348e-5de5-496b-8e96-cf2f4e69d9f5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.393866 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 162/377] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:20.404697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-524e7811-59e5-4651-a5eb-2abfe0d78481 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.407517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-524e7811-59e5-4651-a5eb-2abfe0d78481 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:20.408545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df47e7a7-8ea9-406a-8b58-d3209d6a20a2 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bde5117f2e1c43178d00b93d5eaf989b"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-524e7811-59e5-4651-a5eb-2abfe0d78481 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.412391 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:20.413629 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:20.414300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.415745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-524e7811-59e5-4651-a5eb-2abfe0d78481 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.417287 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-524e7811-59e5-4651-a5eb-2abfe0d78481 tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021981 Oct 04 17:49:20.417287 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 216/378] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.431749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.434215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.446720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.450052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.453273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.455328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.457502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.459688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.498895 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de HTTP/1.1 Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:20.505312 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.506779 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de'} Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.507463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.508506 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.513159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.514615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ba76456-fad5-44ed-b56e-794aac1c391d tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 404 len: 111 microversion: 2.1 time: 0.091215 Oct 04 17:49:20.516224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 217/379] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:20 2022] DELETE /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.538473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.542707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.554178 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df47e7a7-8ea9-406a-8b58-d3209d6a20a2 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1626985074/action" status: 200 len: 21 microversion: 2.1 time: 0.152246 Oct 04 17:49:20.555437 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 163/380] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:20 2022] POST /compute/v2.1/flavors/1626985074/action => generated 21 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:49:20.571090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2de7ae73-ea5b-49c9-90a3-de8a6593b8f9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-517013512"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:20.572024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.572591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.573042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.573794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.574252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.581511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.589619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.aggregate [None req-2de7ae73-ea5b-49c9-90a3-de8a6593b8f9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid 4198c7d6-c4b4-4925-a11a-9b44d55a29f6 for aggregate {{(pid=128771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:20.644748 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2de7ae73-ea5b-49c9-90a3-de8a6593b8f9 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080212 Oct 04 17:49:20.646561 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 164/381] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:20.657831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.658843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] [instance: a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:20.679014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.679848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.680712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.681680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.684254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.684976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.712844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] HTTP exception thrown: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Request method failure captured: Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de HTTP/1.1 Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHHc_HeTwjZN7pXgKIOPnJ05xhSPpmEun0EWWNsGVkEMXGk_a2C5FSnmDcXKmlvevQY9M7-nR6P-zTvdOTTsYDO5TrhG4If9jNo11-nTZ_IyEunFAEuXoEci-HI56hanOoy8qEZ1XGzsdulSbqOBRBpb0kv4y657Cp1aFv3pvi9omwc Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:20.723862 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb489eee36bb40eba357a5aba5101c5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: eb489eee36bb40eba357a5aba5101c5c Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640146567 Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9f4a80d2cfce408e8e1bc355c1ecf288 Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640146567-project Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.725360 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de'} Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:20.726022 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. Oct 04 17:49:20.727122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:20.728106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] Returning 404 to user: Instance a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:20.728106 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d5f68c7d-b932-48ca-a277-38c743847506 tempest-DeleteServersAdminTestJSON-1640146567 tempest-DeleteServersAdminTestJSON-1640146567-project] 10.222.0.33 "GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de" status: 404 len: 111 microversion: 2.1 time: 0.078959 Oct 04 17:49:20.733470 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 165/382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/servers/a7d0d1e6-9ba8-4fa2-ab62-03be0d29f6de => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:20.742996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f26afb77-9448-42dc-979e-e9c0e55d68c5 tempest-FlavorsAccessTestJSON-405400477 tempest-FlavorsAccessTestJSON-405400477-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:20.799601 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f26afb77-9448-42dc-979e-e9c0e55d68c5 tempest-FlavorsAccessTestJSON-405400477 tempest-FlavorsAccessTestJSON-405400477-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061649 Oct 04 17:49:20.800959 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 166/383] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:20.806212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-353b89ac-474e-4aec-82ce-af725b279e3f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:20.846020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-353b89ac-474e-4aec-82ce-af725b279e3f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:20.846896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-353b89ac-474e-4aec-82ce-af725b279e3f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:20.847580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-353b89ac-474e-4aec-82ce-af725b279e3f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:20.881993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:21.026840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:21.027968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-353b89ac-474e-4aec-82ce-af725b279e3f tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.225481 Oct 04 17:49:21.032453 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 167/384] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:21.046961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a23ea163-e938-41d4-8009-206f5a0ad41d tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:21.052318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52f92e02-d5b6-4c4e-8493-fbf8ce57a63b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1472 microversion: 2.1 time: 0.534036 Oct 04 17:49:21.052915 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 218/385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:20 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:21.082338 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a23ea163-e938-41d4-8009-206f5a0ad41d tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1626985074" status: 202 len: 0 microversion: 2.1 time: 0.047690 Oct 04 17:49:21.085688 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 168/386] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:21 2022] DELETE /compute/v2.1/flavors/1626985074 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:21.101643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:21.104584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:21.118609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:21.119728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:21.122301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:21.126461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:21.127235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:21.128166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:21.649403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-807113737", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1a1507de-64a0-41ec-99ee-723250e9aaaa"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:21.736206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] validate_networks() for [('1a1507de-64a0-41ec-99ee-723250e9aaaa', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:21.856713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:21.867362 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-871a78d5-984a-4944-a18f-6438949d5742 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1468 microversion: 2.1 time: 0.779009 Oct 04 17:49:21.884338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 169/387] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:21 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1468 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:21.899187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc637689-a243-4086-873c-40bf96f1d8bc tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:21.904560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cc637689-a243-4086-873c-40bf96f1d8bc tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6b65ff755ac1450491fa6cd8c01aa751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25698c6256c4aa9a123b192d0d985d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc637689-a243-4086-873c-40bf96f1d8bc tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Request method failure captured: Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 43 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIXDm63h8BVngLCwmadxOzydsO5wl-8FedDr0SB7wTMX5sES3RvFWIXInoh-24o-x-BBSZQBj4kAqHqt85TOQVgj9lQIuJzqVkgeNkppxKbupjMEQQV2MAcvpVBte6WIOgdXyPLlfaFIElsAASuHdjuZlZ-sqCcMS8OECAp4g19km0 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:21.906951 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a25698c6256c4aa9a123b192d0d985d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a25698c6256c4aa9a123b192d0d985d4 Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-68356146 Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 6b65ff755ac1450491fa6cd8c01aa751 Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-68356146-project Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: {"remove_host": {"host": "n-h2-831193-17"}} Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:21.908427 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-831193-17'}}} Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:21.909252 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:49:21.910507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:21.912480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc637689-a243-4086-873c-40bf96f1d8bc tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:21.914082 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc637689-a243-4086-873c-40bf96f1d8bc tempest-AggregatesAdminNegativeTestJSON-68356146 tempest-AggregatesAdminNegativeTestJSON-68356146-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.027941 Oct 04 17:49:21.919354 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 170/388] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:21 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:21.932491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88a16c35-a44d-4d0b-b29a-211823081923 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:21.964479 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88a16c35-a44d-4d0b-b29a-211823081923 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043688 Oct 04 17:49:21.980541 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 171/389] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:21.991876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:21.992725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:21.999957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.000454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.000903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.001613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.002070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.002901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.065656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lazy-loading 'flavor' on Instance uuid a3caec25-7e5b-4b1a-b580-981e1d2699b2 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:22.206636 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7a8ec7dd-4ecd-49b5-8713-fc780caf6803 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2/action" status: 202 len: 0 microversion: 2.1 time: 0.218302 Oct 04 17:49:22.209517 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 172/390] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:49:21 2022] POST /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:22.216162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b807e9cb-2104-49e7-b894-8dc154666817 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:22.233413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b807e9cb-2104-49e7-b894-8dc154666817 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.234491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b807e9cb-2104-49e7-b894-8dc154666817 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.235182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b807e9cb-2104-49e7-b894-8dc154666817 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.486178 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b807e9cb-2104-49e7-b894-8dc154666817 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.274826 Oct 04 17:49:22.486799 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 173/391] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:22.504932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-43e2e66d-fae9-4a60-a4c7-5cd961c8799f tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-918011620", "id": 2091968936, "os-flavor-access:is_public": "False"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:22.554075 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-43e2e66d-fae9-4a60-a4c7-5cd961c8799f tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.063716 Oct 04 17:49:22.555263 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 174/392] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:22 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:22.569190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:22.570082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:22.585417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.587194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.587671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.588413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.588874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.589656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.760464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:22.760961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:22.761661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:22.762461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:22.763126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:22.782278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.783113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.783834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.784801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.785451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.786087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.809325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:22.816927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for user ee53a080f77a44f8aac80b34c1dd179e and project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:22.831845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:49:22.835022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:49:22.923187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c01d8948-9d02-4dc1-a73e-1838f01a4d86 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.865481 Oct 04 17:49:22.932832 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 219/393] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:49:22.945666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:22.946779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:22.954545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.955973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.957055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:22.958436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:22.959870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:22.960525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:23.287386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:23.298571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31c1513d-4b7c-465c-9b53-0416f235242e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1476 microversion: 2.1 time: 0.363232 Oct 04 17:49:23.312954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 220/394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:22 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1476 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:23.348388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e3b734e-40b5-445b-92be-7a923fe6ee84 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.419663 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e3b734e-40b5-445b-92be-7a923fe6ee84 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.098928 Oct 04 17:49:23.428172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 221/395] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:23 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:23.445754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-523a228e-adf2-4212-8cf7-b5c6717b9b0a tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.468849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:23.481058 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4e6eb374-84eb-49e8-b52f-8f782b21372f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.922741 Oct 04 17:49:23.482113 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 175/396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:22 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:23.487655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.488568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:23.530856 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-523a228e-adf2-4212-8cf7-b5c6717b9b0a tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/2091968936/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.097041 Oct 04 17:49:23.535222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 222/397] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 17:49:23 2022] GET /compute/v2.1/flavors/2091968936/os-flavor-access => generated 21 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:23.547657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49dffd54-3ed8-4ca7-bf49-b519796c0154 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1901029209"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:23.558462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-49dffd54-3ed8-4ca7-bf49-b519796c0154 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Generated uuid 40aa0a89-f754-4bb0-b8a3-848caf33a630 for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:23.598518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:23.617061 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49dffd54-3ed8-4ca7-bf49-b519796c0154 tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074491 Oct 04 17:49:23.622066 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 223/398] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:23.645914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74124b54-3ac7-457f-8569-a152c44ae1d9 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.676560 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74124b54-3ac7-457f-8569-a152c44ae1d9 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2091968936" status: 202 len: 0 microversion: 2.1 time: 0.052617 Oct 04 17:49:23.677935 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 224/399] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:23 2022] DELETE /compute/v2.1/flavors/2091968936 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:23.687502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:23.705383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:23.717133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:23.717821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:23.719059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:23.740948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:23.744981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:23.745886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:23.746357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:23.750727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:23.756076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:23.763314 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3b0e463-7d6f-48eb-8076-dcc7dcc14c51 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1261 microversion: 2.25 time: 0.275477 Oct 04 17:49:23.764669 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 176/400] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:23 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1261 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:23.770327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-23b64082-9162-4d62-a70b-3857a50e2d50 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.790400 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.compute.aggregates [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 17:49:23.790948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Request method failure captured: Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 42 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIZpocxKFWTaCHp6FFFJahLN_7X4bdbD8pHCk_iijHc07goUj6gf7OlPVJRNTL0QvGmxPIdrtcPLrBpuoHMOwL6ZbVlLry08HfvfasQowKdI9S57uBM0TI-7KH3i6TQafKFUe435FT6slbqYL7sv0DIao90nuv3-QeEnTY63hd61Aw Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:23.793682 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_021542703097414992d8af6dc9c60b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/021542703097414992d8af6dc9c60b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/021542703097414992d8af6dc9c60b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 021542703097414992d8af6dc9c60b59 Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288 Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 14e489504d9c44ae9d867830e028b651 Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: {"remove_host": {"host": "nonexist_host"}} Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:23.795685 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 17:49:23.796489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 17:49:23.798950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.801428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8011d1f-97db-4f3f-a674-45efcdde191e tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.123227 Oct 04 17:49:23.808638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 225/401] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 17:49:23 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:23.813822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1aa3c0b7-eb93-435f-906c-dc36f76e61cd tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:23.822779 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-23b64082-9162-4d62-a70b-3857a50e2d50 tempest-FlavorsAccessTestJSON-1819173158 tempest-FlavorsAccessTestJSON-1819173158-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055995 Oct 04 17:49:23.840501 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 177/402] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:23.897381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1aa3c0b7-eb93-435f-906c-dc36f76e61cd tempest-AggregatesAdminNegativeTestJSON-1736622288 tempest-AggregatesAdminNegativeTestJSON-1736622288-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.088847 Oct 04 17:49:23.898961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 226/403] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 17:49:24.324431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:24.325709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:24.333831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:24.334910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:24.336166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:24.337095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:24.337756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:24.338542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:24.766950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:24.777585 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b2598d8d-7eba-4240-8300-dd04524af359 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1459 microversion: 2.1 time: 0.458257 Oct 04 17:49:24.778856 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 178/404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:24 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1459 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:24.787389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:24.788575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:24.819600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:24.821766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:24.825186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:24.828841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:24.830460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:24.832513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.411234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Calling method '.version_select at 0x7f6342021d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:25.414712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.415607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.417176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.479717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.480820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.481767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.522696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.523588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.524278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.542190 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6be154ba-c70a-4f84-b120-4ef762aa3db6 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.097778 Oct 04 17:49:25.558107 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 227/405] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:25.567270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:25.568192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:25.578379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.579526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.580429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.581516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.582216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.582883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.657460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:25.673512 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4747770-3307-4e90-bd7d-5fc4cebd4015 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.890244 Oct 04 17:49:25.684598 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 179/406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:24 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:25.702796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:25.704093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:25.711898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.713163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.713930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.714922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.715826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.716485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.806923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:25.818841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:25.827659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:25.829954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-081dba4c-e6eb-4cdc-9ff8-4037292cd0b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1319 microversion: 2.25 time: 0.269968 Oct 04 17:49:25.850788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 228/407] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:25 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:25.857456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Calling method '.version_select at 0x7f6342016160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:25.859739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.861452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.862339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.892665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.894609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.897591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.956615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:25.959707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:25.960837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:25.976375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf10a6d5-efd0-4542-b9bc-987c78e0bee0 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-831193-17/servers" status: 200 len: 276 microversion: 2.1 time: 0.124047 Oct 04 17:49:25.977569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 229/408] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 17:49:25 2022] GET /compute/v2.1/os-hypervisors/n-h2-831193-17/servers => generated 276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:26.005627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Calling method '.version_select at 0x7f63422155e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.012077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.013512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.014692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.044383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.044796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.045854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.062202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.062717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.063768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.100878 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65cd73da-eefb-4c8b-b92c-e17ecac97e2b tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.107791 Oct 04 17:49:26.101687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 230/409] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:26.125675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Calling method '.version_select at 0x7f634255de50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.126828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.132672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.134741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.179603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.183498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.183914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.216470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b25c669-247e-4da8-b6fd-9bedc293b9a4 tempest-HypervisorAdminUnderV252Test-1094481852 tempest-HypervisorAdminUnderV252Test-1094481852-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-831193-17/search" status: 200 len: 105 microversion: 2.1 time: 0.104492 Oct 04 17:49:26.221748 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 231/410] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-831193-17/search => generated 105 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:26.672423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7b530f50-7210-4476-9cdc-9aef77e9c38e tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1612 microversion: 2.1 time: 0.986625 Oct 04 17:49:26.673032 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 180/411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:25 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1612 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:26.702219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.707752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.708373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:26.711909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.712799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.715852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.719278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.719797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.720197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.726986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.727778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.733313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.734313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.734993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.735659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.784515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9cad50cb-3d19-4e39-817d-05bc53ce0adb tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.090771 Oct 04 17:49:26.785956 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 232/412] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:26.805966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831193-17", "block_migration": true, "disk_over_commit": false}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:26.820864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:26.833273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.834377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.835180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.836510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.837402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.838224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.949979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Lazy-loading 'flavor' on Instance uuid a3caec25-7e5b-4b1a-b580-981e1d2699b2 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:27.062594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 while it is in vm_state suspended Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Request method failure captured: Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2/action HTTP/1.1 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 98 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH6LkLphatupTZr_VUKfm3e_LQA19uJGQ6Z7outfuImqESq6JvayeutxDm-zyZt86Ix9Z6-H5l2WxNLgybiNsjO0YRYu-TL-vkZuSrpjWcuS-61fA6ak4kcEq5uW3-RF0ch3X0lfjlgvwU6HRbx3HfE3VS9tyMfEaIZQsL8WVVH1UI Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: e16dae9f6bf94ed9919225dcde2c82c9 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:27.068674 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e16dae9f6bf94ed9919225dcde2c82c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: e16dae9f6bf94ed9919225dcde2c82c9 Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-820259963 Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationNegativeTest-820259963-project-admin Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 43cfb97dbd4847c4a9911b7e0f2fdd59 Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationNegativeTest-820259963-project-admin Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: {"os-migrateLive": {"host": "n-h1-831193-17", "block_migration": true, "disk_over_commit": false}} Oct 04 17:49:27.069987 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'os-migrateLive' instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 while it is in vm_state suspended Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a3caec25-7e5b-4b1a-b580-981e1d2699b2', 'body': {'os-migrateLive': {'host': 'n-h1-831193-17', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 17:49:27.070659 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:27.071873 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 while it is in vm_state suspended Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 while it is in vm_state suspended Oct 04 17:49:27.072978 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:27.076329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 while it is in vm_state suspended {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:27.076329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3efc2ff6-4e7e-4d83-826b-8e0d6d1277d5 tempest-LiveMigrationNegativeTest-820259963 tempest-LiveMigrationNegativeTest-820259963-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2/action" status: 409 len: 155 microversion: 2.1 time: 0.277092 Oct 04 17:49:27.076329 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 233/413] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:49:26 2022] POST /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2/action => generated 155 bytes in 280 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:27.080533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.081505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:27.095020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.096313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.096776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.097671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.098141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.098571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.152765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:27.188896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-451471af-3baa-4961-95e2-fb783dadba60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.493338 Oct 04 17:49:27.189497 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 181/414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:27.204130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.205215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:27.211983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.213152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.213936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.215047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.215806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.216321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:27.216737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.227900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:27.230223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:27.231440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b3cb1357-d43b-4d1d-beea-a72aa53af91f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1319 microversion: 2.25 time: 0.157148 Oct 04 17:49:27.232901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 234/415] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:27.259468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:49:27.557681 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-05351fa9-f7bc-4a22-84d8-70e3d8839919 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 204 len: 0 microversion: 2.1 time: 0.365910 Oct 04 17:49:27.565050 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 182/416] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:27 2022] DELETE /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:27.570137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.570762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:27.584620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.585165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.585619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.586376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.586841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.587302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.879262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:27.892316 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf84ee9b-096b-43f2-9364-b1e67f4c96c6 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1465 microversion: 2.1 time: 0.325590 Oct 04 17:49:27.895247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 235/417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1465 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.223612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.225356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:28.237178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.238013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.238598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.239558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.240359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.241508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.258247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.259290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:28.273008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.287391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.287960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.288727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.289203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.289634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.674172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:28.688943 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a395697a-1073-4311-ba20-455bd8aaee98 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.471404 Oct 04 17:49:28.689595 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 183/418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.735247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:28.751000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:28.753952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:28.755557 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a45023f-7f3c-460d-aa43-ab5db3c8b7e4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.501291 Oct 04 17:49:28.758598 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 236/419] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:28.924254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.925179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:28.938347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.940125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.940744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.943848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.944485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.945060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.714156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.715422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:29.723775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.724563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.725130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.725999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.726688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.727396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:30.026314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.028396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.039643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-02646b86-54de-4fe2-aaa4-ccac28a7ffe2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.329932 Oct 04 17:49:30.042798 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22d8147b-a49a-4d49-a44b-583bcc23e915 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1465 microversion: 2.1 time: 1.124901 Oct 04 17:49:30.047712 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 184/420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1465 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.056652 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 237/421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.061332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.061952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:30.085809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:30.086453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:30.089967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:30.090459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:30.090582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:30.092456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:30.546603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.562361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.564914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.567489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d38faa07-0209-4806-bd45-3b9f75fb4010 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.516492 Oct 04 17:49:30.591470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 238/422] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:31.043417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2152578d-d896-4038-9f23-29b08bd0c0ea", "tag": "084175da-5b7e-4e5f-a3bd-c2e86da78a78"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:31.076290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.076781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.077233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.127256 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] Creating event network-changed:084175da-5b7e-4e5f-a3bd-c2e86da78a78 for instance 2152578d-d896-4038-9f23-29b08bd0c0ea on n-h1-831193-17 Oct 04 17:49:31.141421 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eabf37f2-cd84-4302-9c12-61265d6a9994 req-790ee19d-8861-4277-b69f-5cfea5a7f43a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101936 Oct 04 17:49:31.142596 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 239/423] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:31.148250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb5e1275-6c16-40e9-b50d-e8f5768f35ed tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-474504220", "ram": 512, "vcpus": 1, "disk": 10, "id": 127516629, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:31.148845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.155422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:31.178858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb5e1275-6c16-40e9-b50d-e8f5768f35ed tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.705513 Oct 04 17:49:31.179495 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 185/424] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/flavors => generated 412 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:31.189985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.190506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.190946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.191973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.192428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.192852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.200542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.201846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:31.217910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.220721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.221430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.224574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.226357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.229018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.463300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:31.507136 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e298cc5a-0406-4327-87eb-6078ba3d2ead tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 200 len: 1423 microversion: 2.1 time: 0.317184 Oct 04 17:49:31.511907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 186/425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:31 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 1423 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:31.537630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:31.554088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06be496c-f7e3-4986-8070-2109eeb581cf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.408175 Oct 04 17:49:31.556623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 240/426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:31 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:31.596228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.597412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:31.606281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.612471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.614257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.616428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.617164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.618996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.926962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:31.948674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:31.952601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:31.956327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-532531ca-dc1c-4372-9647-7e49475ff3ea tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.365436 Oct 04 17:49:31.959411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 241/427] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:31 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:31.998820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96bfc7ed-fbc7-4544-b56c-b716e3603be4 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.019537 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-96bfc7ed-fbc7-4544-b56c-b716e3603be4 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] HTTP exception thrown: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96bfc7ed-fbc7-4544-b56c-b716e3603be4 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Request method failure captured: Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIokf-UmMt80sQpvBhODdHOgYVBbYosos9od6xkTBZQSpYtapXXhRp4-9WgWc5REy8cN_x13vIE0DfK0NbcPxBFSLEuUiZSrN4ilmEQJYpEJfG_e7Pj3w1u5ILiEvU5K7YI5UyXxQH3vYQfkuRhLr5wYJkfV-2OkNPnuhzQCS_QIIo Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:32.027103 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8789cfd74f3f43069540fe2be46819b3 Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:32.030125 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'flavor_id': '127516629', 'id': 'hw:cpu_thread_policy'} Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.032050 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.033719 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.037320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96bfc7ed-fbc7-4544-b56c-b716e3603be4 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Returning 404 to user: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.039737 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-96bfc7ed-fbc7-4544-b56c-b716e3603be4 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] 10.222.0.33 "GET /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.526795 Oct 04 17:49:32.042110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 187/428] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:49:31 2022] GET /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 530 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:32.056212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3265bf2-7e12-40b7-b28d-b3e8de91cbf0 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.062200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3265bf2-7e12-40b7-b28d-b3e8de91cbf0 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8789cfd74f3f43069540fe2be46819b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7a019d48974ebfb64bd4a8dd321b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3265bf2-7e12-40b7-b28d-b3e8de91cbf0 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Request method failure captured: Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/flavors/127516629/os-extra_specs HTTP/1.1 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 66 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIokf-UmMt80sQpvBhODdHOgYVBbYosos9od6xkTBZQSpYtapXXhRp4-9WgWc5REy8cN_x13vIE0DfK0NbcPxBFSLEuUiZSrN4ilmEQJYpEJfG_e7Pj3w1u5ILiEvU5K7YI5UyXxQH3vYQfkuRhLr5wYJkfV-2OkNPnuhzQCS_QIIo Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:32.067604 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8789cfd74f3f43069540fe2be46819b3 Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 17:49:32.069009 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'flavor_id': '127516629', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:32.069660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:49:32.070854 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.072458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3265bf2-7e12-40b7-b28d-b3e8de91cbf0 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.072744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3265bf2-7e12-40b7-b28d-b3e8de91cbf0 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] 10.222.0.33 "POST /compute/v2.1/flavors/127516629/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019551 Oct 04 17:49:32.074425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 242/429] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:49:32 2022] POST /compute/v2.1/flavors/127516629/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:32.085114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7066aac8-59f3-459c-8965-1acdf6d23cd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.186580 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7066aac8-59f3-459c-8965-1acdf6d23cd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/127516629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106250 Oct 04 17:49:32.188270 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 188/430] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:49:32 2022] POST /compute/v2.1/flavors/127516629/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:32.203229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5f1f6cf-82f9-4eda-bf66-4e5faa406323 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.208660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5f1f6cf-82f9-4eda-bf66-4e5faa406323 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8789cfd74f3f43069540fe2be46819b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7a019d48974ebfb64bd4a8dd321b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5f1f6cf-82f9-4eda-bf66-4e5faa406323 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Request method failure captured: Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIokf-UmMt80sQpvBhODdHOgYVBbYosos9od6xkTBZQSpYtapXXhRp4-9WgWc5REy8cN_x13vIE0DfK0NbcPxBFSLEuUiZSrN4ilmEQJYpEJfG_e7Pj3w1u5ILiEvU5K7YI5UyXxQH3vYQfkuRhLr5wYJkfV-2OkNPnuhzQCS_QIIo Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:32.213055 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8789cfd74f3f43069540fe2be46819b3 Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:32.214392 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'flavor_id': '127516629', 'id': 'hw:numa_nodes'} Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:32.215461 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:49:32.217739 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.221965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5f1f6cf-82f9-4eda-bf66-4e5faa406323 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.222964 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5f1f6cf-82f9-4eda-bf66-4e5faa406323 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028483 Oct 04 17:49:32.226172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 243/431] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 17:49:32 2022] DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:32.241566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3ed4959-b541-42ed-88ea-a212062f16f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.264195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:32.285514 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3ed4959-b541-42ed-88ea-a212062f16f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/127516629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050972 Oct 04 17:49:32.285514 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 189/432] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:49:32 2022] POST /compute/v2.1/flavors/127516629/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:32.298526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2f0b49-5237-4db0-9487-da4c6b2c1c68 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.302171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a2f0b49-5237-4db0-9487-da4c6b2c1c68 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8789cfd74f3f43069540fe2be46819b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7a019d48974ebfb64bd4a8dd321b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2f0b49-5237-4db0-9487-da4c6b2c1c68 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Request method failure captured: Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 22 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIokf-UmMt80sQpvBhODdHOgYVBbYosos9od6xkTBZQSpYtapXXhRp4-9WgWc5REy8cN_x13vIE0DfK0NbcPxBFSLEuUiZSrN4ilmEQJYpEJfG_e7Pj3w1u5ILiEvU5K7YI5UyXxQH3vYQfkuRhLr5wYJkfV-2OkNPnuhzQCS_QIIo Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:32.305704 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c7a019d48974ebfb64bd4a8dd321b64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3c7a019d48974ebfb64bd4a8dd321b64 Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8789cfd74f3f43069540fe2be46819b3 Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: {"hw:numa_nodes": "1"} Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:32.307401 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'flavor_id': '127516629', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:32.308342 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:49:32.309577 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.311868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2f0b49-5237-4db0-9487-da4c6b2c1c68 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.316831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a2f0b49-5237-4db0-9487-da4c6b2c1c68 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326 tempest-FlavorsExtraSpecsNegativeTestJSON-2042194326-project] 10.222.0.33 "PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024473 Oct 04 17:49:32.321958 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 244/433] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:32 2022] PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:32.326893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c49dbbb7-60ef-49c9-a054-123cc9783897 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.337168 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-c49dbbb7-60ef-49c9-a054-123cc9783897 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] HTTP exception thrown: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c49dbbb7-60ef-49c9-a054-123cc9783897 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Request method failure captured: Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIqdwy6gqb4nlHHB7bMa_1tBxHASV7Qyjgn_ulbyLN-7ynAmAo9DqPoXJFwfDHJQlybebOqWS7H22kB9ehiEugOFy5QTLBCk9aRZGSi4lUo8R7_F9BJlGcz1iY2XM_GkVN3rLrMgWCebwAoN-fNK5oA_Tr7sltLTNfJfBYPAJ9-MuI Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:32.338993 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1b912b9773a44be4929b959779717904 Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:32.340320 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'flavor_id': '127516629', 'id': 'hw:cpu_thread_policy'} Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.340932 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:49:32.343270 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.345689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c49dbbb7-60ef-49c9-a054-123cc9783897 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Returning 404 to user: Flavor 127516629 has no extra specs with key hw:cpu_thread_policy. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.348468 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c49dbbb7-60ef-49c9-a054-123cc9783897 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.025362 Oct 04 17:49:32.349667 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 190/434] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 17:49:32 2022] DELETE /compute/v2.1/flavors/127516629/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:32.360071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f837619-18d8-4e4f-a766-068d27ae54b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.365213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5f837619-18d8-4e4f-a766-068d27ae54b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f837619-18d8-4e4f-a766-068d27ae54b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Request method failure captured: Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 27 Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIqdwy6gqb4nlHHB7bMa_1tBxHASV7Qyjgn_ulbyLN-7ynAmAo9DqPoXJFwfDHJQlybebOqWS7H22kB9ehiEugOFy5QTLBCk9aRZGSi4lUo8R7_F9BJlGcz1iY2XM_GkVN3rLrMgWCebwAoN-fNK5oA_Tr7sltLTNfJfBYPAJ9-MuI Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:32.377226 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1b912b9773a44be4929b959779717904 Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: {"hw:cpu_policy": "shared"} Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:32.379050 n-d-831193-17 devstack@n-api.service[128770]: exception: Request body and URI mismatch Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'flavor_id': '127516629', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.380022 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f837619-18d8-4e4f-a766-068d27ae54b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f837619-18d8-4e4f-a766-068d27ae54b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015725 Oct 04 17:49:32.381364 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 245/435] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:32 2022] PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:49:32.385255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86ec6140-4bc3-40f4-ad1e-86a62b9ef432 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86ec6140-4bc3-40f4-ad1e-86a62b9ef432 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Request method failure captured: Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 49 Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIqdwy6gqb4nlHHB7bMa_1tBxHASV7Qyjgn_ulbyLN-7ynAmAo9DqPoXJFwfDHJQlybebOqWS7H22kB9ehiEugOFy5QTLBCk9aRZGSi4lUo8R7_F9BJlGcz1iY2XM_GkVN3rLrMgWCebwAoN-fNK5oA_Tr7sltLTNfJfBYPAJ9-MuI Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:49:32.394691 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6919bd153c864b96bbf07b6b6427db7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 6919bd153c864b96bbf07b6b6427db7e Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1b912b9773a44be4929b959779717904 Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 17:49:32.396219 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'flavor_id': '127516629', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 17:49:32.396973 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.403864 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86ec6140-4bc3-40f4-ad1e-86a62b9ef432 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-86ec6140-4bc3-40f4-ad1e-86a62b9ef432 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.023327 Oct 04 17:49:32.408137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 191/436] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:32 2022] PUT /compute/v2.1/flavors/127516629/os-extra_specs/hw:numa_nodes => generated 117 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:32.411930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7335a28d-6142-4246-b574-b8820b4f8e82 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.453208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7335a28d-6142-4246-b574-b8820b4f8e82 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/127516629" status: 202 len: 0 microversion: 2.1 time: 0.046053 Oct 04 17:49:32.454886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 246/437] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:32 2022] DELETE /compute/v2.1/flavors/127516629 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:32.470093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8536e6a7-fff6-4c36-b292-45627d8ce1ea tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.537184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.538069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: a3caec25-7e5b-4b1a-b580-981e1d2699b2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:32.549892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8536e6a7-fff6-4c36-b292-45627d8ce1ea tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051 tempest-FlavorsExtraSpecsNegativeTestJSON-1070492051-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084615 Oct 04 17:49:32.551539 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 192/438] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:32.554627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.555191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.555631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.556341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.557038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.557629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.584221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.586524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:32.606169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] HTTP exception thrown: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. Oct 04 17:49:32.607770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.608507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.609163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.610081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Request method failure captured: Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 HTTP/1.1 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH38OyNlgWGJiyEVM9o0pYkDJSnNaeqE3s2t-NWm6_6yMouGEiX_nb3XZl_Rs7Y9FLm3U38vgMqsVBSe830ypO3U6tZSSM-AruVIKAMb-dZ87VXcbSyM0dQ78cmVKpkbdLD_SK0K5-56k7E-03WqxV4pAdvTfQTJ-tOdaJNXZwh1uw Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 85499581bca640ddb0fb10c480694095 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:32.610460 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85499581bca640ddb0fb10c480694095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85499581bca640ddb0fb10c480694095"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85499581bca640ddb0fb10c480694095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85499581bca640ddb0fb10c480694095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 85499581bca640ddb0fb10c480694095 Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationNegativeTest-786955692-project Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 430b4885dd62404fbb1ba382c7a86d3a Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationNegativeTest-786955692-project Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. Oct 04 17:49:32.611675 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a3caec25-7e5b-4b1a-b580-981e1d2699b2'} Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:32.612352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. Oct 04 17:49:32.613936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:32.615945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.616202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Returning 404 to user: Instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:32.617076 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3590e2a8-6f53-43ab-be68-d5bffa9c379e tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2" status: 404 len: 111 microversion: 2.1 time: 0.086675 Oct 04 17:49:32.618132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.623991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 247/439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:32 2022] GET /compute/v2.1/servers/a3caec25-7e5b-4b1a-b580-981e1d2699b2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:49:32.632077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.636554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:32.650675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.651490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.652193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.653109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.653710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.654848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.698674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:49:32.796352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:32.828900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:32.871108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-652c1995-6ed4-489a-8e5e-110cdcdd45e7 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 204 len: 0 microversion: 2.1 time: 0.245157 Oct 04 17:49:32.872173 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 248/440] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:32 2022] DELETE /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:32.891010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.898249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:32.910161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.911610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.914927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.916800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:32.917894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:32.918691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:33.014540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.023468 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94efe8a3-2aa1-4b7f-a052-8652057c072d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.444785 Oct 04 17:49:33.024383 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 193/441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:32 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:33.034220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:33.034867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:33.049186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:33.049806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:33.050316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:33.059988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:33.062078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:33.063274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:33.121819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:33.229154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.249460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-36a2e1e3-0c13-4c81-807f-1262f3038754 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1474 microversion: 2.1 time: 0.366850 Oct 04 17:49:33.269827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 249/442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:32 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:33.285768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caec25-7e5b-4b1a-b580-981e1d2699b2", "name": "network-vif-deleted", "tag": "b399f855-a2c4-4cd4-b71d-4fa863a49109"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.304418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:33.305918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:33.306624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:33.338611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] Creating event network-vif-deleted:b399f855-a2c4-4cd4-b71d-4fa863a49109 for instance a3caec25-7e5b-4b1a-b580-981e1d2699b2 on n-h2-831193-17 Oct 04 17:49:33.346301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4105d994-3dab-41d6-9949-00b3804bd565 req-7ab39176-033d-4344-bab1-86b7d3db31e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074151 Oct 04 17:49:33.347709 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 250/443] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:33.664164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.679748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.681277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.687770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-899660bc-fd1e-4fa2-bbe8-d84e214c1d3a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.653726 Oct 04 17:49:33.688999 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 194/444] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:33 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:33.918916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b99e1390-9871-4ec6-9691-b82343c732a6 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-651249588", "id": 1923044770, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.952938 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b99e1390-9871-4ec6-9691-b82343c732a6 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.505949 Oct 04 17:49:33.953995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 251/445] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:49:33 2022] POST /compute/v2.1/flavors => generated 448 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:33.979160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:34.067238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.067994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:34.084147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.084672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.085127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.085879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.086345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.089624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.444671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94bfda86-0f15-4295-80a7-760a4b31a5f8 tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.459647 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94bfda86-0f15-4295-80a7-760a4b31a5f8 tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] 10.222.0.33 "GET /compute/v2.1/flavors/1923044770" status: 200 len: 448 microversion: 2.55 time: 0.487610 Oct 04 17:49:34.465136 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 195/446] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Oct 4 17:49:33 2022] GET /compute/v2.1/flavors/1923044770 => generated 448 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:49:34.471241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.480853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:34.490324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.491244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.491835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.492865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.493530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.494115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.508685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 04 17:49:34.521412 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: ERROR sqlalchemy.pool.impl.QueuePool Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: Exception ignored in: . at 0x7f634213f0d0> Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: Traceback (most recent call last): Oct 04 17:49:34.522652 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 04 17:49:34.536433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9f6a97b-a1f6-4f09-85ba-92f443b4b472 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.460660 Oct 04 17:49:34.536531 n-d-831193-17 devstack@n-api.service[128771]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 04 17:49:34.536531 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 04 17:49:34.536730 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 252/447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: connection_record.checkin() Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: pool.dispatch.checkin(connection, self) Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: fn(*args, **kw) Oct 04 17:49:34.536815 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 04 17:49:34.537338 n-d-831193-17 devstack@n-api.service[128771]: time.sleep(0) Oct 04 17:49:34.537338 n-d-831193-17 devstack@n-api.service[128771]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 04 17:49:34.540837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4a2ee24-b680-436e-89db-8c94836ac1f1 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] Action: 'update', calling method: .version_select at 0x7f63438e1a60>, body: {"flavor": {"description": "new"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:34.544489 n-d-831193-17 devstack@n-api.service[128771]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 04 17:49:34.544854 n-d-831193-17 devstack@n-api.service[128771]: AssertionError: do not call blocking functions from the mainloop Oct 04 17:49:34.629962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4a2ee24-b680-436e-89db-8c94836ac1f1 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1923044770" status: 200 len: 449 microversion: 2.55 time: 0.105863 Oct 04 17:49:34.636483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 253/448] 10.222.0.33 () {62 vars in 1219 bytes} [Tue Oct 4 17:49:34 2022] PUT /compute/v2.1/flavors/1923044770 => generated 449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:34.650995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-451358f0-e23c-46ea-9b1e-1fa2beb8036b tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.685182 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-451358f0-e23c-46ea-9b1e-1fa2beb8036b tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.039531 Oct 04 17:49:34.687058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 254/449] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:49:34.716781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31b4e9e0-991a-42aa-ba90-8639b81492ff tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.767324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31b4e9e0-991a-42aa-ba90-8639b81492ff tempest-FlavorsV255TestJSON-813679048 tempest-FlavorsV255TestJSON-813679048-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.056230 Oct 04 17:49:34.768562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 255/450] 10.222.0.33 () {60 vars in 1166 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:34.773922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.775048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:34.788372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.789229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.789855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.791249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.791903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.792577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.013123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:35.024974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:35.027324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:35.028555 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8c14181-bed5-4280-b503-7d54f19f76d3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.258816 Oct 04 17:49:35.055227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 256/451] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:35.061470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10cd1206-adad-4f24-a901-1459aed0a523 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.069566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=87,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:35.088138 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10cd1206-adad-4f24-a901-1459aed0a523 tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1923044770" status: 202 len: 0 microversion: 2.55 time: 0.030547 Oct 04 17:49:35.092574 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 257/452] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 17:49:35 2022] DELETE /compute/v2.1/flavors/1923044770 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:35.253688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48da7b41-7a86-4138-9aaf-eb2ed747122a tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] Calling method '.version_select at 0x7f634255da60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.585651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48da7b41-7a86-4138-9aaf-eb2ed747122a tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 5386 microversion: 2.1 time: 0.495377 Oct 04 17:49:35.586798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 258/453] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/os-networks => generated 5386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:35.592785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-617f270a-5356-4724-9cbf-c38840aa772c tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.608581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:35.624042 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e6ffe730-191e-4501-aec1-4e3886dca309 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1474 microversion: 2.1 time: 1.155224 Oct 04 17:49:35.627752 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 196/454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1474 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:35.640496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.641359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:35.656945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.660489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.660921 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-617f270a-5356-4724-9cbf-c38840aa772c tempest-FlavorsV255TestJSON-428670039 tempest-FlavorsV255TestJSON-428670039-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.072653 Oct 04 17:49:35.662444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 259/455] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:35.663129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.664423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.664911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.666712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.668823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6875b52-41fd-4211-b158-e903ee32bcb5 tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] Calling method '.version_select at 0x7f6341f60430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.880605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6875b52-41fd-4211-b158-e903ee32bcb5 tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/e82663ac-0786-4ba6-8aef-a44f9e2d8a12" status: 200 len: 652 microversion: 2.1 time: 0.216337 Oct 04 17:49:35.882070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 260/456] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/os-networks/e82663ac-0786-4ba6-8aef-a44f9e2d8a12 => generated 652 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:35.894688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca33cb61-4d94-4c9a-a0be-7dc600a91c51 tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] Calling method '.version_select at 0x7f634255d820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:36.160026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca33cb61-4d94-4c9a-a0be-7dc600a91c51 tempest-NetworksTest-1291408395 tempest-NetworksTest-1291408395-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 5386 microversion: 2.1 time: 0.272640 Oct 04 17:49:36.160775 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 261/457] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/os-networks => generated 5386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:36.166402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:36.167361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:36.176299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:36.177227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:36.177861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.178903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:36.179847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:36.180612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.207447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.217984 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c636b4d0-e8ce-4fbe-b969-ded58f62c4ac tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.588493 Oct 04 17:49:36.218593 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 197/458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:36.394071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.415905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.420127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.422196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-700e03d4-4a7a-4adc-8dbe-f49de59373b2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.260295 Oct 04 17:49:36.424199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 262/459] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:36 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:36.657824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:36.658434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:36.673222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:36.673740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:36.674194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.679931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:36.680459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:36.681051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.836019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '430b4885dd62404fbb1ba382c7a86d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85499581bca640ddb0fb10c480694095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.852719 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-27642b3e-f73a-4351-8482-e1c95bc086e4 tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 200 len: 1432 microversion: 2.1 time: 0.198684 Oct 04 17:49:36.867596 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 198/460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:36 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 1432 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:36.896681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5", "name": "network-vif-deleted", "tag": "90d06051-e51c-4447-98d6-0992b41c0a4f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:36.910840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:36.951404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:36.952671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:36.954624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.988655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] Creating event network-vif-deleted:90d06051-e51c-4447-98d6-0992b41c0a4f for instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 on n-h2-831193-17 Oct 04 17:49:37.002352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2922881c-ba9a-4118-9a34-9ee009217a21 req-4f7c0d1a-0a54-4e6a-9e92-7997a75fe434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109555 Oct 04 17:49:37.015151 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 263/461] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:37.245836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:37.246462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:37.273336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.273858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.274303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:37.275047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.275520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.275952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:37.452451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:37.453338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:37.464273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.470060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.471990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:37.472958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.474739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.475380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.123737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:38.139889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:38.148818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:38.157190 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb562304-9e5f-4f70-aa0f-6d538fb06a98 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.711161 Oct 04 17:49:38.161429 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 264/462] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:37 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:49:38.170389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:38.179574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] [instance: 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:38.209390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.213537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.214312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.216445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.221281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.225451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.245406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] HTTP exception thrown: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Request method failure captured: Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 HTTP/1.1 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH38OyNlgWGJiyEVM9o0pYkDJSnNaeqE3s2t-NWm6_6yMouGEiX_nb3XZl_Rs7Y9FLm3U38vgMqsVBSe830ypO3U6tZSSM-AruVIKAMb-dZ87VXcbSyM0dQ78cmVKpkbdLD_SK0K5-56k7E-03WqxV4pAdvTfQTJ-tOdaJNXZwh1uw Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 85499581bca640ddb0fb10c480694095 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:38.248696 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85499581bca640ddb0fb10c480694095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85499581bca640ddb0fb10c480694095"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85499581bca640ddb0fb10c480694095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85499581bca640ddb0fb10c480694095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 85499581bca640ddb0fb10c480694095 Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-786955692 Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationNegativeTest-786955692-project Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 430b4885dd62404fbb1ba382c7a86d3a Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationNegativeTest-786955692-project Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. Oct 04 17:49:38.250009 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5'} Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:38.250717 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. Oct 04 17:49:38.251981 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.255283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] Returning 404 to user: Instance 3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:38.257127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04ad7e00-79ab-4c09-a6ff-5213f437919d tempest-LiveMigrationNegativeTest-786955692 tempest-LiveMigrationNegativeTest-786955692-project] 10.222.0.33 "GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5" status: 404 len: 111 microversion: 2.1 time: 0.093732 Oct 04 17:49:38.261487 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 265/463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:38 2022] GET /compute/v2.1/servers/3e9b0dfa-d64e-468c-bfaf-9b9df4a1efc5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:38.268009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2152578d-d896-4038-9f23-29b08bd0c0ea", "name": "network-vif-plugged", "status": "completed", "tag": "084175da-5b7e-4e5f-a3bd-c2e86da78a78"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:38.280147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.280791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.281639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.300575 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] Creating event network-vif-plugged:084175da-5b7e-4e5f-a3bd-c2e86da78a78 for instance 2152578d-d896-4038-9f23-29b08bd0c0ea on n-h1-831193-17 Oct 04 17:49:38.309728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e927c872-3217-4a99-9d3b-99f342f1b61c req-75950d92-926d-4d8f-8a8b-93e30acb6329 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046751 Oct 04 17:49:38.317423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 266/464] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:39.194163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:39.203069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:39.244905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.246479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.252383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.254162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.264679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.266728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.368965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:39.402189 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-538eb77c-a6d5-43f7-9967-586cc4ed97b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 2.160314 Oct 04 17:49:39.415844 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 199/465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:37 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:40.444949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:40.456869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:40.488525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.490612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.491409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:40.495144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.496031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.496766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:40.852944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:40.897444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:40.900368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:40.923810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10fc023b-3f76-4a0b-b523-d385facf76eb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 1.715480 Oct 04 17:49:40.929881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 267/466] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:39 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:49:41.126548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:41.141961 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c5a6e18-4fde-48ff-8620-d501cf82def0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 0.698153 Oct 04 17:49:41.147989 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 200/467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:40 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:41.977217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:41.983061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:41.994488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:41.999884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.005453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.010014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.015226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.015791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.535556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:42.551698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:42.561144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:42.565360 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-304428b0-7903-4a3a-a56a-53e2f5d18221 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1361 microversion: 2.25 time: 0.595360 Oct 04 17:49:42.580554 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 201/468] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:41 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1361 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:49:42.604695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:42.610468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:42.639758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.645575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.646049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.646812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.647313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.647746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.880540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Calling method '.version_select at 0x7f634222c700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:42.882623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.882984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.883446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.926085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.926085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.926085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.955154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.955728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.956490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.975551 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b3eeaaa-8574-4b7f-b8bc-16c25592a6b1 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 1.282847 Oct 04 17:49:42.985319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 268/469] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 17:49:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:42.992147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Calling method '.version_select at 0x7f634222c040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:42.994388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.995273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.996140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.018302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.019332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.019991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.028526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73ec6e0c-e0d3-4991-9a34-5d9a89df59a9 tempest-HypervisorAdminV228Test-1792705558 tempest-HypervisorAdminV228Test-1792705558-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.040052 Oct 04 17:49:43.030817 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 269/470] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 17:49:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:43.600284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:43.601112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:43.608716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.614318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.615004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.615933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.620431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.621194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.653305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:43.661938 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f83dc246-8010-4121-bcbe-b4d23dd563fc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1477 microversion: 2.1 time: 1.078140 Oct 04 17:49:43.674251 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 202/471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:42 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1477 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:43.869834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:43.897285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:43.900406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:43.902513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-351bd73f-5d9b-4d23-96ed-510b1c9b5c2d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1556 microversion: 2.25 time: 0.310832 Oct 04 17:49:43.924111 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 270/472] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:43 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1556 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:44.540806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.543318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:44.570854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.571448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.572047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:44.572995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.573457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.573885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:44.705187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.707133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:44.726032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.728667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.733346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:44.735930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.739155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.745395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.073452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:45.086587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-194c6046-bc5c-42cd-9793-777d605c76da tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1476 microversion: 2.1 time: 0.393217 Oct 04 17:49:45.108322 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 271/473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:45.525532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 2152578d-d896-4038-9f23-29b08bd0c0ea {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:45.630554 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e462a6ef-fa9e-4ffc-ba0a-0c4f0f78c627 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 2050 microversion: 2.25 time: 1.687956 Oct 04 17:49:45.632108 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 203/474] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:43 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 2050 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:45.661979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:45.666711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:45.679387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:45.684779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:45.686344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.689595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:45.690468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:45.692520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.896974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "name": "network-vif-unplugged", "status": "completed", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:45.947803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:45.948393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:45.949136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.002673 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Creating event network-vif-unplugged:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h2-831193-17 Oct 04 17:49:46.041336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:49:46.085852 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-772eb7c8-7fd1-4ff2-bd79-a9e78290841d req-c385860f-4a6b-4a24-944c-567e066a3e62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191528 Oct 04 17:49:46.089010 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 204/475] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:46.118076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:46.119569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:46.150167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.151651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.153188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.155886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.156540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.159986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.655077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 2152578d-d896-4038-9f23-29b08bd0c0ea {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:46.657834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:46.675881 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-09a2159d-dbb3-4cad-b3c3-25de0e70fa6d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1476 microversion: 2.1 time: 0.563950 Oct 04 17:49:46.677013 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 205/476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:46 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1476 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:46.778047 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d903c344-2b1d-4925-806c-7fc9d09a8f04 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 2050 microversion: 2.25 time: 1.118855 Oct 04 17:49:46.781859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 272/477] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:45 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 2050 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:46.814118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:46.818355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.818726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.819242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.819984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.820445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.820865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.865670 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cf197169-095c-4b70-8ef7-85e69dc7d826 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.059905 Oct 04 17:49:46.868869 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 206/478] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 17:49:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:46.884709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831193-17", "block_migration": "auto"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:46.889397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:46.903763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.904822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.907298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.909368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.911949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.912671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.948279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'flavor' on Instance uuid 2152578d-d896-4038-9f23-29b08bd0c0ea {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:49:46.965974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Going to try to live migrate instance to n-h2-831193-17 {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:49:47.743345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8aec17b1-4723-4c13-b8c6-53f61854d5f3 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Calling method '.version_select at 0x7f63422c7af0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:47.749382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8aec17b1-4723-4c13-b8c6-53f61854d5f3 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'bacb1dc8853f4683adc49806d020e4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d28c2e7d964b7d9b20b00e5b49aa7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8aec17b1-4723-4c13-b8c6-53f61854d5f3 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Request method failure captured: Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI4cJ-JBd3QZm8PKBJXVezb_jUOh7xArBi9phuxt4zLNg6ll_lrvQf55hjGs0Kz5GaWpKoJpUHLPPD5KwkUmPvoaGQ8NQwq_ob6_NF_rQIJtAVttRCp4TWqtGtivbsn910MgNSg5KGS_TqlMR13_TvetpvwZuQDStG8p-qYU0vF4D0 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:47.756787 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bacb1dc8853f4683adc49806d020e4b5 Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 17:49:47.759075 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:47.760540 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:49:47.762567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:47.767141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8aec17b1-4723-4c13-b8c6-53f61854d5f3 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:47.770959 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8aec17b1-4723-4c13-b8c6-53f61854d5f3 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.549226 Oct 04 17:49:47.771724 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 207/479] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 17:49:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 551 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:48.165399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-79e0c622-3925-49e8-9bc0-f7e06f36894b tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] Calling method '.version_select at 0x7f6342029790>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.215665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-79e0c622-3925-49e8-9bc0-f7e06f36894b tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.439902 Oct 04 17:49:48.220527 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 208/480] 10.222.0.33 () {60 vars in 1226 bytes} [Tue Oct 4 17:49:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:48.229968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.231375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:48.243443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.244237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.246285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.247412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.248767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.249679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.688122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:48.713557 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-574b0624-dd28-4d5c-bd39-b7e3765bce60 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1476 microversion: 2.1 time: 0.488100 Oct 04 17:49:48.714832 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 209/481] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:48 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1476 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:48.721949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2646e2c6-927e-4233-9db4-a04f5037d0ff tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Calling method '.version_select at 0x7f6342080310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.729815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2646e2c6-927e-4233-9db4-a04f5037d0ff tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'bacb1dc8853f4683adc49806d020e4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d28c2e7d964b7d9b20b00e5b49aa7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2646e2c6-927e-4233-9db4-a04f5037d0ff tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Request method failure captured: Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI4cJ-JBd3QZm8PKBJXVezb_jUOh7xArBi9phuxt4zLNg6ll_lrvQf55hjGs0Kz5GaWpKoJpUHLPPD5KwkUmPvoaGQ8NQwq_ob6_NF_rQIJtAVttRCp4TWqtGtivbsn910MgNSg5KGS_TqlMR13_TvetpvwZuQDStG8p-qYU0vF4D0 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:48.734948 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bacb1dc8853f4683adc49806d020e4b5 Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 17:49:48.736479 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:48.737350 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:49:48.738611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:48.749264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2646e2c6-927e-4233-9db4-a04f5037d0ff tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:48.750673 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2646e2c6-927e-4233-9db4-a04f5037d0ff tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034238 Oct 04 17:49:48.752637 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 210/482] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:48 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:48.764751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:48.792013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.800419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.800869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.849500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Creating event network-changed:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h2-831193-17 Oct 04 17:49:48.864682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:49:48.906525 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-059bc214-9061-4cec-a2d4-a5f60d3328ce req-fb229fa5-1a61-412c-baba-9a4eca316dfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151797 Oct 04 17:49:48.909072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 211/483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:48.924051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b740b782-04df-4bab-a1c9-e7c83eba17e4 tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f82940>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:49.453704 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b740b782-04df-4bab-a1c9-e7c83eba17e4 tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.538696 Oct 04 17:49:49.454539 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 212/484] 10.222.0.33 () {62 vars in 1247 bytes} [Tue Oct 4 17:49:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:49.463027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8d55b35-4672-4839-8d8f-b8e05abc5765 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Calling method '.version_select at 0x7f634201d8b0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:49.489970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a8d55b35-4672-4839-8d8f-b8e05abc5765 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'bacb1dc8853f4683adc49806d020e4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d28c2e7d964b7d9b20b00e5b49aa7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8d55b35-4672-4839-8d8f-b8e05abc5765 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Request method failure captured: Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI4cJ-JBd3QZm8PKBJXVezb_jUOh7xArBi9phuxt4zLNg6ll_lrvQf55hjGs0Kz5GaWpKoJpUHLPPD5KwkUmPvoaGQ8NQwq_ob6_NF_rQIJtAVttRCp4TWqtGtivbsn910MgNSg5KGS_TqlMR13_TvetpvwZuQDStG8p-qYU0vF4D0 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:49.492697 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bacb1dc8853f4683adc49806d020e4b5 Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 17:49:49.495166 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:49.496592 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:49:49.499580 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.504520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8d55b35-4672-4839-8d8f-b8e05abc5765 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:49.506196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a8d55b35-4672-4839-8d8f-b8e05abc5765 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.050174 Oct 04 17:49:49.516532 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 213/485] 10.222.0.33 () {58 vars in 1179 bytes} [Tue Oct 4 17:49:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:49.526630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49acb0e7-b10c-4b61-805f-13106ea515be tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] Calling method '.version_select at 0x7f6341f87280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:49.553424 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-49acb0e7-b10c-4b61-805f-13106ea515be tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.035443 Oct 04 17:49:49.558255 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 214/486] 10.222.0.33 () {60 vars in 1226 bytes} [Tue Oct 4 17:49:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:50.851636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Calling method '.version_select at 0x7f6341fa6040>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:50.854233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.855930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.857188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:50.946117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.947152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.951626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:50.989435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.989942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.990388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.023336 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-caed2704-06cd-4127-9d53-47e68125e15e tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.463523 Oct 04 17:49:51.035368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 215/487] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:51.050512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-abacd25b-6b35-4c92-8ec2-45bd2e23a194 tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f874c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:51.145294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:SELECT=79,nova_api:UPDATE=10,nova_api:INSERT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:51.317998 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-abacd25b-6b35-4c92-8ec2-45bd2e23a194 tempest-QuotaClassesAdmin257Test-140351875 tempest-QuotaClassesAdmin257Test-140351875-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.280936 Oct 04 17:49:51.318394 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 216/488] 10.222.0.33 () {62 vars in 1247 bytes} [Tue Oct 4 17:49:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:51.334922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:51.335751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:51.386870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.403703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.404227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.405030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.405511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.405952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.225814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:52.245203 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0385befa-d839-4df5-9d9e-0d8678e50067 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1474 microversion: 2.1 time: 0.924091 Oct 04 17:49:52.258593 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 217/489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:51 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1474 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:52.277556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b123d274-39dc-4126-ab45-bab05976b4c4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Calling method '.version_select at 0x7f6341f35700>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.284609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b123d274-39dc-4126-ab45-bab05976b4c4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'bacb1dc8853f4683adc49806d020e4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d28c2e7d964b7d9b20b00e5b49aa7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b123d274-39dc-4126-ab45-bab05976b4c4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Request method failure captured: Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI4cJ-JBd3QZm8PKBJXVezb_jUOh7xArBi9phuxt4zLNg6ll_lrvQf55hjGs0Kz5GaWpKoJpUHLPPD5KwkUmPvoaGQ8NQwq_ob6_NF_rQIJtAVttRCp4TWqtGtivbsn910MgNSg5KGS_TqlMR13_TvetpvwZuQDStG8p-qYU0vF4D0 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:52.287654 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bacb1dc8853f4683adc49806d020e4b5 Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1'} Oct 04 17:49:52.288914 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:52.289790 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:49:52.290849 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.302084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b123d274-39dc-4126-ab45-bab05976b4c4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:52.304081 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b123d274-39dc-4126-ab45-bab05976b4c4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.044337 Oct 04 17:49:52.313288 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 218/490] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:52.504009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f2cc0bb-ee7f-4c06-8269-fdf8b82e0257 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea/action" status: 202 len: 0 microversion: 2.25 time: 5.623914 Oct 04 17:49:52.508139 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 273/491] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:49:46 2022] POST /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea/action => generated 0 bytes in 5629 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:52.513031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8785916-8f52-4d70-9eb7-2d5e6c5e4641 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Calling method '.version_select at 0x7f634222c280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.514651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f8785916-8f52-4d70-9eb7-2d5e6c5e4641 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] HTTP exception thrown: Hypervisor with ID 'cebbed14-5572-48bb-bb59-e9fb272de477' could not be found. Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8785916-8f52-4d70-9eb7-2d5e6c5e4641 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Request method failure captured: Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hypervisors/cebbed14-5572-48bb-bb59-e9fb272de477/uptime HTTP/1.1 Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHI7RUlYm63EYcaRUX-yPbc-YMMXlseFzo7F5QIMOwtTv4_toKqUzsnUpLbkTUYgtck_o1K0VZSCpGWMzhSYjCMHxRxgO0X8tpkvJRV0VG6nNaDQmfnxNkM2xWoNE4vYBng-TVM2BIkvTvRfwWGYWn0rQ3qlG0GP9T6GzKn5U7mSE8M Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9ff170c573d34812bacc250def02c91b Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:52.537714 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ff170c573d34812bacc250def02c91b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ff170c573d34812bacc250def02c91b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ff170c573d34812bacc250def02c91b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ff170c573d34812bacc250def02c91b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9ff170c573d34812bacc250def02c91b Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2e0cc3d9446d4d50ad649308d652692a Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: exception: Hypervisor with ID 'cebbed14-5572-48bb-bb59-e9fb272de477' could not be found. Oct 04 17:49:52.539259 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'cebbed14-5572-48bb-bb59-e9fb272de477'} Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cebbed14-5572-48bb-bb59-e9fb272de477' Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 17:49:52.540152 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cebbed14-5572-48bb-bb59-e9fb272de477' could not be found. Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.541584 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cebbed14-5572-48bb-bb59-e9fb272de477' could not be found. Oct 04 17:49:52.542901 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.552320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8785916-8f52-4d70-9eb7-2d5e6c5e4641 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Returning 404 to user: Hypervisor with ID 'cebbed14-5572-48bb-bb59-e9fb272de477' could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:52.557934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8785916-8f52-4d70-9eb7-2d5e6c5e4641 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/cebbed14-5572-48bb-bb59-e9fb272de477/uptime" status: 404 len: 123 microversion: 2.1 time: 0.047415 Oct 04 17:49:52.563468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 274/492] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/os-hypervisors/cebbed14-5572-48bb-bb59-e9fb272de477/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:52.583421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.584038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:52.627540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.632607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.636012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.637039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.639132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.639757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.077950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee5f4d70-8eb5-435f-9b6c-db67c7d9203f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Calling method '.version_select at 0x7f6341f879d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:53.327830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:53.350466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:53.356350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:53.363107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e0309c9-14c6-4f09-965b-dabbabadb25d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.795700 Oct 04 17:49:53.366274 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 275/493] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:53.396176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Calling method '.version_select at 0x7f634255de50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:53.405920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.406818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.410256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.426794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:53.468842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.472142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.472871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.505286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.509439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.511097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.532981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0938e535-6cbe-4e88-a2f1-4a9657a08055 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.165039 Oct 04 17:49:53.538224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 276/494] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:53.555162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:53.557000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:53.573492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.576010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.578341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.584505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.589465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.591655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.150203 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee5f4d70-8eb5-435f-9b6c-db67c7d9203f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 371 microversion: 2.1 time: 1.835509 Oct 04 17:49:54.155582 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 219/495] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 371 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:54.188373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e2b699a4-bc94-469a-b152-4039f290e8b4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Calling method '.version_select at 0x7f63420d2310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.195401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e2b699a4-bc94-469a-b152-4039f290e8b4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'bacb1dc8853f4683adc49806d020e4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d28c2e7d964b7d9b20b00e5b49aa7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e2b699a4-bc94-469a-b152-4039f290e8b4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Request method failure captured: Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI4cJ-JBd3QZm8PKBJXVezb_jUOh7xArBi9phuxt4zLNg6ll_lrvQf55hjGs0Kz5GaWpKoJpUHLPPD5KwkUmPvoaGQ8NQwq_ob6_NF_rQIJtAVttRCp4TWqtGtivbsn910MgNSg5KGS_TqlMR13_TvetpvwZuQDStG8p-qYU0vF4D0 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:54.207813 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a1d28c2e7d964b7d9b20b00e5b49aa7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a1d28c2e7d964b7d9b20b00e5b49aa7f Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832 Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bacb1dc8853f4683adc49806d020e4b5 Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027034832-project Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1'} Oct 04 17:49:54.209238 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:54.210581 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:49:54.212030 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.216002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e2b699a4-bc94-469a-b152-4039f290e8b4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:54.219927 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e2b699a4-bc94-469a-b152-4039f290e8b4 tempest-HypervisorAdminNegativeTestJSON-2027034832 tempest-HypervisorAdminNegativeTestJSON-2027034832-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.060463 Oct 04 17:49:54.228605 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 220/496] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:54.249246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f35af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.267082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:54.270895 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a455408-444f-4de7-9fc0-9e33ddd4d36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1471 microversion: 2.1 time: 0.726309 Oct 04 17:49:54.270895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 277/497] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:53 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:54.295772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9492130-241b-4f69-90b3-94615243ae60 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Calling method '.version_select at 0x7f6341ee8940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.297211 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a9492130-241b-4f69-90b3-94615243ae60 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] HTTP exception thrown: Hypervisor with ID '4d3a9049-11af-4f80-8db4-f2eabe8972f1' could not be found. Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9492130-241b-4f69-90b3-94615243ae60 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Request method failure captured: Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-hypervisors/4d3a9049-11af-4f80-8db4-f2eabe8972f1 HTTP/1.1 Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHI7RUlYm63EYcaRUX-yPbc-YMMXlseFzo7F5QIMOwtTv4_toKqUzsnUpLbkTUYgtck_o1K0VZSCpGWMzhSYjCMHxRxgO0X8tpkvJRV0VG6nNaDQmfnxNkM2xWoNE4vYBng-TVM2BIkvTvRfwWGYWn0rQ3qlG0GP9T6GzKn5U7mSE8M Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9ff170c573d34812bacc250def02c91b Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:54.298888 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ff170c573d34812bacc250def02c91b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ff170c573d34812bacc250def02c91b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ff170c573d34812bacc250def02c91b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ff170c573d34812bacc250def02c91b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9ff170c573d34812bacc250def02c91b Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-296224223 Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2e0cc3d9446d4d50ad649308d652692a Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: exception: Hypervisor with ID '4d3a9049-11af-4f80-8db4-f2eabe8972f1' could not be found. Oct 04 17:49:54.300196 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4d3a9049-11af-4f80-8db4-f2eabe8972f1'} Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4d3a9049-11af-4f80-8db4-f2eabe8972f1' Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 17:49:54.300941 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:49:54.302135 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4d3a9049-11af-4f80-8db4-f2eabe8972f1' could not be found. Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4d3a9049-11af-4f80-8db4-f2eabe8972f1' could not be found. Oct 04 17:49:54.304153 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.308748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9492130-241b-4f69-90b3-94615243ae60 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] Returning 404 to user: Hypervisor with ID '4d3a9049-11af-4f80-8db4-f2eabe8972f1' could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:54.317024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9492130-241b-4f69-90b3-94615243ae60 tempest-HypervisorAdminNegativeTestJSON-296224223 tempest-HypervisorAdminNegativeTestJSON-296224223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/4d3a9049-11af-4f80-8db4-f2eabe8972f1" status: 404 len: 123 microversion: 2.1 time: 0.038978 Oct 04 17:49:54.322774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 278/498] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/os-hypervisors/4d3a9049-11af-4f80-8db4-f2eabe8972f1 => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:54.342175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.345815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:54.383253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.384534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.392688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.405881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.413895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.416065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.594680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27c0456c-8b87-4d88-bb7d-9653b4dd1bdb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5/action" status: 204 len: 0 microversion: 2.1 time: 0.275706 Oct 04 17:49:54.600339 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 279/499] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:49:54 2022] POST /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5/action => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:49:54.623930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.625179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:54.636123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.637569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.638445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.640414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.642262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.643157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.067946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.082499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.103520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.110736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d684ba1-ae52-4abc-876d-0f3f6a0939ee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.506249 Oct 04 17:49:55.121240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 280/500] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:55.153346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:55.159108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:55.182079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.185767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.189203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.191957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.194446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.203759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.614078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.631309 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbccc0ea-1b78-46af-9ae9-3517937e2223 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1471 microversion: 2.1 time: 0.506458 Oct 04 17:49:55.646996 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 281/501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:55 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:56.034577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.035905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.038928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.042420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.043214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.044748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.254168 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b195b88-f851-4da4-98af-2e250fa3a1ef tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 328 microversion: 2.1 time: 2.023076 Oct 04 17:49:56.257051 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 221/502] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:54 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 328 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:56.287157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:56.297574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:56.339174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.342307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.344878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.354458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.358205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.360712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.850314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b8a634a-ec41-4148-8f98-45f0ab4ec79d tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:56.861440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1b8a634a-ec41-4148-8f98-45f0ab4ec79d tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b8a634a-ec41-4148-8f98-45f0ab4ec79d tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin] Request method failure captured: Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJCmxOJnyaYXWg8ZCkmJC_KDGCJIiPzYMHx_TKBeZItd46phoFTnASG-nb4bhe7VH8toprHB6P_Rt0KpUlqFkPXBjaUHyIKZ29zrnbHZQ1-HM4BbDfNtVNK2sNt2d-hdN5J-WfQYY-enais_qMCZbzGALnoGKiq0lUPhqee7Q2CRiA Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c2d20a9a57614eceb2bd47fc8ddf0d1d Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:49:56.874511 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c2d20a9a57614eceb2bd47fc8ddf0d1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c2d20a9a57614eceb2bd47fc8ddf0d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c2d20a9a57614eceb2bd47fc8ddf0d1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c2d20a9a57614eceb2bd47fc8ddf0d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c2d20a9a57614eceb2bd47fc8ddf0d1d Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a0bd95b210074557b5de677a81aaa2e0 Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:56.877067 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid timestamp for date invalid_time Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'invalid_time'} Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:56.878742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 17:49:56.881169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:56.892069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b8a634a-ec41-4148-8f98-45f0ab4ec79d tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:56.894810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1b8a634a-ec41-4148-8f98-45f0ab4ec79d tempest-InstanceUsageAuditLogNegativeTestJSON-320638333 tempest-InstanceUsageAuditLogNegativeTestJSON-320638333-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.251441 Oct 04 17:49:56.901668 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 282/503] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 17:49:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1260 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:49:56.916679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:56.919045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:56.946944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.949463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.949933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.951263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.956291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.957810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:57.348772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.362111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16f258b1-e7e4-404a-bd16-74080ee29de1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1471 microversion: 2.1 time: 0.458037 Oct 04 17:49:57.364713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 283/504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:56 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:57.716089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6effe22-2e7c-465c-a651-7e4a2b29293b tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:57.719262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6effe22-2e7c-465c-a651-7e4a2b29293b tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '466b4c569b16403c96f6359a2d23772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc215dac6dfc4959bd042d07e446ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6effe22-2e7c-465c-a651-7e4a2b29293b tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Request method failure captured: Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHI_F4L6GbBW1HeOR41eVbDHlFkxeKJxcXMHtEnFSmhortRfOrnfhyglH_VZ0r85T1NR_p3ZuxTyV4r3r0EGSuVIZTxOL6lcSlEcaVDGjAa7T-ZPkz7DOLibadD5w1H2jxrYFJq0ohW8tPuqudV_a-ClcozmoFKbUGlbC6__FDarGZU Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: cc215dac6dfc4959bd042d07e446ad92 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:57.721618 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: cc215dac6dfc4959bd042d07e446ad92 Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 466b4c569b16403c96f6359a2d23772f Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project Oct 04 17:49:57.723208 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:57.723903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:57.725269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.733112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6effe22-2e7c-465c-a651-7e4a2b29293b tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:57.760841 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6effe22-2e7c-465c-a651-7e4a2b29293b tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.371587 Oct 04 17:49:57.768061 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 284/505] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:49:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:57.808691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.832927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.835391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.836614 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b8a0e38-66cd-434f-a597-c489abd8b3c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 1.576875 Oct 04 17:49:57.845390 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 222/506] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:56 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:57.867707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6298c00d-8834-47d5-984e-2bde62a1c7bb tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:57.870582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6298c00d-8834-47d5-984e-2bde62a1c7bb tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '466b4c569b16403c96f6359a2d23772f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc215dac6dfc4959bd042d07e446ad92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6298c00d-8834-47d5-984e-2bde62a1c7bb tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Request method failure captured: Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017:49:57 HTTP/1.1 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI_F4L6GbBW1HeOR41eVbDHlFkxeKJxcXMHtEnFSmhortRfOrnfhyglH_VZ0r85T1NR_p3ZuxTyV4r3r0EGSuVIZTxOL6lcSlEcaVDGjAa7T-ZPkz7DOLibadD5w1H2jxrYFJq0ohW8tPuqudV_a-ClcozmoFKbUGlbC6__FDarGZU Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: cc215dac6dfc4959bd042d07e446ad92 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:49:57.878018 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc215dac6dfc4959bd042d07e446ad92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: cc215dac6dfc4959bd042d07e446ad92 Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 466b4c569b16403c96f6359a2d23772f Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project Oct 04 17:49:57.879736 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2022-10-04 17:49:57'} Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:57.880429 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:57.881745 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:49:57.886947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6298c00d-8834-47d5-984e-2bde62a1c7bb tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:57.894827 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6298c00d-8834-47d5-984e-2bde62a1c7bb tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616 tempest-InstanceUsageAuditLogNegativeTestJSON-1961461616-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 17:49:57" status: 403 len: 128 microversion: 2.1 time: 0.046277 Oct 04 17:49:57.904164 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 223/507] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 17:49:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017%3A49%3A57 => generated 128 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:58.321443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-820714509", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:58.408066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:58.408683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:58.422841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.425160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.437120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.437924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.438488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.438847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.450434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:59.371971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:59.377574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:59.432732 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a0a16dc-7799-4a6a-b753-4b29b6c4d969 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1471 microversion: 2.1 time: 1.036786 Oct 04 17:49:59.433633 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 224/508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:58 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1471 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:59.463265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2152578d-d896-4038-9f23-29b08bd0c0ea", "name": "network-vif-unplugged", "status": "completed", "tag": "084175da-5b7e-4e5f-a3bd-c2e86da78a78"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:59.500014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.501212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.502386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.540196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] Creating event network-vif-unplugged:084175da-5b7e-4e5f-a3bd-c2e86da78a78 for instance 2152578d-d896-4038-9f23-29b08bd0c0ea on n-h1-831193-17 Oct 04 17:49:59.549194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5fbe086e-51e8-40e1-994f-2671f0de67a8 req-8894b134-1a14-41a0-9487-bafac0dbe750 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109472 Oct 04 17:49:59.549972 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 225/509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:59.572124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:59.573255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:59.582961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.583924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.585538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.586723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.588158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.591343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.612463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:59.614409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:59.615222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:59.615902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:59.616498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:59.663324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.669124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.670362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.680798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.682399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.683744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.759873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:59.788732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for user 9650983383724c81b548969bee48f33e and project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:59.862506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.utils [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] cores quota exceeded for f53b1230052d4cccbe6349bf959cdfa6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128770) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:49:59.868596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Request method failure captured: Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 144 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHI70eMw3Z4nE5kPy-RC9DBovkdgUmMwUhe7V90_hxNwZfdQVKPCGg06a84NANbjtJxtrjEvM77dYYr2JLnPqyUoSh003kTArKGzp7ke2Y56XrMsiP7cVPrT7YM77qN-vtZKqbU09Y7M22ws1W-kXB-TC3rPdAryo2CngW0UHA48NR0 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:49:59.893446 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9650983383724c81b548969bee48f33e Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-820714509", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} Oct 04 17:49:59.894864 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-820714509', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452'}}} Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:49:59.895598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:59.896651 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.897838 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:59.899313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:49:59.907110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:59.909411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1869b00c-8abe-4306-8b88-2ca3b04f0c82 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.135585 Oct 04 17:49:59.915218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 285/510] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:57 2022] POST /compute/v2.1/servers => generated 111 bytes in 2145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:59.937900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f601f0>, body: {"quota_set": {"cores": 20}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:01.086074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.093440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.094631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.097102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.100605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.101292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.236460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d5105b5-398d-48b0-98f1-a13be1f6028f tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 329 microversion: 2.1 time: 1.318602 Oct 04 17:50:01.237874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 286/511] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:59 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 329 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:01.245037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.246495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.264062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.265316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.267513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.269764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.270488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.275202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.624184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.644756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.655011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.661705 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d4c5d307-1242-4438-bf04-89e5bc3fde36 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 2.109868 Oct 04 17:50:01.671077 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 226/512] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:49:59 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:01.692424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "name": "network-vif-plugged", "status": "completed", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:01.727908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.732327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.736740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.777379 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] Creating event network-vif-plugged:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h2-831193-17 Oct 04 17:50:01.789602 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-38a63fce-f62f-497f-a7ee-f617463614fc req-2eeecb98-3baa-4fab-a806-aacdbaee8331 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120776 Oct 04 17:50:01.793059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 227/513] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:01.807686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30c48dbe-b810-4200-9864-c96797c38046 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Calling method '.version_select at 0x7f6341f4d0d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.417828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30c48dbe-b810-4200-9864-c96797c38046 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 371 microversion: 2.1 time: 0.621703 Oct 04 17:50:02.426850 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 228/514] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 371 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:02.674172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea0a2b82-dacc-446b-9aa7-2558b4c85e0a tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] Action: 'create', calling method: .version_select at 0x7f6341fafc10>, body: {"security_group": {"name": "tempest-securitygroup-2072727660", "description": "tempest-description-676414803"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:02.690045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.709472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5457bc18-57bb-4b6a-af31-41e7fdc4020a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1471 microversion: 2.1 time: 1.469740 Oct 04 17:50:02.718214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 287/515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1471 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:02.730736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f63420165e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:02.929365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.931575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.938383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.939606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.940850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.944812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.112647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc81b21f-466a-4c2d-a534-7cfe7c0d6a2e tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 328 microversion: 2.1 time: 0.389169 Oct 04 17:50:03.116698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 288/516] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:02 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:03.127780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.170248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:03.209697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.211450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.212607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.213989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.217374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.218956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.579588 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea0a2b82-dacc-446b-9aa7-2558b4c85e0a tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.149038 Oct 04 17:50:03.581717 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 229/517] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:50:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:03.604580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2152578d-d896-4038-9f23-29b08bd0c0ea", "tag": "084175da-5b7e-4e5f-a3bd-c2e86da78a78"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.644105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.648040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.651969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.678036 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] Creating event network-changed:084175da-5b7e-4e5f-a3bd-c2e86da78a78 for instance 2152578d-d896-4038-9f23-29b08bd0c0ea on n-h1-831193-17 Oct 04 17:50:03.688361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e33ce4fc-9da3-4720-9250-4b4006c2cc87 req-079f4fd7-0f79-42a7-9a7a-40aba139edbb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101752 Oct 04 17:50:03.689561 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 230/518] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:03.697929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-654087067", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.791637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:03.944869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.955807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.960330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.964622 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f02e0e5d-34a8-418f-8f1e-fa79eb0bc9f0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.846025 Oct 04 17:50:03.969565 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 289/519] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:03.985760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d749668b-6091-47b1-87c2-5028e7d8140d tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] Action: 'create', calling method: .version_select at 0x7f6341e4ea60>, body: {"security_group": {"name": "tempest-securitygroup-459618107", "description": "tempest-description-2107141177"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:04.509645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d749668b-6091-47b1-87c2-5028e7d8140d tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.537986 Oct 04 17:50:04.510888 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 290/520] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:50:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:04.516746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:04.517698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:04.538051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.540449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.541714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.544345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.546044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.546738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.573341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:04.574012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:04.574606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:04.575230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:04.576344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:04.602828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.603529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.604096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.604949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.605523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.606060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.645026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:04.651969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for user 9650983383724c81b548969bee48f33e and project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:04.682213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.utils [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] instances quota exceeded for f53b1230052d4cccbe6349bf959cdfa6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128771) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:50:04.683151 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Request method failure captured: Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 144 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI70eMw3Z4nE5kPy-RC9DBovkdgUmMwUhe7V90_hxNwZfdQVKPCGg06a84NANbjtJxtrjEvM77dYYr2JLnPqyUoSh003kTArKGzp7ke2Y56XrMsiP7cVPrT7YM77qN-vtZKqbU09Y7M22ws1W-kXB-TC3rPdAryo2CngW0UHA48NR0 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:04.698188 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9650983383724c81b548969bee48f33e Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-654087067", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} Oct 04 17:50:04.699695 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-654087067', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452'}}} Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:50:04.701124 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:04.703383 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.705945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff38e78a-1d64-4f24-a5ed-1454c5babe9e tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.008847 Oct 04 17:50:04.709053 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 231/521] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:03 2022] POST /compute/v2.1/servers => generated 119 bytes in 1010 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:04.834545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:04.842593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80049dba-dc34-453c-948f-1fc3bbb22cf4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1463 microversion: 2.1 time: 0.330344 Oct 04 17:50:04.848278 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 291/522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:04 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:04.853380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f608b0>, body: {"quota_set": {"instances": 10}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:05.448477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f9ed6a72-5193-43e0-a633-6d2bab960e3f tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] Action: 'create', calling method: .version_select at 0x7f63420c98b0>, body: {"security_group": {"name": "tempest-securitygroup-1263890166", "description": "tempest-description-1390881426"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.240282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:06.256349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.257251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.258004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.259977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.260952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.262981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.449073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b576a79-ae76-4efb-b268-3e6901f85112 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 329 microversion: 2.1 time: 1.599074 Oct 04 17:50:06.451309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 292/523] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:04 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 329 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.475316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.476928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:06.497398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.499717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.500333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.502758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.504163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.505929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.989181 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-342fab1e-9702-4349-9c64-e792256979ad tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1616 microversion: 2.1 time: 0.536299 Oct 04 17:50:06.990019 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 293/524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:06 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1616 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:06.996460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.997419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:07.020268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.021393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.022027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.022940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.023583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.025018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.428948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:07.450155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:07.457492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:07.460486 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70456788-2c93-41df-a3b4-16230a58949b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.467666 Oct 04 17:50:07.463884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 294/525] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:06 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:07.472747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eff4920c-3eb8-4ffc-8e18-1a5d29e7187d tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Calling method '.version_select at 0x7f6341e4eca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.177472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eff4920c-3eb8-4ffc-8e18-1a5d29e7187d tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 371 microversion: 2.1 time: 0.711498 Oct 04 17:50:08.197812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 295/526] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:50:07 2022] GET /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.220698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8b46e2d-f620-458a-9f3f-5bf6ef33e6fd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '.version_select at 0x7f6341e96550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.224455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b46e2d-f620-458a-9f3f-5bf6ef33e6fd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.243413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b46e2d-f620-458a-9f3f-5bf6ef33e6fd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.245752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b46e2d-f620-458a-9f3f-5bf6ef33e6fd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.253864 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f9ed6a72-5193-43e0-a633-6d2bab960e3f tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.551221 Oct 04 17:50:08.255196 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 232/527] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:50:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.260404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f825e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:08.301660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8b46e2d-f620-458a-9f3f-5bf6ef33e6fd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 799 microversion: 2.1 time: 0.102579 Oct 04 17:50:08.316776 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 296/528] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:50:08 2022] GET /compute/v2.1/os-migrations => generated 799 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.322023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8dc7894c-ec09-49ac-9515-156cd95079cc tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] Action: 'create', calling method: .version_select at 0x7f6341e42820>, body: {"security_group": {"name": "tempest-securitygroup-1149558598", "description": "tempest-description-10896537"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:08.444333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.445124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.445808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.447523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.448254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.452098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.607905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9e183d2b-61f1-43fa-9f0f-8ca9dab71b33 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 325 microversion: 2.1 time: 0.351339 Oct 04 17:50:08.627631 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 233/529] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:08 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.644683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.645578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:08.662599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.663225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.663682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.664411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.675552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.676429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.021111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8dc7894c-ec09-49ac-9515-156cd95079cc tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.700495 Oct 04 17:50:09.029684 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 297/530] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:50:08 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.039953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1175002540", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.190259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:09.260955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:09.276707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:09.278438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:09.280884 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-49cf4f42-bb2d-4ca4-8fd9-72b009e91300 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.652133 Oct 04 17:50:09.281655 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 234/531] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:08 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:09.296385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1971342872", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.420537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:10.020143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:10.021132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:10.022065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:10.022597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:10.022787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:10.054005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.054699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.055191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.055961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.056434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.056867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.102322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:10.114246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:10.193505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:10.196699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:10.306366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce7c4fdc-74a0-4257-9d93-df2541059cba tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275218 Oct 04 17:50:10.307613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 298/532] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:10.312485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d9c51b3-6dec-43c4-90ed-505d33fa0194 tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] Calling method '.version_select at 0x7f6341e42820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.390805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:10.391772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:10.392401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:10.392981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:10.393564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:10.418000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.418659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.419526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.420419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.421034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.424715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.463827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:10.475791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Getting quotas for user 9650983383724c81b548969bee48f33e and project f53b1230052d4cccbe6349bf959cdfa6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:10.500568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.utils [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] ram quota exceeded for f53b1230052d4cccbe6349bf959cdfa6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128771) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:50:10.501234 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Request method failure captured: Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 145 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI70eMw3Z4nE5kPy-RC9DBovkdgUmMwUhe7V90_hxNwZfdQVKPCGg06a84NANbjtJxtrjEvM77dYYr2JLnPqyUoSh003kTArKGzp7ke2Y56XrMsiP7cVPrT7YM77qN-vtZKqbU09Y7M22ws1W-kXB-TC3rPdAryo2CngW0UHA48NR0 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:10.507625 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9650983383724c81b548969bee48f33e Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1971342872", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} Oct 04 17:50:10.509156 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1971342872', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452'}}} Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:50:10.509955 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.510954 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.512213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:50:10.513856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.517221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:10.519140 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-874db48d-5ef8-401c-aebb-db09260adfc1 tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.236078 Oct 04 17:50:10.521426 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 235/533] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 1239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:10.546880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.547913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:10.559675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.561061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.563808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.564998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.568772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.570798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.382605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.405747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.415633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.422521 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7aada39a-a929-4a57-952b-579f5eac7124 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.899798 Oct 04 17:50:11.427346 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 236/534] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:11.436682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.442473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:11.454773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.471865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.472727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.479376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.480103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.480696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.734365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.753684 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e291157e-ec20-4224-bd37-d3c02187d005 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1209 microversion: 2.1 time: 0.324714 Oct 04 17:50:11.780440 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 237/535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1209 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:11.797798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Action: 'update', calling method: .version_select at 0x7f6341f2c040>, body: {"quota_set": {"ram": 51200}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:12.562782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.563498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.563733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.564501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.564951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.565372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.633009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=11 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:12.762361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:12.845890 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ef5d60aa-3d09-4e9f-9407-bc5bf9432ca9 tempest-QuotasAdminNegativeTest-914467464 tempest-QuotasAdminNegativeTest-914467464-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 200 len: 329 microversion: 2.1 time: 1.060673 Oct 04 17:50:12.846221 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 238/536] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:11 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 329 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:12.857854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:12.858568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:12.892479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.897245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.898054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.899759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.901916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.903277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.170037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.197068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.201066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.202304 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a443d75a-b8ce-4cca-a362-4feac960d68b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1566 microversion: 2.25 time: 0.352570 Oct 04 17:50:13.205046 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 239/537] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:12 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1566 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:13.213745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:13.217586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:13.233318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.237924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.238604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.239596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.240364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.240946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.359321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.371557 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-10bc93b7-01ac-4972-a1e6-caa92b717def tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1271 microversion: 2.1 time: 0.165103 Oct 04 17:50:13.378874 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 240/538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:13 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:13.393829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06fd52fa-8885-4b82-b9d7-9738b8f04acd tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Action: 'update', calling method: .version_select at 0x7f6341f4d430>, body: {"quota_set": {"ram": 0}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:13.415404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-06fd52fa-8885-4b82-b9d7-9738b8f04acd tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '9650983383724c81b548969bee48f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53b1230052d4cccbe6349bf959cdfa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06fd52fa-8885-4b82-b9d7-9738b8f04acd tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Request method failure captured: Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 HTTP/1.1 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 25 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHI70eMw3Z4nE5kPy-RC9DBovkdgUmMwUhe7V90_hxNwZfdQVKPCGg06a84NANbjtJxtrjEvM77dYYr2JLnPqyUoSh003kTArKGzp7ke2Y56XrMsiP7cVPrT7YM77qN-vtZKqbU09Y7M22ws1W-kXB-TC3rPdAryo2CngW0UHA48NR0 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:13.428885 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f53b1230052d4cccbe6349bf959cdfa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f53b1230052d4cccbe6349bf959cdfa6 Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-64883444 Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9650983383724c81b548969bee48f33e Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-QuotasAdminNegativeTest-64883444-project Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: {"quota_set": {"ram": 0}} Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:50:13.430505 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'f53b1230052d4cccbe6349bf959cdfa6', 'body': {'quota_set': {'ram': 0}}} Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:13.431511 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:13.432875 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06fd52fa-8885-4b82-b9d7-9738b8f04acd tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:13.434272 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-06fd52fa-8885-4b82-b9d7-9738b8f04acd tempest-QuotasAdminNegativeTest-64883444 tempest-QuotasAdminNegativeTest-64883444-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6" status: 403 len: 116 microversion: 2.1 time: 0.052813 Oct 04 17:50:13.439541 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 241/539] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:13 2022] PUT /compute/v2.1/os-quota-sets/f53b1230052d4cccbe6349bf959cdfa6 => generated 116 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:14.358174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b64419e4-d5ce-40a5-b791-3637ee914f1e tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:14.370772 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b64419e4-d5ce-40a5-b791-3637ee914f1e tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.930745 Oct 04 17:50:14.371738 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 242/540] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:14.776015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c335c98f-ad3c-460c-9eda-d7632e295c37 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:14.789439 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c335c98f-ad3c-460c-9eda-d7632e295c37 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.400468 Oct 04 17:50:14.790182 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 243/541] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:14.797116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:14.808062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:14.828812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.829372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.829893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:14.830612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.831182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.831637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.134878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:15.145988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:15.155168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:15.159654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c465ede6-7dc9-4df2-b0d2-e7412ca982c7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 1556 microversion: 2.25 time: 0.364483 Oct 04 17:50:15.161169 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 244/542] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:14 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 1556 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:15.484526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-032a221d-9061-4bd7-8c02-f233ea57d69e tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-31610869", "id": 1616054151, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:15.517421 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-032a221d-9061-4bd7-8c02-f233ea57d69e tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.354934 Oct 04 17:50:15.520966 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 245/543] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:15 2022] POST /compute/v2.1/flavors => generated 423 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:15.532454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.535083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:15.551169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.552894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.556986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.557960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.558583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.559669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.763571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:15.777024 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-51e6a1ca-3d84-44e4-860d-8da2f5f20683 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1271 microversion: 2.1 time: 0.254796 Oct 04 17:50:15.777624 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 246/544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:15.791392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b37c39c-73d8-4b3b-94bf-569a1d647a6f tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.848343 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b37c39c-73d8-4b3b-94bf-569a1d647a6f tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2836 microversion: 2.1 time: 0.065959 Oct 04 17:50:15.849246 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 247/545] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/flavors => generated 2836 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:15.854972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6f862fc6-a1c4-4b23-a14d-ad40c4988403 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '.version_select at 0x7f6342286040>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.859721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f862fc6-a1c4-4b23-a14d-ad40c4988403 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.860211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f862fc6-a1c4-4b23-a14d-ad40c4988403 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.860650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f862fc6-a1c4-4b23-a14d-ad40c4988403 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.877430 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6f862fc6-a1c4-4b23-a14d-ad40c4988403 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 868 microversion: 2.25 time: 0.027086 Oct 04 17:50:15.889208 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 248/546] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/os-migrations => generated 868 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:15.915194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a325449f-f560-4346-89b6-f2aec848375a tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.928298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a325449f-f560-4346-89b6-f2aec848375a tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037488 Oct 04 17:50:15.933783 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 249/547] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:15.938817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-691c1b50-7e37-4e80-887b-0da12ae6431f tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.958130 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-691c1b50-7e37-4e80-887b-0da12ae6431f tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026134 Oct 04 17:50:15.959233 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 250/548] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:15.964989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.965658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:15.978289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.979067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.979551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.981110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.982584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.983293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:16.303967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 2152578d-d896-4038-9f23-29b08bd0c0ea {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:16.346345 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-06553fd6-2697-46b2-9995-e3e9de5ecf7d tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 200 len: 2050 microversion: 2.25 time: 0.384122 Oct 04 17:50:16.347085 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 251/549] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 2050 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:16.380547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4b7dcb62-a8dd-4e7a-887a-32292fc58572 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2080385573", "id": 1901294572, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:16.431329 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4b7dcb62-a8dd-4e7a-887a-32292fc58572 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.068155 Oct 04 17:50:16.431957 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 252/550] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:16 2022] POST /compute/v2.1/flavors => generated 425 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:16.444919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b8d499a-228d-46b4-9f52-cc7e160f4fe4 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:16.465538 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b8d499a-228d-46b4-9f52-cc7e160f4fe4 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032420 Oct 04 17:50:16.468194 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 253/551] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:16.474196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-21be98a1-50c9-4acb-aaff-3f59ac32878c tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:16.502604 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-21be98a1-50c9-4acb-aaff-3f59ac32878c tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030852 Oct 04 17:50:16.504220 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 254/552] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 17:50:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:16.517517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2efc1ebf-f8df-478e-b2bd-9baf117971b7 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:16.613116 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2efc1ebf-f8df-478e-b2bd-9baf117971b7 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.105505 Oct 04 17:50:16.614983 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 255/553] 10.222.0.33 () {58 vars in 1165 bytes} [Tue Oct 4 17:50:16 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:16.621367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9aef3699-939e-41f3-a57d-99619347651b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Action: 'create', calling method: .version_select at 0x7f6342013f70>, body: {"keypair": {"name": "tempest-keypair-1942937255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtP2+G8bMz+4+e9f+VtLnOM7/o/oftOBVMl5U1t9BA+esigTnCipQ2VUvcYDlfJPrflALDPENFU+bDx/JxrICVlkVyXGxaQ0yP7ab98cT5FDmZaBKd2Suw/VCmUI4+lig=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:16.700186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=70,nova_cell0:UPDATE=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:16.708757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9aef3699-939e-41f3-a57d-99619347651b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for project 67f8b905a51742a18aea0297cd1f119d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:16.745474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9aef3699-939e-41f3-a57d-99619347651b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for user 51f1d73e7fbc42ecafb89f0875d5d70d and project 67f8b905a51742a18aea0297cd1f119d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:16.849802 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9aef3699-939e-41f3-a57d-99619347651b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233322 Oct 04 17:50:16.855980 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 256/554] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:50:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:16.882276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-293f818e-4b2f-4cf7-84b9-839432c89c44 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:16.914831 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-293f818e-4b2f-4cf7-84b9-839432c89c44 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051324 Oct 04 17:50:16.916214 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 257/555] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:16.926944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-223369712", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1a1507de-64a0-41ec-99ee-723250e9aaaa"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:17.096700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] validate_networks() for [('1a1507de-64a0-41ec-99ee-723250e9aaaa', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:18.705670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:18.706250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:18.706782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:18.707246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:18.707687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:18.720570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.721428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.722174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.723620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.724529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.725580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.776977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:18.784468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for user ee53a080f77a44f8aac80b34c1dd179e and project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:18.814563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:18.833718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:18.941371 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8a2080d-0026-40e0-b5a0-2107de428378 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.017897 Oct 04 17:50:18.943474 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 258/556] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:50:18.959488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:18.960288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:18.968174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.968914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.969536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.970409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.971012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.971666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.317889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.326002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e186ec9-c761-4643-9f12-9736f4b5ceec tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.371878 Oct 04 17:50:19.336953 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 259/557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.351755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-99abfaab-f1c3-4da6-a77c-fa6eb3be6616 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.410122 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-99abfaab-f1c3-4da6-a77c-fa6eb3be6616 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.062125 Oct 04 17:50:19.411081 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 260/558] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.416234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.416848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:19.482547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.503423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.505451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.506861 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-35cb3e69-176e-4412-a15d-06e29c1b92df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1261 microversion: 2.25 time: 0.094828 Oct 04 17:50:19.507945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 261/559] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:19.514679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c02e5464-de9e-406b-9c28-dc1ad672e0ab tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.543632 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c02e5464-de9e-406b-9c28-dc1ad672e0ab tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.034481 Oct 04 17:50:19.551806 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 262/560] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:19.558442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da329e07-0a27-4dfc-8ed5-202571f41226 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.609825 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da329e07-0a27-4dfc-8ed5-202571f41226 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055374 Oct 04 17:50:19.611058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 263/561] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:19.626133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6d39c1a-2c14-45ad-b418-0a37a855e92c tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.778142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6d39c1a-2c14-45ad-b418-0a37a855e92c tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.156757 Oct 04 17:50:19.780663 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 264/562] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.799281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bcca7467-7325-4e49-be80-298e3ac0d728 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.816095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bcca7467-7325-4e49-be80-298e3ac0d728 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022202 Oct 04 17:50:19.817417 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 265/563] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:19.847246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a6e0aa3-dbf8-490f-b22d-44f6841bbd35 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.878831 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a6e0aa3-dbf8-490f-b22d-44f6841bbd35 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.051648 Oct 04 17:50:19.880003 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 266/564] 10.222.0.33 () {58 vars in 1144 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.896235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d4ff5822-b9b2-4a3d-b5f2-1e3181978191 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.906000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d4ff5822-b9b2-4a3d-b5f2-1e3181978191 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014652 Oct 04 17:50:19.923772 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 267/565] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:50:19.937427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62881093-3fb9-4bda-9945-896c1daec076 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.962060 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62881093-3fb9-4bda-9945-896c1daec076 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029572 Oct 04 17:50:19.963242 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 268/566] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:19.979649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-600c022b-c81d-4b0b-be91-fc4102633831 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.000575 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-600c022b-c81d-4b0b-be91-fc4102633831 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025119 Oct 04 17:50:20.002090 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 269/567] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:20.023805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6fe45d2d-2971-453a-96af-0f01f641daaa tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.046022 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6fe45d2d-2971-453a-96af-0f01f641daaa tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033309 Oct 04 17:50:20.054384 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 270/568] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:20.060037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a38a4558-f9fd-4e8b-bd0e-beaf097f84e8 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.080806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:20.082918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:20.109552 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a38a4558-f9fd-4e8b-bd0e-beaf097f84e8 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.054440 Oct 04 17:50:20.116034 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 271/569] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:20.137453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-58db8760-3695-4f99-ba93-dd1e8d9496e1 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.139090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=38 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:20.150043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:20.180554 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-58db8760-3695-4f99-ba93-dd1e8d9496e1 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.053522 Oct 04 17:50:20.195218 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 272/570] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:20.202174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7cecf77c-2faf-4969-887a-9e97b02f0d85 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.214895 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7cecf77c-2faf-4969-887a-9e97b02f0d85 tempest-FlavorsV2TestJSON-1412540103 tempest-FlavorsV2TestJSON-1412540103-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017436 Oct 04 17:50:20.227179 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 273/571] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:20.255227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:20.352989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.353716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:20.361181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.362090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.364386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.366133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.367502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.369800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.149931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:21.160649 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b87630c-5659-4e75-9582-2e009c6517f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.811526 Oct 04 17:50:21.174461 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 274/572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:21.786061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-556631484", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:21.901731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:22.033487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d9c51b3-6dec-43c4-90ed-505d33fa0194 tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10433 microversion: 2.1 time: 11.724398 Oct 04 17:50:22.035184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 299/573] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10433 bytes in 11727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:22.041974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.042943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:22.062933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.063845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.064560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.070337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.071238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.073045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.241252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:22.256676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:22.258193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:22.259417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b7c8cd0-404c-48cc-80fe-1115d3f75e2a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1319 microversion: 2.25 time: 0.222956 Oct 04 17:50:22.259972 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 300/574] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:22.300263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a079fe5d-a282-49a9-898b-d7ff7bbc49ab tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] Calling method '.version_select at 0x7f6341d8e160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.715097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:22.715683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:22.717796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:22.718447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:22.719118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:22.737908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.738768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.739473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.742345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.743177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.744778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.799192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:22.821413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:22.860932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:22.880140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:23.047414 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7bc7e565-a54d-4641-a247-62fea123557e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868106 Oct 04 17:50:23.050696 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 275/575] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:23.093758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.099750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:23.122408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.123243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.124071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.124973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.125613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.126209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.460372 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a079fe5d-a282-49a9-898b-d7ff7bbc49ab tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.169857 Oct 04 17:50:23.467760 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 301/576] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:23.474949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:23.497728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.498041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.500139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.563268 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] Creating event network-changed:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h2-831193-17 Oct 04 17:50:23.618049 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8b57f356-a07d-44e0-94a6-921bff5a6239 req-6efd672f-16d5-4d67-8499-21bca8eb6124 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148162 Oct 04 17:50:23.629029 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 302/577] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:23.678280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e8ba595-4481-4c67-8793-1a7f59be6ece tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.691680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e8ba595-4481-4c67-8793-1a7f59be6ece tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:23.872229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e8ba595-4481-4c67-8793-1a7f59be6ece tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:23.879746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e8ba595-4481-4c67-8793-1a7f59be6ece tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1216 microversion: 2.1 time: 0.247839 Oct 04 17:50:23.888072 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 303/578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1216 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:23.897469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.898080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:23.921353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.921863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.922308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.923059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.923519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.923952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.925704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:23.942224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55dd2143-43b0-4c3f-9a26-ba564944cbfd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.888322 Oct 04 17:50:23.944261 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 276/579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:23.964866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eeeb17bd-fb81-49af-80a3-f3d702216cff tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] Calling method '.version_select at 0x7f6341f87e50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:24.635721 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eeeb17bd-fb81-49af-80a3-f3d702216cff tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4ba84147-36ed-4702-a499-7247b3d29efa" status: 202 len: 0 microversion: 2.1 time: 0.686313 Oct 04 17:50:24.636313 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 277/580] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:23 2022] DELETE /compute/v2.1/os-security-groups/4ba84147-36ed-4702-a499-7247b3d29efa => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:24.646664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-773f49fd-956a-42d8-a415-329adaecd2f6 tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] Calling method '.version_select at 0x7f6341f87ca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.000192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.013460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.017650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.024125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58ba004b-2611-456a-ba0a-4f3062760b8d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 1.134535 Oct 04 17:50:25.024950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 304/581] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:25.152649 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-773f49fd-956a-42d8-a415-329adaecd2f6 tempest-SecurityGroupsTestAdminJSON-1691223512 tempest-SecurityGroupsTestAdminJSON-1691223512-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/57211140-e03b-4fd7-8495-d249ba6a186f" status: 202 len: 0 microversion: 2.1 time: 0.509996 Oct 04 17:50:25.153230 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 278/582] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:24 2022] DELETE /compute/v2.1/os-security-groups/57211140-e03b-4fd7-8495-d249ba6a186f => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:50:25.161493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.162035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:25.179551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.180304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.181207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.183483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.187816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.188278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.293215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6210af3-3c67-46b5-a274-b54234e66cf0 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Calling method '.version_select at 0x7f6341e42310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.301127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.303380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:25.316192 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-84ef5be4-c6d6-43fd-a3df-e4d993904449 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1268 microversion: 2.1 time: 0.158741 Oct 04 17:50:25.332967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 279/583] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:25 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:25.342780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c6210af3-3c67-46b5-a274-b54234e66cf0 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:25.348805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.349427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:25.361827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.363357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.364853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.365972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.366451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.366982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6210af3-3c67-46b5-a274-b54234e66cf0 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/869c7f65-8267-459d-b0b8-ca9117779f3a/metadata/os_distro HTTP/1.1 Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:50:25.384588 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'image_id': '869c7f65-8267-459d-b0b8-ca9117779f3a', 'id': 'os_distro'} Oct 04 17:50:25.385979 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:25.386752 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 869c7f65-8267-459d-b0b8-ca9117779f3a Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:25.387869 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 869c7f65-8267-459d-b0b8-ca9117779f3a could not be found. Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:25.388987 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:25.390051 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.392999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6210af3-3c67-46b5-a274-b54234e66cf0 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:25.394072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6210af3-3c67-46b5-a274-b54234e66cf0 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "DELETE /compute/v2.1/images/869c7f65-8267-459d-b0b8-ca9117779f3a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.368134 Oct 04 17:50:25.395116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 305/584] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 17:50:25 2022] DELETE /compute/v2.1/images/869c7f65-8267-459d-b0b8-ca9117779f3a/metadata/os_distro => generated 62 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:25.413097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc153bb9-01bc-4d74-a0ac-bf70cb13d130 tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] Calling method '.version_select at 0x7f6341dca3a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.911591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.936397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a2aefd6-dac6-4a25-b880-251b0d172524 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.600945 Oct 04 17:50:25.939295 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 280/585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:25 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:25.958401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33e79eb3-48c7-4ed9-8f10-5fcf04a91f6a tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Calling method '.version_select at 0x7f6341e56e50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.005549 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-33e79eb3-48c7-4ed9-8f10-5fcf04a91f6a tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33e79eb3-48c7-4ed9-8f10-5fcf04a91f6a tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/images/37cc4736-a96b-4e16-9ef9-0dc9ae89feec/metadata/os_version HTTP/1.1 Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:26.010338 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'image_id': '37cc4736-a96b-4e16-9ef9-0dc9ae89feec', 'id': 'os_version'} Oct 04 17:50:26.011702 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:26.012468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37cc4736-a96b-4e16-9ef9-0dc9ae89feec Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:26.014027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37cc4736-a96b-4e16-9ef9-0dc9ae89feec could not be found. Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:26.015212 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:26.016272 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.019319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33e79eb3-48c7-4ed9-8f10-5fcf04a91f6a tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:26.020498 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-33e79eb3-48c7-4ed9-8f10-5fcf04a91f6a tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "GET /compute/v2.1/images/37cc4736-a96b-4e16-9ef9-0dc9ae89feec/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.076394 Oct 04 17:50:26.021582 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 281/586] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 17:50:25 2022] GET /compute/v2.1/images/37cc4736-a96b-4e16-9ef9-0dc9ae89feec/metadata/os_version => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:26.027932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-182157964", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "1901294572", "adminPass": "***", "networks": [{"uuid": "c1a98b93-57dc-41a0-a33e-3b11a477943e"}], "security_groups": [{"name": "tempest-securitygroup--724195362"}], "key_name": "tempest-keypair-1942937255", "user_data": "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:26.198748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] validate_networks() for [('c1a98b93-57dc-41a0-a33e-3b11a477943e', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:26.411027 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc153bb9-01bc-4d74-a0ac-bf70cb13d130 tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/80086597-7e03-44d9-a5dd-99eca1bef2fc" status: 202 len: 0 microversion: 2.1 time: 1.014529 Oct 04 17:50:26.411760 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 306/587] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:25 2022] DELETE /compute/v2.1/os-security-groups/80086597-7e03-44d9-a5dd-99eca1bef2fc => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:26.417819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cc0faee-e909-45c7-8ecc-1e92819a5776 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Calling method '.version_select at 0x7f6341de3dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.468016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7cc0faee-e909-45c7-8ecc-1e92819a5776 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cc0faee-e909-45c7-8ecc-1e92819a5776 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/images/43d98d2f-fa3a-4732-90f0-25a8edc9f08f/metadata HTTP/1.1 Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:50:26.471541 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'image_id': '43d98d2f-fa3a-4732-90f0-25a8edc9f08f'} Oct 04 17:50:26.473079 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:26.474105 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 43d98d2f-fa3a-4732-90f0-25a8edc9f08f Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:26.475816 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43d98d2f-fa3a-4732-90f0-25a8edc9f08f could not be found. Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:26.478256 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:26.482050 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:50:26.492550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cc0faee-e909-45c7-8ecc-1e92819a5776 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:26.494031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cc0faee-e909-45c7-8ecc-1e92819a5776 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "GET /compute/v2.1/images/43d98d2f-fa3a-4732-90f0-25a8edc9f08f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080647 Oct 04 17:50:26.495448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 307/588] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:50:26 2022] GET /compute/v2.1/images/43d98d2f-fa3a-4732-90f0-25a8edc9f08f/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:26.522530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.531290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:26.567401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.569579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.570235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.572183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.576358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.599196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.177742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:27.196347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:27.198846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:27.200177 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-101ad4c4-9544-4a68-94e2-a51baca13dd8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 0.703578 Oct 04 17:50:27.216530 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 308/589] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:26 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:27.221608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:27.223472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:27.234968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.235352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.235802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.236530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.236992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.238006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.287263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:27.287750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:27.288352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:27.289051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:27.289561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:27.337759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.342603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.343253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.348647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.352521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.355477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.381422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:27.392760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0632be5-f15e-47c0-8791-6f4b4297dc85 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1274 microversion: 2.1 time: 0.187868 Oct 04 17:50:27.396802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 309/590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:27 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:27.406834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a28377e-093f-437e-9219-b24ffb1b9aaa tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] Calling method '.version_select at 0x7f6341d98160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:27.422397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for project 67f8b905a51742a18aea0297cd1f119d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:27.435249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for user 51f1d73e7fbc42ecafb89f0875d5d70d and project 67f8b905a51742a18aea0297cd1f119d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:27.458202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:27.460445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:27.551640 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c4edabed-1e27-4d0f-8f04-096f8acc8491 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.528426 Oct 04 17:50:27.554067 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 282/591] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:27.566044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa1e9b1-7158-42b0-9640-5162ae82e1d7", "tag": "c8ff3d05-8685-46f1-9de7-bddad808637d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:27.619810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.620836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.623507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.643900 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] Creating event network-changed:c8ff3d05-8685-46f1-9de7-bddad808637d for instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 on n-h1-831193-17 Oct 04 17:50:27.656907 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-07d64a34-3a62-4bfa-8f48-cfa644ce6c43 req-35eeef96-d264-487b-8ea4-651c01b6b7fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099687 Oct 04 17:50:27.659570 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 283/592] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:27.667064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-45e79bb8-e1bf-4b62-a555-0bf7596b9459 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Action: 'update_all', calling method: .version_select at 0x7f6341e75ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:27.728729 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-45e79bb8-e1bf-4b62-a555-0bf7596b9459 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-45e79bb8-e1bf-4b62-a555-0bf7596b9459 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/images/94b765de-7e9a-44c6-9ee5-5083d289e282/metadata HTTP/1.1 Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 57 Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:27.731849 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:50:27.733114 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'image_id': '94b765de-7e9a-44c6-9ee5-5083d289e282', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:27.733938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 94b765de-7e9a-44c6-9ee5-5083d289e282 Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:27.735156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94b765de-7e9a-44c6-9ee5-5083d289e282 could not be found. Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:27.736305 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:27.737403 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:27.738600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-45e79bb8-e1bf-4b62-a555-0bf7596b9459 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:27.738600 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-45e79bb8-e1bf-4b62-a555-0bf7596b9459 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "PUT /compute/v2.1/images/94b765de-7e9a-44c6-9ee5-5083d289e282/metadata" status: 404 len: 62 microversion: 2.1 time: 0.075096 Oct 04 17:50:27.743055 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 284/593] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:50:27 2022] PUT /compute/v2.1/images/94b765de-7e9a-44c6-9ee5-5083d289e282/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:27.772895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:27.777435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:27.803265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.803720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.805332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.806085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.806548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.809194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.268185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:28.280138 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1263f077-f146-4047-a5db-fe9092b21e4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.537297 Oct 04 17:50:28.288663 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 285/594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:27 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:28.300126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-92fd965a-1ff3-46b7-8b0c-ff86f24c7861 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:28.301071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-92fd965a-1ff3-46b7-8b0c-ff86f24c7861 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:28.421679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-92fd965a-1ff3-46b7-8b0c-ff86f24c7861 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:28.431926 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-92fd965a-1ff3-46b7-8b0c-ff86f24c7861 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1264 microversion: 2.1 time: 0.137347 Oct 04 17:50:28.432965 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 286/595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:28 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:28.455370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93f5f41e-d005-486c-ad68-b019a6f5af64 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Action: 'update', calling method: .version_select at 0x7f6341e75040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:28.486920 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-93f5f41e-d005-486c-ad68-b019a6f5af64 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93f5f41e-d005-486c-ad68-b019a6f5af64 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/images/f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a/metadata/os_distro HTTP/1.1 Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 30 Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:28.490228 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: {"meta": {"os_distro": "alt"}} Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:50:28.491525 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'image_id': 'f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:28.492314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:28.493301 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a could not be found. Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:28.495704 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:28.497749 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:28.499269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93f5f41e-d005-486c-ad68-b019a6f5af64 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:28.499269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-93f5f41e-d005-486c-ad68-b019a6f5af64 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "PUT /compute/v2.1/images/f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.042572 Oct 04 17:50:28.499269 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 287/596] 10.222.0.33 () {60 vars in 1310 bytes} [Tue Oct 4 17:50:28 2022] PUT /compute/v2.1/images/f953d3eb-6c09-45ca-8bd4-b62f5fcffd3a/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:28.506842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:28.507503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:28.533113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:28.534102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:28.534362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.535286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:28.535937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:28.536524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.117971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a28377e-093f-437e-9219-b24ffb1b9aaa tempest-SecurityGroupsTestAdminJSON-121505259 tempest-SecurityGroupsTestAdminJSON-121505259-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/bcd04d69-60d8-46a3-9252-5147b9d63e76" status: 202 len: 0 microversion: 2.1 time: 1.719859 Oct 04 17:50:29.119569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 310/597] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:27 2022] DELETE /compute/v2.1/os-security-groups/bcd04d69-60d8-46a3-9252-5147b9d63e76 => generated 0 bytes in 1722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:29.129263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:29.130040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:29.158388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:29.165894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.166560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.167860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.168701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.170650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.171873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.187244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:29.189068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:29.193756 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a3b17138-068a-4b32-810a-aef30fa9a11f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 0.690861 Oct 04 17:50:29.221215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 288/598] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:28 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:29.234795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5453d186-7951-432a-9292-2bbd5fad1b60 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Action: 'create', calling method: .version_select at 0x7f6342286040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:29.327982 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5453d186-7951-432a-9292-2bbd5fad1b60 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] HTTP exception thrown: Image not found. Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5453d186-7951-432a-9292-2bbd5fad1b60 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Request method failure captured: Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/images/9e398eb1-19e0-406a-9dbf-efe3f144017c/metadata HTTP/1.1 Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 57 Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJgkoeV6sKFzCLg8vS_rWyai-c3v3L0lAQeU9KJx0daLzxbCrlWfKcDqkh7PLV2y2N3bTAZgParg71rkzsoKJwpFIohnr280vev4004Cu4L62ohINXOupQxy95aJhLUrvKnvjt8kGzovmY85EmjW42J2aUwfmb5Dri5MNOVgEELdOo Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:50:29.337064 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dad4df8fee9a4c52b8bb181372d0965f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dad4df8fee9a4c52b8bb181372d0965f Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320 Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b36eda9ff0f4b229f55bdaf63d0bd7a Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2042723320-project Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:50:29.338735 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'image_id': '9e398eb1-19e0-406a-9dbf-efe3f144017c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:29.339755 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e398eb1-19e0-406a-9dbf-efe3f144017c Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:29.341638 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e398eb1-19e0-406a-9dbf-efe3f144017c could not be found. Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:29.343059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:29.344409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:50:29.345980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5453d186-7951-432a-9292-2bbd5fad1b60 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:29.345980 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5453d186-7951-432a-9292-2bbd5fad1b60 tempest-ImagesMetadataNegativeTestJSON-2042723320 tempest-ImagesMetadataNegativeTestJSON-2042723320-project] 10.222.0.33 "POST /compute/v2.1/images/9e398eb1-19e0-406a-9dbf-efe3f144017c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.122115 Oct 04 17:50:29.347097 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 289/599] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 17:50:29 2022] POST /compute/v2.1/images/9e398eb1-19e0-406a-9dbf-efe3f144017c/metadata => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:29.424856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:29.425942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:29.460731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.472216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.475304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.483467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.484118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.489360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.708408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:29.717733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c9dc570e-2789-440a-b859-40976fcf1e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1274 microversion: 2.1 time: 0.597160 Oct 04 17:50:29.718332 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 311/600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:29 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1274 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:29.730877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:29.741739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:29.768476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.768994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.769441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.770180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.770646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.771115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:30.168287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:30.178321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab3bb768-bb87-4847-9601-e4e44b66325f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1316 microversion: 2.1 time: 0.458904 Oct 04 17:50:30.178903 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 312/601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:29 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:30.226650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:30.227686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:30.240667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.248372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.250342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:30.252432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.254654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.255812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:30.347925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:30.356799 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-52ee57b5-3a54-41d0-9640-1181a4ec8889 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 1.008754 Oct 04 17:50:30.358221 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 290/602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:29 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:30.745722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:30.747958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:30.800873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.808167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.808646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:30.813107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.813845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.815705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.256357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.290494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.292292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.302908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4404d303-586b-41da-b9c2-99ad411c37c2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 1.082500 Oct 04 17:50:31.304877 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 313/603] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:30 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:50:31.321133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.322154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.337596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.343446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.346554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.355664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.357050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.363355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.396584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.407333 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e3771b0c-3f5d-490a-bdc1-a1a1b270a420 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.667008 Oct 04 17:50:31.423520 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 291/604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:30 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:31.431085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.435261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.441712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.442627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.443311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.444238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.444880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.445677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.693669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.704758 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e06e9bf5-df0f-4ce2-8c9b-f68789dbc1d4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.279524 Oct 04 17:50:31.705608 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 292/605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:31.743639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.759128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07f12447-0403-4b1b-8191-c2273bfea4ff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1322 microversion: 2.1 time: 0.452606 Oct 04 17:50:31.759885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 314/606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:32.337087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:32.337712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:32.358553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.359077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.359532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.360253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.367507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.372889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.446543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:32.447348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:32.472338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.473829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.474461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.475796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.476469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.477092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.080268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:33.091829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:33.096422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:33.100513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:33.105414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65bc07e9-932a-4df9-8e9a-3c6b604af3da tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.666221 Oct 04 17:50:33.109738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3c959d6b-370c-4393-bc5a-be394e4c1942 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 0.778799 Oct 04 17:50:33.110670 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 293/607] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:32 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:33.110987 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 315/608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:32 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:33.125836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:33.126768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:33.134397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:33.135630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:33.140138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.140663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.141121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.143098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.143586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.144214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.144868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.146109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.147924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.150642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.151435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.152097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.327554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:33.343205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd5d9dda-0706-4bf8-9400-9edcc4d71453 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1322 microversion: 2.1 time: 0.228915 Oct 04 17:50:33.345220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 316/609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:33 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:33.357816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "name": "network-vif-plugged", "status": "completed", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:33.400702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.401636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.401747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.449208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] Creating event network-vif-plugged:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h2-831193-17 Oct 04 17:50:33.472733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-86565fae-8077-4b91-8cbb-0427e17c4eec req-2001fcd8-526e-4fbb-b35b-0008bcee8dce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121322 Oct 04 17:50:33.473793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 317/610] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:33.999836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:34.014109 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e72de67e-ece6-4341-8014-23b20be4bbb3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.902270 Oct 04 17:50:34.015301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 294/611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:33 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:34.147926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.150267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.153946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:34.155948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:34.168422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:34.177159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.177664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.189706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.190316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.192265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.194469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.195211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.196286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.196945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.199877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.200604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.201376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.737622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:34.750602 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5aef7f81-29b9-4323-a50d-a7b01c44d65d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.611952 Oct 04 17:50:34.751459 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 295/612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:34.779253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.781300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:34.797957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.798652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.799317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.800023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.811776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.812491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.114236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.128381 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-650f7c5d-cbce-4be8-a0ef-4b2dff50ae48 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.357700 Oct 04 17:50:35.131451 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 296/613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:35.295931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.318534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.324742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.328707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9aedf463-9dc0-4101-8223-380b328aa1c9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 1.195975 Oct 04 17:50:35.354035 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 318/614] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:35.364346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:35.365305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:35.380115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.391843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.392692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.393663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.394351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.394997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.848814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62b5305c-f691-4313-b513-cd6468092a38 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Action: 'create', calling method: .version_select at 0x7f6341e66e50>, body: {"keypair": {"name": "tempest-keypair-1447655907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkIQLRsKgyNuR3WmjiFoMkNsSL7xUn4BIhDHWqht/gah78PyszW9Uz+DihUk2cfjk8d60htxnX4G7iS0FIEQ5dmg9ZVTfiTgqNXiLNSohMeRdl8GDFMINgJcgc7EZAHrA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:35.886176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.889153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-62b5305c-f691-4313-b513-cd6468092a38 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Getting quotas for project 60536b45e94840a78065a08a9cce0eb7. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:35.895142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39aa2253-804f-4d72-9fc0-69d4197af28d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1313 microversion: 2.1 time: 0.539551 Oct 04 17:50:35.898328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-62b5305c-f691-4313-b513-cd6468092a38 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Getting quotas for user 86f34bf323cd41a489655373a9123b06 and project 60536b45e94840a78065a08a9cce0eb7. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:35.899159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 319/615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:35 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:35.912289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b565ff-d036-43bf-bd95-f99596021e22", "tag": "36716cdb-dade-4de6-8cf3-29c656891aef"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:35.953941 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62b5305c-f691-4313-b513-cd6468092a38 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.821224 Oct 04 17:50:35.955478 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 297/616] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:50:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:35.956014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.956559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.957003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.969349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:35.971112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:35.982882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.983904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.984654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.985977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.986892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.988007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.000751 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] Creating event network-changed:36716cdb-dade-4de6-8cf3-29c656891aef for instance 15b565ff-d036-43bf-bd95-f99596021e22 on n-h1-831193-17 Oct 04 17:50:36.015773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8cf37288-05f5-4351-95e2-3865f106ca22 req-ab500acb-caf3-4ea1-9a87-ca8294953dfe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109007 Oct 04 17:50:36.023153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 320/617] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:36.156121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:36.157345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:36.171144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.171679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.172110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.172847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.173308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.173737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.698741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:36.709132 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a9dc44d4-c736-457d-8f15-10c127dc9f53 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.750765 Oct 04 17:50:36.716743 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 298/618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:35 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:36.728556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:36.730567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:36.738223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.739127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.739768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.740723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.741349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.741948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.909014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:36.925348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7ff77ffb-7cd4-4191-bb5f-5fc3b97a4eb3 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.772290 Oct 04 17:50:36.927714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 321/619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:36 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:36.944813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa1e9b1-7158-42b0-9640-5162ae82e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "c8ff3d05-8685-46f1-9de7-bddad808637d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:36.986162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.987324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.988415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.005540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] Creating event network-vif-plugged:c8ff3d05-8685-46f1-9de7-bddad808637d for instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 on n-h1-831193-17 Oct 04 17:50:37.031006 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b5fe05ae-ae1e-4c71-a3f3-20ce37a90e65 req-74fb9ca7-e168-4e63-ab1d-e933930f1c74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092851 Oct 04 17:50:37.038967 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 322/620] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:37.056318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:37.058695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:37.079852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.082996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.083792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.086519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.089129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.093093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.281511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:37.303896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:37.314340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:37.319601 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e7cab95-7442-4f54-a5b0-4fcbb6098c0e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 0.605181 Oct 04 17:50:37.320222 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 299/621] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:36 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:37.735885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:37.737602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:37.741686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:37.750396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.751395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.752388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.753413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.754602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.755428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.781517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:37.793948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15480af6-f0d0-4cb6-9b47-7593febca4b7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1463 microversion: 2.1 time: 0.752611 Oct 04 17:50:37.809310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 323/622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:37 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1463 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:37.836209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:37.840296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:37.849952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.850610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.851552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.853088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.853780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.854314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.067700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:38.082940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Old instance type m1.heat2, new instance type m1.heat {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 17:50:38.096473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:38.097470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:38.098234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:38.098813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:38.099461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:38.196952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:38.254284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:38.273764 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-468ee837-5b5a-429f-ade4-66d80c60d124 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.541198 Oct 04 17:50:38.274702 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 300/623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:37 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:38.300264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.301930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:38.313142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.313643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.314082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.314805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.315296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.315728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.332574 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a261324e-a4a8-42dc-a9f3-ef4b37e2bf6a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa/action" status: 202 len: 0 microversion: 2.1 time: 0.495015 Oct 04 17:50:38.340091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 324/624] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:37 2022] POST /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:38.350632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c43453d0-13d1-4437-b551-7d450ab64c4b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e4e0d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.424305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c43453d0-13d1-4437-b551-7d450ab64c4b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4" status: 200 len: 662 microversion: 2.1 time: 0.080005 Oct 04 17:50:38.425306 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 325/625] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:38.437758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db13119-c61f-4371-b78b-9957079b8055", "tag": "9625451c-873a-413d-9044-94e317965aff"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:38.459058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.459971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.459971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.493197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] Creating event network-changed:9625451c-873a-413d-9044-94e317965aff for instance 1db13119-c61f-4371-b78b-9957079b8055 on n-h2-831193-17 Oct 04 17:50:38.509235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cdb56eb2-2b87-4886-a4ba-b9d4da3a5fad req-90bfcd59-3d0d-473e-b786-b91cceaca978 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082643 Oct 04 17:50:38.509876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 326/626] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:38.524916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.525624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:38.537376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.537859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.538432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.539316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.539728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.540142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.725967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:38.735168 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-adb521cb-2424-4233-9783-2887a935ccf5 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.458814 Oct 04 17:50:38.737024 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 301/627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:38.742265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.744401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:38.755407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.756056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.756571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.758796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.759589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.760463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.062674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.082955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.085210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.087835 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-637feea8-98e4-4bb0-ae5f-1edbd5bb2761 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1361 microversion: 2.25 time: 0.349288 Oct 04 17:50:39.110966 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 302/628] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:39.118289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bffd9716-5988-492c-8edd-dc968d1dc36f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e56280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.179280 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bffd9716-5988-492c-8edd-dc968d1dc36f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4" status: 200 len: 662 microversion: 2.1 time: 0.066650 Oct 04 17:50:39.212253 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 303/629] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4 => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:39.300327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.301896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:39.312808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.313704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.314435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.315690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.316257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.317010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.592081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.596014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:39.613178 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01ab7093-08f1-4c86-871f-04541b73ac3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.317325 Oct 04 17:50:39.617347 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 304/630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:39.699144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.712143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0c4d51b-d367-481a-bb82-233d9a369701 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1472 microversion: 2.1 time: 1.191356 Oct 04 17:50:39.712736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 327/631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1472 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:39.760052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.760880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:39.780568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.781551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.782454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.783366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.784177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.784792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.122820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:40.124068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:40.134342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.136912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.137648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.138596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.139323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.140004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.326726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:40.343974 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b46ee130-971e-4dee-af57-06fdee2dfc2b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.587536 Oct 04 17:50:40.356898 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 305/632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:40.640738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:40.641812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:40.650974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.652844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.654718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.656251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.657113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.658008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.057262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.068245 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8716a2f5-6826-47be-9f91-7808e4ad4409 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.433807 Oct 04 17:50:41.083596 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 306/633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:40 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:41.322661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-463610099", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "35bfa742-c59f-4f7e-a228-2ef392c75418"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:41.407673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] validate_networks() for [('35bfa742-c59f-4f7e-a228-2ef392c75418', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:41.443477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.455006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.459559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.461228 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e06c3779-37c5-4402-8b07-1977ed516bee tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1556 microversion: 2.25 time: 1.342867 Oct 04 17:50:41.462369 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 328/634] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:40 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1556 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:41.468336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:41.469195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:41.478520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.479351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.479985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.480890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.482139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.482771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.532245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:42.553651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6eda03b0-2213-49b1-9da0-cae8efabf7bc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1472 microversion: 2.1 time: 1.089919 Oct 04 17:50:42.560693 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 329/635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:41 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1472 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:42.589983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de7b27cb-ef26-47e6-baa4-7eabdec3eb53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341c36e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:42.669069 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de7b27cb-ef26-47e6-baa4-7eabdec3eb53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a" status: 200 len: 661 microversion: 2.1 time: 0.096339 Oct 04 17:50:42.681343 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 330/636] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:42 2022] GET /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a => generated 661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:42.687389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:42.688125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:42.701055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.701796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.702404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.703374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.704307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.704922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.898846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:42.899395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:42.900025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:42.900556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:42.901072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:42.903562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:42.942281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.943270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.943778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.944722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.945196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.945675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.983468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:42.990209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for user 6f2ae8c47aca4786b8bde4da30d84158 and project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:43.009869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:43.014027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:43.093039 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2294e546-b8ed-4334-a4a8-02b139a16615 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008202 Oct 04 17:50:43.105163 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 307/637] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:43.124297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.126840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.137516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.138172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.138769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.139883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.140513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.141093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.220543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:43.234525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbfcca10-42ea-4980-8571-bffa409b56cf tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.551582 Oct 04 17:50:43.235807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 331/638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:42 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:43.273266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.274477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.291716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.292770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.294223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.298096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.300092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.302006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.323997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:43.340987 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6de1ed53-baa8-4a20-9510-c6d88491711e tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 2050 microversion: 2.25 time: 0.226318 Oct 04 17:50:43.355281 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 308/639] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 2050 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:43.355281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cd91b916-8e91-443f-871c-0b453a511d5a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e66d30>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.438847 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cd91b916-8e91-443f-871c-0b453a511d5a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a" status: 200 len: 661 microversion: 2.1 time: 0.092816 Oct 04 17:50:43.443327 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 309/640] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:43.465333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3c06cb6-859c-440c-b343-10a8ba172cdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.467015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b3c06cb6-859c-440c-b343-10a8ba172cdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.606892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3c06cb6-859c-440c-b343-10a8ba172cdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:43.632281 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3c06cb6-859c-440c-b343-10a8ba172cdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1210 microversion: 2.1 time: 0.184399 Oct 04 17:50:43.653665 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 310/641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:43.674581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.675612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.701401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.704789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.705481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.708399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.711906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.712654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.979770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:44.007741 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea5d1b58-a28f-4725-aaf3-f95b7972f095 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 2050 microversion: 2.25 time: 0.351970 Oct 04 17:50:44.008878 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 311/642] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 2050 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:44.014404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.015297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:44.022105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.022788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.023973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.024894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.025513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.026127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.073221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.089035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2dc24b66-0512-4ea1-b78b-e3cd3059e915 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.838630 Oct 04 17:50:44.107266 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 332/643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:44.112982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.145272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.146081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.146866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.155307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.160419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.161140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.413016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.427647 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e177462-6ff1-46aa-bba8-10b0f65464f1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.417195 Oct 04 17:50:44.429328 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 312/644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:44.450113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.450857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:44.459297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.460083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.461006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.462452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.463240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.463922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.617950 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db72aee8-3449-4c0b-8e88-3e87115bd052 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.508887 Oct 04 17:50:44.624293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 333/645] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:44.631104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-246359158", "imageRef": "75843b18-46b7-4061-abed-8407f9fc3714", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1377af26-59b8-4480-9220-2ed8492e7de0"}], "security_groups": [{"name": "tempest-securitygroup--1548365331"}], "key_name": "tempest-keypair-1447655907", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:44.821040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.834587 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ef6c1843-e2cb-4e92-9165-c6ddefd37221 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.402587 Oct 04 17:50:44.835815 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 313/646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:44.845726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:44.846572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:44.859156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.859905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.860600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.861814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.862469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.863432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.956796 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83007b75-33f1-4e24-b34b-19bc56fbadb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7/action" status: 202 len: 0 microversion: 2.25 time: 0.119178 Oct 04 17:50:44.969812 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 314/647] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:50:44 2022] POST /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:44.980930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.982641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:44.993767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.995187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.997287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.999369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.000892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.001937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.090009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] validate_networks() for [('1377af26-59b8-4480-9220-2ed8492e7de0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:45.309829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.326013 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78ae09cd-871a-43e5-8d70-ccb2813c8d0d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1262 microversion: 2.1 time: 0.353937 Oct 04 17:50:45.327148 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 315/648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1262 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:45.333563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.334674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:45.344859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.345707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.346372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.355795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.356686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.357607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.644812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:45.664729 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd43ef96-466e-4200-ad66-bb03bbfd5eb0 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 2055 microversion: 2.25 time: 0.335257 Oct 04 17:50:45.665876 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 316/649] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:45 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 2055 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:45.695359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.696211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:45.703400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.704044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.704490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.705217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.705721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.706205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.072895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:46.083054 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a01a85ae-d359-4e67-9d46-d46c499e1352 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.396408 Oct 04 17:50:46.083971 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 317/650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:45 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:46.100462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5ec02cad-2de8-4e81-9698-c44e0636484d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341f87ca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.157256 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5ec02cad-2de8-4e81-9698-c44e0636484d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad" status: 200 len: 661 microversion: 2.1 time: 0.072178 Oct 04 17:50:46.158967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 318/651] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:46.163855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.164693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:46.174334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.174996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.175594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.176422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.177151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.177683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.416454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:46.432327 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6474d4d1-b44f-489e-9c81-07f467b81b90 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.270354 Oct 04 17:50:46.451404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 319/652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:46.465009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.465679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:46.481565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.482273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.483906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.484635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.485095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.485521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.713086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:46.713582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:46.713958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:46.714361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:46.714770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:46.728678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.731783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.734299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.736470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.736994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.737429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.769936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Getting quotas for project 60536b45e94840a78065a08a9cce0eb7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:46.776802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Getting quotas for user 86f34bf323cd41a489655373a9123b06 and project 60536b45e94840a78065a08a9cce0eb7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:46.791439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:46.794755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75843b18-46b7-4061-abed-8407f9fc3714',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:46.836715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:46.861351 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4bd183ce-b76a-47da-b54a-545897b3ef2f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.406302 Oct 04 17:50:46.863769 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 320/653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:46.871046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ca0da3a-3604-4988-908c-007cbd4cd872 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.245196 Oct 04 17:50:46.872012 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 334/654] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:46.882777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6151957-2247-4f1f-8ad7-342040ea8bbe tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e75160>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.900800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.901580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:46.923639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.924146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.924596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.925321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.925777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.926208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.937968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6151957-2247-4f1f-8ad7-342040ea8bbe tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad" status: 200 len: 661 microversion: 2.1 time: 0.072716 Oct 04 17:50:46.938550 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 321/655] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:46.944548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b565ff-d036-43bf-bd95-f99596021e22", "name": "network-vif-plugged", "status": "completed", "tag": "36716cdb-dade-4de6-8cf3-29c656891aef"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:46.971570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.973329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.984041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.009208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] Creating event network-vif-plugged:36716cdb-dade-4de6-8cf3-29c656891aef for instance 15b565ff-d036-43bf-bd95-f99596021e22 on n-h1-831193-17 Oct 04 17:50:47.038110 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f28f0aee-dfb2-42b2-9c77-dd7312e40d23 req-29eff97e-81d2-4263-811c-0bbae9a8142e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098284 Oct 04 17:50:47.038717 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 322/656] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:47.066913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.067645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:47.081405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.082071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.082329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.083141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.083579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.083997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.288854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.318853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:47.319455 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fcec8a84-172d-4862-a314-8da80df40a12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1268 microversion: 2.1 time: 0.439189 Oct 04 17:50:47.320497 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 335/657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1268 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:47.327247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d388037-ebd4-47f9-bb81-173a2b8c7128 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.332764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d388037-ebd4-47f9-bb81-173a2b8c7128 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:47.359665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6e158664-7e87-48c9-b67a-e50bb7f708ad tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 2035 microversion: 2.25 time: 0.297609 Oct 04 17:50:47.365616 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 323/658] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 2035 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:47.370632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.371270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:47.381358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.382120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.388135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.390572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.393687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.394347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.438743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:47.475780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d388037-ebd4-47f9-bb81-173a2b8c7128 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.487104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d388037-ebd4-47f9-bb81-173a2b8c7128 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1245 microversion: 2.1 time: 0.164258 Oct 04 17:50:47.488983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 336/659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:47.496355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-168653652", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:47.602315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:47.825439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.834235 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ede44fdf-1067-4b1b-9e85-e33c1c525fe7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1316 microversion: 2.1 time: 0.467463 Oct 04 17:50:47.851072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 324/660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:47.860899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831193-17", "block_migration": "auto"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:47.863743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:47.874585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.893007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.894252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.895213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.899169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.901847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.004316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'flavor' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:48.036687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Going to try to live migrate instance to n-h2-831193-17 {{(pid=128771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:50:48.307083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:48.308769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:48.309515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:48.310091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:48.310708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:48.333700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.334191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.334625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.335401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.336036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.336478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.380228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Getting quotas for project 720a616ccdf64ea8bf6dd7d43cd7304d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:48.386071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Getting quotas for user 7c05b59c6c964deab8eb775ca2cb8b15 and project 720a616ccdf64ea8bf6dd7d43cd7304d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:48.401303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:48.415183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:48.437602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:48.498130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1698c9eb-765b-4eb8-a721-9f0e424af7ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002743 Oct 04 17:50:48.499718 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 337/661] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:48.513332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:48.516284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:48.536682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.538287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.541187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.543396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.575807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.582726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:49.228933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:49.272824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a813385-7a56-4020-b070-c0bdb52aa56a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.769477 Oct 04 17:50:49.276249 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 338/662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:48 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:49.291404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:49.292263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:49.311176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:49.311819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:49.312104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:49.318861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:49.324935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:49.326049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.274230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:50.284772 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aaada2a1-471d-4d31-9ddd-70d1eaf99aff tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 1.005719 Oct 04 17:50:50.286270 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 339/663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:49 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:50.294355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:50.295465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:50.302488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.308103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.309028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.310039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.310732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.311437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.906821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:50.929891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d0ddf5d-3237-4317-9ba2-9757433e958b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1310 microversion: 2.1 time: 0.640943 Oct 04 17:50:50.930591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 340/664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:50 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1310 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:50.946640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:50.947668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:50.968459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.968958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.969392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.970103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.970555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.970976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.109647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.124965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ef85493-4573-4514-b7ad-d43c9c94c3b3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1303 microversion: 2.1 time: 0.193035 Oct 04 17:50:51.128436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 341/665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:50 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:51.135729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-877013899", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:51.239342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:51.305946 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d20f6644-4955-4747-ab05-989a4fb6b982 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7/action" status: 202 len: 0 microversion: 2.25 time: 3.466176 Oct 04 17:50:51.310017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 325/666] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:50:47 2022] POST /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7/action => generated 0 bytes in 3471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:51.316589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:51.317472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:51.326167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.326907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.327643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.328743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.329381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.329879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.622863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.636104 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b683655-654a-406f-a987-1705eccefff0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1466 microversion: 2.1 time: 0.321684 Oct 04 17:50:51.638280 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 326/667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:51 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:51.643781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db13119-c61f-4371-b78b-9957079b8055", "name": "network-vif-plugged", "status": "completed", "tag": "9625451c-873a-413d-9044-94e317965aff"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:51.654377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.655287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.655981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.669486 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] Creating event network-vif-plugged:9625451c-873a-413d-9044-94e317965aff for instance 1db13119-c61f-4371-b78b-9957079b8055 on n-h2-831193-17 Oct 04 17:50:51.675332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e10cedec-10ea-4672-80e9-ec59443cfba7 req-fa596423-fb73-4e66-a23d-327278d35ba3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Oct 04 17:50:51.676757 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 327/668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:51.683361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12349714-03d5-4a6d-b094-6ad0ae13ccb8", "tag": "08030174-2cfa-43fb-b31a-652ca7e122d4"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:51.697822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.698634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.699353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.713758 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] Creating event network-changed:08030174-2cfa-43fb-b31a-652ca7e122d4 for instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 on n-h1-831193-17 Oct 04 17:50:51.719785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b2211066-1817-498f-82ec-ee1524a9e633 req-1f20ba8f-b0a5-47db-9d2e-1beee65ed7fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040028 Oct 04 17:50:51.720999 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 328/669] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:51.726608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:51.727569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:51.734853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.735725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.736449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.737563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.738383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.739700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.884603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:51.885250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:51.885877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:51.886519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:51.887100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:51.925438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.930015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.931017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.939151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.940558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.941642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.026951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Getting quotas for project 720a616ccdf64ea8bf6dd7d43cd7304d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:52.043507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Getting quotas for user 7c05b59c6c964deab8eb775ca2cb8b15 and project 720a616ccdf64ea8bf6dd7d43cd7304d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:52.128901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:52.148543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:52.157679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:52.187992 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-663f45b3-ad96-4553-b17d-4005fe2d4746 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.463353 Oct 04 17:50:52.190192 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 329/670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:51 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:52.217429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:52.220800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:52.239798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.241635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.242675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.247144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.248781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.250254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.314605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc7c0005-2cbc-4a1c-ba6a-496dcbf3153c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184348 Oct 04 17:50:52.320174 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 342/671] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:52.335937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:52.339570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:52.361684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.362423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.363136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.364287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.364981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.365648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.715631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:52.748451 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3bbdeb4d-ca73-411a-84fe-353bdb256a41 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1389 microversion: 2.1 time: 0.556241 Oct 04 17:50:52.756020 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 330/672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:52 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1389 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:52.959988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:53.171430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:53.172271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:53.182946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.192698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.194388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.195513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.196158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.196830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.593487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.606515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.612941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.614488 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aac5f97f-126e-4b2d-91f0-9a385baa84ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 1.291128 Oct 04 17:50:53.620083 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 343/673] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:52 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:53.625547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:53.633116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:53.644283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=37 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:53.648396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.649421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.650403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.651391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.652093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.652738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.962048 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dbbf4c2f-078f-4ada-b8a4-a8269dbe1d5b tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1619 microversion: 2.1 time: 1.204627 Oct 04 17:50:53.963284 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 331/674] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:52 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1619 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:53.972876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:53.973504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:53.990356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.994428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.995317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.999580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.000366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.000977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.052704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.067172 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-120d5c37-50a0-447b-abf9-8947386b75bf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1310 microversion: 2.1 time: 0.445453 Oct 04 17:50:54.071607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 344/675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:53 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1310 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:54.086345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.089722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:54.103670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.107848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.109463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.109463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.114770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.115503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.426706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.455775 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6df842a1-829a-4d43-99d2-55f89f14ccc5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1221 microversion: 2.1 time: 0.374466 Oct 04 17:50:54.456631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 345/676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1221 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:54.461901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.462521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:54.495427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.496138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.496744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.498019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.501845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.502518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.664588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.695632 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff74a668-0a50-494d-80f1-1b46fbfb328a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1303 microversion: 2.1 time: 0.724001 Oct 04 17:50:54.705207 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 332/677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:53 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1303 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:54.714255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.715252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:54.752644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.755977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.759430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.764221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.764733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.765180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.027220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.048163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:55.051092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a2448ae-ad3c-4955-875e-531a825b0fb7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.593083 Oct 04 17:50:55.057308 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 346/678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:55.071281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: .version_select at 0x7f63424b83a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-973527727", "policies": ["affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:55.143112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:55.162759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:55.243147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.257383 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-95025f5a-b6ef-4925-997d-340dcec641ea tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1588 microversion: 2.1 time: 0.550977 Oct 04 17:50:55.259963 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 333/679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1588 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:55.269482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:55.274411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:55.285058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.285573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.286022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.286725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:55.286853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.290296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.290841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.296546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:55.329514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3278d36b-b473-4353-b9c6-1881d3726208 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.270811 Oct 04 17:50:55.330829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 347/680] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 17:50:55 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:55.342439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:55.344087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:55.372568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.375334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.387315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.389162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.389897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.390564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.659568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.675084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.679661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.691851 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2394e7cd-49ea-4049-a8b8-2c19cd38cf52 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.430880 Oct 04 17:50:55.693938 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 334/681] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:55 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:55.722047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:55.723343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:55.753984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.754826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.755297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.762987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.763580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.764026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.148172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:56.159489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35ec25a5-9353-4c59-b45f-8d8ab7585108 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1310 microversion: 2.1 time: 0.827181 Oct 04 17:50:56.168483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 348/682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:55 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1310 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:56.186018 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6f387b69-3226-4d99-8da5-6315da792149 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.490665 Oct 04 17:50:56.187383 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 335/683] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:50:55 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055/os-interface => generated 284 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:56.192306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-989555243", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d7f3070d-1ab1-4a1b-a749-91436b3a0808"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:56.196468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:56.197275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:56.215918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.230507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.231142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.233883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.235270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.237845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.327147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:56.806292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:56.814898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1df5f4d9-ba10-4c68-87c4-4d118639b6d9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1275 microversion: 2.1 time: 0.644796 Oct 04 17:50:56.815553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 349/684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:56 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1275 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:56.851677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:56.852299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:56.866781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.867424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.867838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.868543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.868996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.869434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.177809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:57.178803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:57.179838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:57.180764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:57.181940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:57.228296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.229212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.230145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.233058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.234510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.235230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.287627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.312341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.343421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 2 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:57.353172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:57.440257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128771) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 17:50:57.465474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.475615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.506051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:57.568398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.580441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.640882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:57.804623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.815899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.898036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.910391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.990067 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8836b02c-c791-4197-9278-4a3c3bbb97a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.801326 Oct 04 17:50:57.995090 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 336/685] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1806 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 17:50:58.005153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.005785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:58.017163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.017481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.017922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.018627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.019102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.019521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.490842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:58.501682 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-824052b1-aa93-441d-a579-e4ef5b4287c3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1477 microversion: 2.1 time: 0.506423 Oct 04 17:50:58.506891 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 337/686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:57 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1477 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:58.512775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12349714-03d5-4a6d-b094-6ad0ae13ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "08030174-2cfa-43fb-b31a-652ca7e122d4"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:58.541117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.541834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.542554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.570500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] Creating event network-vif-plugged:08030174-2cfa-43fb-b31a-652ca7e122d4 for instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 on n-h1-831193-17 Oct 04 17:50:58.582116 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-17ec9ba5-86ac-4979-bd09-7d3396f7d172 req-95e647e5-837c-4cd3-9a32-54c20921bbb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073575 Oct 04 17:50:58.583050 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 338/687] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:58.594183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.598766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:58.612136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.616160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.616812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.617789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.618985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.620159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.875318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:58.904533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-232deb8d-cbc3-4ab9-91bf-56eeef73ce1d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 2.049808 Oct 04 17:50:58.907622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 350/688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:56 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:58.930237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.961827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:58.986123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.987705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.989813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.990805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.992751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.997850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.499582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.524087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.525940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.527386 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8648715a-64d2-4212-aa91-23e9fe3500e1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.942061 Oct 04 17:50:59.529012 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 339/689] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:58 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:59.534906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa1e9b1-7158-42b0-9640-5162ae82e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ff3d05-8685-46f1-9de7-bddad808637d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:59.570208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.570707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.571184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.592539 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] Creating event network-vif-unplugged:c8ff3d05-8685-46f1-9de7-bddad808637d for instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 on n-h1-831193-17 Oct 04 17:50:59.605143 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0c3b9fdf-737e-4b56-8a47-415951b19a8b req-6d5bfaa1-92db-4e42-ab48-e36359c41ce4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067696 Oct 04 17:50:59.609853 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 340/690] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:59.615593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:59.616834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:59.636540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.639080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.639920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.640945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.643168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.644134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:00.490169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:00.503738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-74f34acb-6951-4cc0-bc7f-2079fc7bc669 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.892416 Oct 04 17:51:00.504708 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 341/691] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:59 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:00.509374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:00.514196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:00.520980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Searching by: {'deleted': False, 'project_id': 'c329d327a97e476581dc870e8e71a712'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:51:00.555022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:00.556280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:00.573766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:00.575123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:00.575792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:00.576514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:00.832528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:51:00.906777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:01.141955 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ff45b4a-eeb9-464e-bec1-7fff0a08cf2d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.636227 Oct 04 17:51:01.148153 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 342/692] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 17:51:00 2022] GET /compute/v2.1/servers => generated 1001 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:01.160899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:01.161591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:01.177211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.178394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.178865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.180727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.181218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.181656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.419111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:01.431510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9c3f21dd-4102-4b83-b6ce-d87969ac9352 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1310 microversion: 2.1 time: 2.518176 Oct 04 17:51:01.432446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 351/693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:58 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1310 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:01.468393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:01.469074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:01.475904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.476425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.476917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.477628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.478078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.478737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.962227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:02.164259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:02.180576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b745a95f-20be-44d1-9e80-329e05d793d0 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.735428 Oct 04 17:51:02.192704 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 352/694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:01 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:02.208143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.212974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.225140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.232953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.235974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.237623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.241412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.247792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.268316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:02.292550 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6f213c8-be4a-4822-8abd-f1e4889320aa tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 1.143117 Oct 04 17:51:02.300179 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 343/695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:01 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:02.322246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.327817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.358114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.358912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.360195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.360950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.361435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.364320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.572664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:02.593963 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7c3fe949-dfb7-443c-9b9d-9e95dda33d16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1276 microversion: 2.1 time: 0.288760 Oct 04 17:51:02.617828 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 344/696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:02.628789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.631186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.642488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.643354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.644047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.644981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.646026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.648530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.054394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.064415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.069615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.078909 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35ca710d-78b4-4bb0-aec6-07e4ea6ce307 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.884894 Oct 04 17:51:03.091977 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 353/697] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:03.105258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa1e9b1-7158-42b0-9640-5162ae82e1d7", "tag": "c8ff3d05-8685-46f1-9de7-bddad808637d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:03.117032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.118018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.119109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.132652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] Creating event network-changed:c8ff3d05-8685-46f1-9de7-bddad808637d for instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 on n-h1-831193-17 Oct 04 17:51:03.138379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-560a26a5-6ecd-4742-9655-53a9cc3c3a54 req-bab72467-4033-4ba4-ac53-586f92f8b94a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044953 Oct 04 17:51:03.140294 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 354/698] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:03.148337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.149308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:03.174124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.177644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.178347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.181452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.185399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.186643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.573626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.598068 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26e314d6-b38b-464d-93ba-e78089f31130 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.972012 Oct 04 17:51:03.617739 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 345/699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:03.631133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:03.682129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.682697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.683653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.716599 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] Creating event network-changed:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:51:03.727593 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-16450db9-8029-44eb-96ea-5d4f2c2622d8 req-92b4ceb1-c386-473d-b92c-45e5606560b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106788 Oct 04 17:51:03.728741 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 346/700] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:03.736635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.737959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:03.747650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.748598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.749198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.750448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.750918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.751562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.899712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.911548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9f46a51-5ab2-448c-954a-f7a7e9741b41 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1491 microversion: 2.1 time: 0.769480 Oct 04 17:51:03.927426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 355/701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:03 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1491 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:03.932697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.933628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:03.940852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.946893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.948632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.949584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.950287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.950891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.698246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:04.711809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6134aa3b-77be-4332-85b0-f4b75a6d8d86 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 200 len: 1588 microversion: 2.1 time: 0.780415 Oct 04 17:51:04.713758 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 356/702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:03 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 1588 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:04.737564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.738376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:04.740750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:04.748071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.748928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.750131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.751297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.753238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.753680 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-745b1af4-9a94-4a7e-8467-3bf1577b4ec1 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 1.020210 Oct 04 17:51:04.754668 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 347/703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:03 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:04.755255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.763304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.775983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:04.784807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.785999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.787200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.800115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.801010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.801680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.118293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:05.136387 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0053c120-5315-4b3e-89c1-83bba71c766c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 0.417479 Oct 04 17:51:05.137992 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 357/704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:05.152280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "name": "network-vif-unplugged", "status": "completed", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:05.176463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.176951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.177382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.205788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Creating event network-vif-unplugged:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h1-831193-17 Oct 04 17:51:05.211906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] Instance 26191c24-da38-413a-a5d0-23de941822aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:51:05.225871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f022792c-6f97-49fe-b498-f828bdb7580e req-bca4cb1a-4357-4cfc-b57e-f3da715c7ca1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084967 Oct 04 17:51:05.226968 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 358/705] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:05.317961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=28 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:05.501114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:05.518163 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d9811a8-6146-4a36-9635-250b1d9e2079 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1276 microversion: 2.1 time: 0.755842 Oct 04 17:51:05.518951 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 348/706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1276 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:05.532038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:05.533607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:05.550859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.552140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.557342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.558636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.559596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.560283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.749568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:05.750774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:05.758164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.758871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.759954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.760923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.761547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.763023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.946656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa7c48d2-7fbf-40ca-ab08-5b06bfc18de0 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1644 microversion: 2.1 time: 0.717730 Oct 04 17:51:05.965363 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 359/707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:05 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1644 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:05.970640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:05.971543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:05.977929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.978659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.979327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.980222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.980830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.981453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.153053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.161329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc67137f-b736-41b4-8496-7ffb7fcdaf0e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.194523 Oct 04 17:51:06.162048 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 360/708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:05 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:06.166487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a271236f-c547-44f0-9916-f884faebc219", "tag": "10d9a6ec-45cc-431b-bce1-58cc29f185a5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:06.176784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.177272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.177709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.189230 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] Creating event network-changed:10d9a6ec-45cc-431b-bce1-58cc29f185a5 for instance a271236f-c547-44f0-9916-f884faebc219 on n-h1-831193-17 Oct 04 17:51:06.194220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-33b8ab07-d413-4fa4-861c-4a16237c6dd4 req-93f94f41-a303-4428-891d-156b8ce4dd72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030913 Oct 04 17:51:06.194830 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 361/709] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:06.200866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cfef55-6ba9-4a00-b36f-e79dae6fd2d0", "tag": "14dec5c6-007e-4a91-ab88-7205693169a8"}, {"name": "network-changed", "server_uuid": "1db13119-c61f-4371-b78b-9957079b8055", "tag": "9625451c-873a-413d-9044-94e317965aff"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:06.211225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.211710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.212223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.227861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Creating event network-changed:14dec5c6-007e-4a91-ab88-7205693169a8 for instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 on n-h1-831193-17 Oct 04 17:51:06.228784 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] Creating event network-changed:9625451c-873a-413d-9044-94e317965aff for instance 1db13119-c61f-4371-b78b-9957079b8055 on n-h2-831193-17 Oct 04 17:51:06.240000 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-09c756bb-8764-49d9-a681-d1e638c87fec req-c283a937-2d8b-4ee5-900f-72df8d144de2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043234 Oct 04 17:51:06.240832 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 362/710] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:06.246014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.247322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.253553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.254050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.254753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.255495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.255958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.256419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.400627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.409476 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c58fed57-c5ed-468a-9e5e-9f7ee1497a64 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.167616 Oct 04 17:51:06.410154 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 363/711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:06.415892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.416579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.420007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.424735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.425466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.426115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.426997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.427642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.428244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.430978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.434264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.435728 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0176abf0-24f5-49c1-944c-bf52bd9cd6f1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.915479 Oct 04 17:51:06.438288 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 349/712] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:05 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:06.443249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.444114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.454909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.456087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.456548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.457282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.457750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.458373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.616159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4bebd2ba-675f-4afe-ab04-8a4e5dd97ca8 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1644 microversion: 2.1 time: 0.204512 Oct 04 17:51:06.630940 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 364/713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1644 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:06.643598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.645218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.654721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.655276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.655721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.657225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.658247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.660114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.731411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.740201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a607489e-f1f1-4662-af53-fa6b295aa5d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1276 microversion: 2.1 time: 0.107788 Oct 04 17:51:06.741993 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 365/714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:06.749771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.754893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.755561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.756213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.757314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.757816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.758280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.777829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:06.788129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9be6e63e-4ad1-49f3-bc41-3662ec8a4036 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044598 Oct 04 17:51:06.789086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 366/715] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:06.801899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831193-17", "block_migration": true, "disk_over_commit": false}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:06.804684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.812039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.812545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.813007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.813748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.814296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.814667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.835403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:06.843784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lazy-loading 'flavor' on Instance uuid 12349714-03d5-4a6d-b094-6ad0ae13ccb8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:06.857073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Going to try to live migrate instance to n-h2-831193-17 {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:51:07.003589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:07.014931 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a3ccd00e-7806-433b-b8ae-e40851b20c4d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 0.575467 Oct 04 17:51:07.023628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 350/716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:07.187176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.188128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:07.199649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.207067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.208638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:07.210255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.211130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.215888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:07.931659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:08.308108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.320426 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1bf1fae5-1f77-4ebf-9bb2-9c78deffe26d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 1.138702 Oct 04 17:51:08.338268 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 351/717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:07 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:08.350291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.351459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:08.359831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.360475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.361025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.361850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.362433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.362974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.722595 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4175117-9590-4209-84db-9bb24decc42f tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8/action" status: 202 len: 0 microversion: 2.1 time: 1.924934 Oct 04 17:51:08.723241 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 367/718] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:06 2022] POST /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8/action => generated 0 bytes in 1926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:51:08.727790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.728588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:08.736885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.737373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.737807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.738507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.738998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.739506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.963454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.972329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.974005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.975321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8dcb348d-85b2-4664-9042-72d978e12330 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.251097 Oct 04 17:51:08.976080 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 368/719] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:08.980802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.981427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:08.988389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.988877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.989504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.990210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.990816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.991436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.016656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.025908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-acfe87db-f11c-4e24-888c-e4eae0d26668 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.683656 Oct 04 17:51:09.026492 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 352/720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:09.033333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.034180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.041645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.042143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.042725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.043474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.044045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.044552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.134871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.143965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7608f9a7-a865-4200-adfb-99cc91d14c88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.166712 Oct 04 17:51:09.144543 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 369/721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:09.149853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15198621-aa1c-402a-85f3-95ae075e2d1b", "tag": "0c39e14a-d57f-4878-92b8-508258ad1564"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:09.160161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.160642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.161071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.171862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] Creating event network-changed:0c39e14a-d57f-4878-92b8-508258ad1564 for instance 15198621-aa1c-402a-85f3-95ae075e2d1b on n-h2-831193-17 Oct 04 17:51:09.176989 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-87de28ba-e913-47f7-b152-e571816fe46a req-10a8ea0b-261c-41a1-b3f6-447c44b9c4b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031106 Oct 04 17:51:09.177687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 370/722] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:09.182817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.183596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.190383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.190926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.191403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.192107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.192569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.193000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.328798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.336792 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e5a6d5b-5821-4e4b-8afd-22bbafff85f2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.157957 Oct 04 17:51:09.337723 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 371/723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:09.348178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.348952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.355443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.356088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.356604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.357392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.357930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.358367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.538878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.547603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86183747-279d-460d-b57c-130ddc1c8e39 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.203356 Oct 04 17:51:09.548190 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 372/724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:09.658126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-plugged", "status": "completed", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:09.669621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.670203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.670705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.686284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] Creating event network-vif-plugged:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:51:09.691619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4f2a7446-ff86-4311-971d-81ae20a32c01 req-718dee90-e885-40a3-ac72-c32094fbb3b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Oct 04 17:51:09.692661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 373/725] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:09.884519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.896656 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-714fa19d-6f93-49ac-874f-5dbcf8fb801d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 0.868326 Oct 04 17:51:09.897247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 353/726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:10.002710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.003570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.014869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.015713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.016840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.018407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.019074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.023893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.050495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.051957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.061636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.062149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.062821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.063750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.064373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.064807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.670891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.681139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.683165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.684391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f55aeea7-9532-43ce-b0d9-f73092b5b53d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.686809 Oct 04 17:51:10.684964 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 374/727] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:10.689439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.690251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.697470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.698136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.698579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.699845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.700572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.701000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.720368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:10.830024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.835887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.839514 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8f808e4-af49-49ca-a103-ea67b7f78f61 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.793497 Oct 04 17:51:10.850944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e63a4eb7-26e9-4fe1-ba7e-5f59d2f7a4e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.164902 Oct 04 17:51:10.852186 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 354/729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:10 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:10.852318 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 375/729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:10 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:10.857463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.858528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.867432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.868667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.869279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.870725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.870857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.872525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.874614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.879740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.887868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.889409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.890095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.891081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.891867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.892533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.118142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:11.127432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d99226af-38e1-43ac-8716-b992338d3bed tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.273783 Oct 04 17:51:11.128032 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 376/730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:10 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:11.132941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:11.143605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.144090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.144547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.157663 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Creating event network-changed:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h1-831193-17 Oct 04 17:51:11.163831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] Instance 26191c24-da38-413a-a5d0-23de941822aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:51:11.174940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-00545da7-4f9f-4185-ba79-c1d8e7b95dd8 req-823fd8bc-1230-424b-9156-2bd88c5241f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045692 Oct 04 17:51:11.175762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 377/731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:11.180812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:11.181507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:11.188752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.189252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.189720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.190433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.190892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.191343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.329440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:11.337335 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d51ac6b2-bcae-48f2-84a9-cb4768f0285f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 0.160449 Oct 04 17:51:11.337912 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 378/732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:11 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:11.709835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:11.710740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:11.724194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.724774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.729207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.730357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.731399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.731993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.744752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:11.759578 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5574ddeb-6382-4e3e-a624-a885fc8711ec tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.905763 Oct 04 17:51:11.760802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 355/733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:10 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:11.883239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:11.884354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:11.894836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.895745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.896406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.898019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.898698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.899349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.292542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.319701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.349996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.357944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d45c40b8-3d38-4d48-822a-88880562ee17 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1566 microversion: 2.25 time: 0.649943 Oct 04 17:51:12.360043 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 379/734] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:11 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1566 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:12.368611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:12.371387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:12.384254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.385925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.386560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.388868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.389547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.390761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.425306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.433968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1384af89-e3a8-4a56-8f7d-8375ce55f053 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.554760 Oct 04 17:51:12.436944 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 356/735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:11 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:12.450438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:12.451700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:12.474336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.474910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.475377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.476211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.476533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.476989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.913271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.970778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-feceed05-c581-4c84-b3b4-53f7fe7e88a3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.605653 Oct 04 17:51:12.972945 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 380/736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:12 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:12.979812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.990309 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f832e26c-8d81-45f7-9c5d-f14e65053c7a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.550401 Oct 04 17:51:12.994702 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 357/737] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:12 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:13.000019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.004244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cfef55-6ba9-4a00-b36f-e79dae6fd2d0", "name": "network-vif-plugged", "status": "completed", "tag": "14dec5c6-007e-4a91-ab88-7205693169a8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.004850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.024936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.026234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.027682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.028373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.029104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.029933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.035259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.036625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.039112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.055233 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] Creating event network-vif-plugged:14dec5c6-007e-4a91-ab88-7205693169a8 for instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 on n-h1-831193-17 Oct 04 17:51:13.073257 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-575ef5da-693b-4646-9a38-95da813439d8 req-800d63dd-9e8e-4015-9c47-3534da85575a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076945 Oct 04 17:51:13.074157 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 358/738] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:13.079954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.081058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.093251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.098445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.099098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.100034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.100659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.101370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.524389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:13.540367 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fec95f5c-130f-42a2-89a1-7ceb5edfe8ff tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.459869 Oct 04 17:51:13.541383 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 359/739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:13.558444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96", "tag": "0a8afbe7-c9be-4a8c-978a-15cf622e982d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.592121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.592650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.593668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.634581 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] Creating event network-changed:0a8afbe7-c9be-4a8c-978a-15cf622e982d for instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 on n-h2-831193-17 Oct 04 17:51:13.641011 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b13d9bed-f227-4f04-a472-1b7eedfb42db req-30e19c1f-66ee-464f-aeb4-9dcad10d51d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095412 Oct 04 17:51:13.642156 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 360/740] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:13.647319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.648218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.653809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:13.656376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.657042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.657672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.658535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.659172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.659755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.664576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:13.666151 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9f7b7ae-0bc0-463e-a0d6-75461c89731c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1476 microversion: 2.1 time: 0.690748 Oct 04 17:51:13.667909 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 381/741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:12 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1476 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:13.681720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.682480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.697122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.698014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.698706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.701241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.702798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.705175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.990617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:13.996417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.006201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e72e33b-cf20-40cb-8737-38a51ddb6b2a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.336567 Oct 04 17:51:14.006785 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 382/742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:14.006915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.008727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.010020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e9eec89-e740-4b86-bf79-61974aad0ebc tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1541 microversion: 2.25 time: 0.366764 Oct 04 17:51:14.015443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.016054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.024730 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 361/743] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1541 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:14.034967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.038593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.042190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.042815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.043835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.044567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.045023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.045459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.046567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.047324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.047955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.048844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.049531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.050152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.303221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.306953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:14.318811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80e2c31d-bc91-496a-a3c6-1c244fbb615d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.307071 Oct 04 17:51:14.325197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 383/744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:14.333253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dfa39355-5ea7-44cf-a3f4-62239e046cb2 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '.version_select at 0x7f6341e42c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.339284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfa39355-5ea7-44cf-a3f4-62239e046cb2 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.340029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfa39355-5ea7-44cf-a3f4-62239e046cb2 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.342053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dfa39355-5ea7-44cf-a3f4-62239e046cb2 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.358463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dfa39355-5ea7-44cf-a3f4-62239e046cb2 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2633 microversion: 2.25 time: 0.027840 Oct 04 17:51:14.359348 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 384/745] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/os-migrations => generated 2633 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:14.380558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.383060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.390605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.391290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.391826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.392652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.393212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.393737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.398475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.406733 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01d31a86-f184-4153-bb2a-b3fd0ffafd42 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.380643 Oct 04 17:51:14.410847 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 362/746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:14.600571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:14.616780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-535a1973-9d40-40ff-aaca-327ac49c6fab tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 2035 microversion: 2.25 time: 0.245466 Oct 04 17:51:14.617851 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 385/747] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 2035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:14.640264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.641514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.649715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.650663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.651668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.652698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.653604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.654236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.669655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaa7fdc8-d1ec-4408-8088-a2591939836e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: .version_select at 0x7f6341d98820>, body: {"keypair": {"name": "tempest-keypair-847818090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlqvlOth5qNLWhDJHm7vUDaVZP+3EviNM6MNKp1eXqJk4XcRC7D3/F5FdvNAFoylD9ycDCSVObhsR/URsjS656C67ZmxUFz1+FxQ2rmuC1q58gdTuuTHvgR017XtKNEjA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:14.721723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aaa7fdc8-d1ec-4408-8088-a2591939836e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for project 9704eb841a9845948b9b01555c7051c6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:14.727863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aaa7fdc8-d1ec-4408-8088-a2591939836e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for user ee53a080f77a44f8aac80b34c1dd179e and project 9704eb841a9845948b9b01555c7051c6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:14.762375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aaa7fdc8-d1ec-4408-8088-a2591939836e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.109982 Oct 04 17:51:14.763252 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 386/748] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 17:51:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 17:51:14.768906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.769682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.776364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.776864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.777305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.778061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.778526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.778985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.982268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.991175 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff88ba3d-6edf-4ed5-ace3-f339d8801fc3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.356553 Oct 04 17:51:14.991820 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 363/749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:15.028548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:15.029246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:15.044776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.045580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.046316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.047256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.047872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.048450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.162147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.178994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e386832e-8f6d-4b70-99ef-4b3e002f4641 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1474 microversion: 2.1 time: 0.413994 Oct 04 17:51:15.179899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 387/750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:15.186046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15198621-aa1c-402a-85f3-95ae075e2d1b", "name": "network-vif-plugged", "status": "completed", "tag": "0c39e14a-d57f-4878-92b8-508258ad1564"}, {"server_uuid": "a271236f-c547-44f0-9916-f884faebc219", "name": "network-vif-plugged", "status": "completed", "tag": "10d9a6ec-45cc-431b-bce1-58cc29f185a5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:15.213108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.213608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.214070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.236665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Creating event network-vif-plugged:0c39e14a-d57f-4878-92b8-508258ad1564 for instance 15198621-aa1c-402a-85f3-95ae075e2d1b on n-h2-831193-17 Oct 04 17:51:15.237383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] Creating event network-vif-plugged:10d9a6ec-45cc-431b-bce1-58cc29f185a5 for instance a271236f-c547-44f0-9916-f884faebc219 on n-h1-831193-17 Oct 04 17:51:15.250258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-04308078-b0d6-48f2-b2be-2c8034a50892 req-28c503a1-187f-4248-a0e5-290587546098 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068450 Oct 04 17:51:15.251191 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 388/751] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:15.345057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:15.347340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:15.360962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.361460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.361897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.362759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.368101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.368542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.755803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.783739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.799468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc2aa0a5-0b77-424e-b3b6-215a17ac0fa4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.461637 Oct 04 17:51:15.813208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bef29359-be6b-47e4-8758-ebc5cb8d319f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1371 microversion: 2.1 time: 0.784747 Oct 04 17:51:15.816151 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 389/752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:15 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:15.824223 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 364/753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:15 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1371 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:15.831078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:15.841381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:15.864342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.865116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.867545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.871709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.872718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.873358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.015404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.016229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.034327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.034850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.035331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.036075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.036695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.036983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.390827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:16.400719 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7fd6bafd-4c91-4247-9edf-14bc43e8ef2c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.389740 Oct 04 17:51:16.401493 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 365/754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:16.406876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.407609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.413965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.414872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.415517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.416421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.417203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.417803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.479761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:16.488398 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d138d115-46c1-48e5-8f09-b054834366ad tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.670346 Oct 04 17:51:16.499899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 390/755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:15 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:16.815850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:16.834883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.835620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.840922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:16.841744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-18efc552-36c3-4d74-b321-487de924d6a6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1471 microversion: 2.1 time: 0.437773 Oct 04 17:51:16.846911 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 366/756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:16.859532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.860172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.873393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.875219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.875702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.878687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.879419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.880441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.884476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:16.890675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.896822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.896822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.896822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.896822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.897266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.220429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:17.230515 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6c3d6394-7aa4-4c85-ba72-6334d7d932b6 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1556 microversion: 2.1 time: 0.382008 Oct 04 17:51:17.238433 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 367/757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1556 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:17.247770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:17.251936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.263892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.265314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.266443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.267928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.269267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.270244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.284421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:17.294299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-737cd9e6-77d3-4f27-b6c0-793bc9233070 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 0.463923 Oct 04 17:51:17.295534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 391/758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:17.301486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.302407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.316015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.316897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.318161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.319459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.320303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.321284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.389469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30e4a85f-50a7-450e-8570-861de7061d19 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa/action" status: 204 len: 0 microversion: 2.1 time: 0.149381 Oct 04 17:51:17.393451 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 368/759] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:17 2022] POST /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa/action => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:17.414828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.415685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.423957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.424487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.424694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.425400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.426024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.426616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.549891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cacb9b64-8033-4669-9a65-f1a72fa41478 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252798 Oct 04 17:51:17.550539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 392/760] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:17.559803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.560669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.577844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.578355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.578785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.579920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.580604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.581229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.810801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:17.828208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d80e0166-b179-4f6a-9caf-dafa45696dcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1471 microversion: 2.1 time: 0.428741 Oct 04 17:51:17.828712 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 369/761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:17.837440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.841210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.852920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.858331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.858886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.859694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.860185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.860627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.046914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:18.067988 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c086071-298d-4cbc-a015-540af230be5f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1317 microversion: 2.1 time: 0.514321 Oct 04 17:51:18.069457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 393/762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:18.207160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afe47112-29ee-4012-951e-e5238d05fec7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Action: 'create', calling method: .version_select at 0x7f63424b58b0>, body: {"keypair": {"name": "tempest-keypair-1431597605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm4GBDygHetWbsSH2y4Dvyx3UBxL00fI728TxGL3pF3TWXX9ji0jXfOFI4Kl32fGFQHTRK3jwwq54Q8znf+r+YrDj0zpUA/KrHP2V5U2out+p45MOlr0Ml+lK/mZKzCmQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:18.232771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-afe47112-29ee-4012-951e-e5238d05fec7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:18.245272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-afe47112-29ee-4012-951e-e5238d05fec7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for user 634dc1af05d34e30834cf3f0e0e35815 and project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:18.274769 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-afe47112-29ee-4012-951e-e5238d05fec7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203866 Oct 04 17:51:18.283594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 394/763] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:51:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:18.318623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:18.319356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:18.344750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.345948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.346988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.349147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.350263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.351297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.514935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:18.525985 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-99da80f8-c45b-42f9-aa6b-196839618241 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.696157 Oct 04 17:51:18.526573 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 370/764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:18.535718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96", "name": "network-vif-plugged", "status": "completed", "tag": "0a8afbe7-c9be-4a8c-978a-15cf622e982d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:18.553469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.554363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.556566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.580635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] Creating event network-vif-plugged:0a8afbe7-c9be-4a8c-978a-15cf622e982d for instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 on n-h2-831193-17 Oct 04 17:51:18.597948 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-75172b48-9215-429d-a1dd-8fc843ac303c req-3ed184b7-9c60-4275-99f5-835f6dbe4b9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069576 Oct 04 17:51:18.601035 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 371/765] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:18.857883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:18.861474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:18.888996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.889536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.889939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.890697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.895904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.896671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.315992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:19.348617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ebd67e60-a55e-4612-aeae-a539503413a4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1318 microversion: 2.1 time: 1.032443 Oct 04 17:51:19.383964 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 395/766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:18 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1318 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:19.400431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:19.401442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:19.434738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.443727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.446487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.448388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.450131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.450131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.589389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:19.609681 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b60563be-b829-4b2c-a48e-ef30c6498728 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1471 microversion: 2.1 time: 0.760617 Oct 04 17:51:19.610649 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 372/767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:18 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1471 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:19.617600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:19.618635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:19.631922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.632844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.633691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.634674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.635595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.636254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.874608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:19.889686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f92356ae-bb8b-4149-b002-289a2a0d3dac tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1467 microversion: 2.1 time: 0.504063 Oct 04 17:51:19.890990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 396/768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:19 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1467 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:19.896111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1731825223", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1a1507de-64a0-41ec-99ee-723250e9aaaa"}], "security_groups": [{"name": "tempest-securitygroup--504986633"}], "key_name": "tempest-keypair-847818090", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:20.015469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:20.030490 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-361fbee3-b433-4b6c-82a8-537d6ed4ac5f tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.416858 Oct 04 17:51:20.031864 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 373/769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:19 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:20.038815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:20.039715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:20.051300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.052152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.053058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.055494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.056648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.057658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.103823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] validate_networks() for [('1a1507de-64a0-41ec-99ee-723250e9aaaa', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:20.338213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:20.363763 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f5abbbb8-8f7e-4a0e-9aef-2e2dac2086c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1466 microversion: 2.1 time: 0.329850 Oct 04 17:51:20.364928 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 374/770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:20 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1466 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:20.409576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1527250793"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:20.412505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:20.426134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.426696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.427771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.428541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.430567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.431073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.837865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:20.882727 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2c8e7889-0a9a-443d-bd07-2a6f56a12da0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "POST /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.493413 Oct 04 17:51:20.883750 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 375/771] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:20 2022] POST /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 17:51:20.896405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:20.897186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:20.915066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.916020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.916636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.917519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.919982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.922212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.010849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:21.011705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:21.012484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:21.013043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:21.013569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:21.038612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.043940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.046088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.050478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.057951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.058628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.111827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:21.129779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for user ee53a080f77a44f8aac80b34c1dd179e and project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:21.189331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:21.194589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:21.271615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00f4f322-012e-40c2-8472-8992c1bd2f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.379077 Oct 04 17:51:21.272440 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 397/772] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:51:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:51:21.293648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "name": "network-vif-plugged", "status": "completed", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:21.317604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:21.326898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.327958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.328595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.346130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Creating event network-vif-plugged:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h1-831193-17 Oct 04 17:51:21.353635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] Instance 26191c24-da38-413a-a5d0-23de941822aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:51:21.377537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ac7a2d4b-4179-40be-b434-4b64cdc845d2 req-b9ae656f-dc22-479b-9cb8-ded7b7515953 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098154 Oct 04 17:51:21.378413 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 398/773] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:21.385062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:21.385836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:21.393115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.393788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.394245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.394962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.395466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.395898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.518234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:21.558431 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f2504be-116f-49d2-897f-4473937ff6a6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1468 microversion: 2.1 time: 0.673403 Oct 04 17:51:21.568580 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 376/774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:20 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1468 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:21.584803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cfef55-6ba9-4a00-b36f-e79dae6fd2d0", "tag": "14dec5c6-007e-4a91-ab88-7205693169a8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:21.644176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.661186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.663879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.704405 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] Creating event network-changed:14dec5c6-007e-4a91-ab88-7205693169a8 for instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 on n-h1-831193-17 Oct 04 17:51:21.713423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-38f8621b-6330-4f77-bfc4-b7ec9bbdd1aa req-c886b55c-9aa8-427e-b916-1a6fbcd88a3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142596 Oct 04 17:51:21.715259 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 377/775] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:21.722576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a29ba014-827c-40fb-a867-5c5bd1315997 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341c58280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:21.835694 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a29ba014-827c-40fb-a867-5c5bd1315997 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.119061 Oct 04 17:51:21.840685 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 378/776] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:21 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:21.855371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:21.856537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:21.890308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.890826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.891300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.892040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.892506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.898575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.901790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:21.912350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f773c735-8710-4b22-ab39-67dde8222c93 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1471 microversion: 2.1 time: 0.533352 Oct 04 17:51:21.915319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 399/777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:21 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1471 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:21.922037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:21.922911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:22.024644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.037928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.039955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.042025 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d50dd41f-41c1-42f4-98d9-2177e2ebdbc0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1285 microversion: 2.25 time: 0.125076 Oct 04 17:51:22.043822 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 400/778] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:21 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:22.050903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:22.052213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:22.059832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.060831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.061568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.062527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.063250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.064026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.314622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.326757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ff4d7ae-8e66-41a1-a0bb-1c9a6e0b8205 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 200 len: 1467 microversion: 2.1 time: 0.281499 Oct 04 17:51:22.327822 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 401/779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:22 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 1467 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:22.356358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:22.369335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.370609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Searching by: {'reservation_id': 'r-ih6lfz1x', 'deleted': False, 'project_id': 'c329d327a97e476581dc870e8e71a712'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:51:22.381497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.381991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.383747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.385076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.385626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.386171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.619494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:51:22.672898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.688688 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0bc008df-3ac2-4831-82c5-c284b8191bef tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.846216 Oct 04 17:51:22.689629 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 379/780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:21 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:22.769802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:22.780168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.781099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.781774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.857948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9db8689e-2573-4baf-b32e-0425cabcd9d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341d6e5e0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:22.937808 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9db8689e-2573-4baf-b32e-0425cabcd9d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.084468 Oct 04 17:51:22.947176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 380/781] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:22 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:22.953056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:22.953925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:22.961419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.962082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.963474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.964415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.965069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.965652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.027611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50790dc5-5751-4269-91b7-81486f901a2b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-ih6lfz1x" status: 200 len: 2928 microversion: 2.1 time: 0.678502 Oct 04 17:51:23.028491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 402/782] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Oct 4 17:51:22 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ih6lfz1x => generated 2928 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:23.053732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.089853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_groups [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Querying cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) for 2 instances {{(pid=128770) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 17:51:23.091211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.091774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.092126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.126053 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7550697f-d9d5-4817-ac8d-904aefe724a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d7f3070d-1ab1-4a1b-a749-91436b3a0808" status: 200 len: 265 microversion: 2.1 time: 0.076427 Oct 04 17:51:23.126641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 403/783] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/os-server-groups/d7f3070d-1ab1-4a1b-a749-91436b3a0808 => generated 265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:23.131846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.132598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.139513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.140014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.140454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.141220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.141683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.142111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.215740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.224498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.225929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.227071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a042420c-157b-4877-a5b5-82a618c17ccf tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1337 microversion: 2.25 time: 0.099244 Oct 04 17:51:23.227637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 404/784] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:23.232535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.233148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.240374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.240871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.241409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.242853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.243399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.243821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.264614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:23.380794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89e5a29c-e46e-4599-ac37-70322a052000 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 200 len: 1621 microversion: 2.1 time: 0.151762 Oct 04 17:51:23.391594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 405/785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 1621 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:23.403719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.404444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.410950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.411593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.412040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.412770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.413238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.413669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.511559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.522898 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-59dae2db-18c9-4ac7-8c71-12235ff2f2cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1463 microversion: 2.1 time: 0.574209 Oct 04 17:51:23.524054 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 381/786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:22 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1463 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:23.557181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.558641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.567501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.568262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.568886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.569972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.570916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.571845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.588673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-933e95a9-682c-451c-aeb6-7b4cb4707264 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 200 len: 1620 microversion: 2.1 time: 0.188768 Oct 04 17:51:23.594085 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 406/787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 1620 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:23.624651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: .version_select at 0x7f63423b9af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1967042978", "policies": ["anti-affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:23.661878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:23.667953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:23.725429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:23.731753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:23.753589 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-385427c0-b1d3-4c41-b7fd-40e04e370e95 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.133142 Oct 04 17:51:23.759159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 407/788] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 17:51:23 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:23.771077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.771897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.780646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.781149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.781599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.782553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.783051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.783501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.971338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.979787 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88d5ed84-e2cc-4fab-89e2-2f15980df20e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.218910 Oct 04 17:51:23.990713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 408/789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:23.990713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12349714-03d5-4a6d-b094-6ad0ae13ccb8", "name": "network-vif-unplugged", "status": "completed", "tag": "08030174-2cfa-43fb-b31a-652ca7e122d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:23.998922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.999487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.999911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.013788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] Creating event network-vif-unplugged:08030174-2cfa-43fb-b31a-652ca7e122d4 for instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 on n-h1-831193-17 Oct 04 17:51:24.020451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1d2611f0-749e-44a7-80e4-e86e208158d7 req-dc5d633d-6985-4bd2-b352-a42703508a86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037713 Oct 04 17:51:24.021349 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 409/790] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:24.027440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1055563526", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bb184c12-004c-408a-806a-a91c0861450f"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:24.112834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:24.237182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:24.253783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd7a69b0-3fe3-4327-b973-8d81f2470f32 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1463 microversion: 2.1 time: 0.701021 Oct 04 17:51:24.265131 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 382/791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1463 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:24.270657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88b22158-263d-4e46-9d7e-11f2a6683d18 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e56c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:24.403198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88b22158-263d-4e46-9d7e-11f2a6683d18 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.130556 Oct 04 17:51:24.404135 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 383/792] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:24 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:24.422811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:24.425327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:24.438160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.439986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.440703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.442245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.443007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.443955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.466679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:24.467300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:24.468681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:24.469715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:24.470311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:24.500224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.500742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.501339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.503615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.504124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.504828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.536190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:24.544409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:24.560454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 2 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:24.565975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:24.578045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:24.599127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:24.604026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:24.607877 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b06a19d3-f800-429a-bd0f-d0e7794082bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1343 microversion: 2.25 time: 0.190783 Oct 04 17:51:24.609863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 384/793] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:24 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1343 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:24.617044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a58c05e4-bcc5-48dc-8244-72b7272d0ee1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'create', calling method: .version_select at 0x7f6341f54430>, body: {"keypair": {"name": "tempest-keypair-1715076753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmeECfzhm9A+45t7hB26hoyFwUioZ+HPyfZBge2diT/05oOtGiXgcDw1YAGD6Ls/ve2ZX4YXRlCfe4/0d6zAdKla/kn5wEcdJR4/LbQ/D/2PsfCXrlt5nA/2BAZcSGYMw=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:24.646960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a58c05e4-bcc5-48dc-8244-72b7272d0ee1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:24.648088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128770) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 17:51:24.659070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a58c05e4-bcc5-48dc-8244-72b7272d0ee1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:24.682893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:24.695245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:24.712481 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a58c05e4-bcc5-48dc-8244-72b7272d0ee1 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100817 Oct 04 17:51:24.713365 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 385/794] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:51:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:24.726060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1104767277", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "ab9073e4-316a-4b3b-8a86-29c1425e3a45"}], "security_groups": [{"name": "tempest-securitygroup--863149682"}], "key_name": "tempest-keypair-1431597605", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:24.801610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:24.811096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:24.845587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=6d70836b-a650-4fbd-9a80-4a70b5b4788d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:24.863061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:24.939599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:24.948189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:25.001490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:25.009653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:25.050249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] validate_networks() for [('ab9073e4-316a-4b3b-8a86-29c1425e3a45', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:25.056584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-febe45d9-1a10-433e-a8d5-51a4ce6ac4dc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.034248 Oct 04 17:51:25.066468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 410/795] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 17:51:25.074211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.077217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:25.092600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.095512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.097307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.097307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.097307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.097777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.338018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:25.351648 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-025b9c48-b46f-4883-af2c-91668a385298 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.283640 Oct 04 17:51:25.352239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 411/796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:25.370176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.376082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:25.376860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Searching by: {'deleted': False, 'project_id': 'c329d327a97e476581dc870e8e71a712'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:51:25.411097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.411604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.412061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.418770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.419313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.419767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.645905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:51:25.828614 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29674348-0115-458f-8e93-0ef3f0a4d702 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.475388 Oct 04 17:51:25.832382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 412/797] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/servers => generated 1663 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:25.842716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70d9e5b3-73dc-4535-b440-03c18c74f7f3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341d51280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.909035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70d9e5b3-73dc-4535-b440-03c18c74f7f3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.075427 Oct 04 17:51:25.917204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 413/798] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:25.923118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.936030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:25.943416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.943919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.944367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.945197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.945738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.946173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.179974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:26.180514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:26.180910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:26.181462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:26.181949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:26.212757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.214270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.216982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.222514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.224014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.225153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.230263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.247360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.249131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.260310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99022f7d-640d-4fb7-be4b-ef7f536a84e7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1343 microversion: 2.25 time: 0.336112 Oct 04 17:51:26.261026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 414/799] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1343 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:26.276792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b0191a1-7ed7-4c37-ad05-d0e692035b13 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:26.276792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b0191a1-7ed7-4c37-ad05-d0e692035b13 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:26.308531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:26.335329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for user 634dc1af05d34e30834cf3f0e0e35815 and project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:26.374125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:26.381664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:26.583988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b0191a1-7ed7-4c37-ad05-d0e692035b13 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.640885 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b0191a1-7ed7-4c37-ad05-d0e692035b13 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1219 microversion: 2.1 time: 0.369851 Oct 04 17:51:26.653606 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c577411-8e67-44b7-9854-6722ac381be0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.936822 Oct 04 17:51:26.659214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 415/800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:26 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1219 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:26.661311 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 386/801] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:26.689068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:26.694075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:26.696368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12349714-03d5-4a6d-b094-6ad0ae13ccb8", "tag": "08030174-2cfa-43fb-b31a-652ca7e122d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:26.734163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.757627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.766459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.770531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.777971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.780559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.784016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.799235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.812660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.897719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] Creating event network-changed:08030174-2cfa-43fb-b31a-652ca7e122d4 for instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 on n-h1-831193-17 Oct 04 17:51:26.916347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-05c2f8c6-2b0a-4ca4-b344-e8e1461f4569 req-4fb07786-26fb-4d19-a0d6-d5881bf6f1e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252505 Oct 04 17:51:26.929004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 416/802] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:26.935158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97ab5651-efc9-438f-9bd9-b7b4b32296a2 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:26.946264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-97ab5651-efc9-438f-9bd9-b7b4b32296a2 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:27.084506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-97ab5651-efc9-438f-9bd9-b7b4b32296a2 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:27.095021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-97ab5651-efc9-438f-9bd9-b7b4b32296a2 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1242 microversion: 2.1 time: 0.164213 Oct 04 17:51:27.098842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 417/803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:26 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:27.121496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-plugged", "status": "completed", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:27.181108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.181616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.185470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.239510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] Creating event network-vif-plugged:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:51:27.256979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-58f96428-4312-46fd-b56c-6f5f67c5bce0 req-2fc8a2c7-1e72-425b-8f75-f64053cbd144 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150943 Oct 04 17:51:27.262688 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 418/804] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:27.298622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6bd453e0-7291-43b9-8c98-92486d36c6bb tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341e4e160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.413095 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6bd453e0-7291-43b9-8c98-92486d36c6bb tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.148342 Oct 04 17:51:27.420485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 419/805] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:27.452324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.453245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:27.495220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.499869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.500454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.502220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.502943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.506256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.076738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.087104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.091255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.094058 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0099e55-4abf-4bff-85a4-df6db990bc0a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.671373 Oct 04 17:51:28.095696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 420/806] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:28.141490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.144477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:28.159112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.159886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.161651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.162654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.163520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.164188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.248213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.251594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.258442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-507aac08-7bb0-481d-9586-ae7001e4453f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1271 microversion: 2.1 time: 0.122794 Oct 04 17:51:28.264030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 421/807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:28.265913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-945f2852-e0f3-4c93-8b2c-f294e56b0323 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 1.599426 Oct 04 17:51:28.272145 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 387/808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:26 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:28.276547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.277317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:28.292211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.293210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.297154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.298426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.299246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.301807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.430092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:28.432386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7a09dd0-810c-40e3-b95f-2289dc8db1e5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341f4d280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.438818 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e092baaf-4f2d-43d5-bbe7-3fa4a46dfae0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1246 microversion: 2.1 time: 0.173384 Oct 04 17:51:28.442887 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 422/809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1246 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:28.508104 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d7a09dd0-810c-40e3-b95f-2289dc8db1e5 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.080741 Oct 04 17:51:28.509595 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 388/810] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:28.880863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f430d41-464f-4418-b087-0d16b463af98 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '.version_select at 0x7f634255d160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.884358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f430d41-464f-4418-b087-0d16b463af98 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.884855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f430d41-464f-4418-b087-0d16b463af98 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.892150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f430d41-464f-4418-b087-0d16b463af98 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.924867 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f430d41-464f-4418-b087-0d16b463af98 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.047897 Oct 04 17:51:28.936467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 423/811] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:28.955284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2bad87ea-1807-4330-90f6-750367c648b8 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.962904 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2bad87ea-1807-4330-90f6-750367c648b8 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011216 Oct 04 17:51:28.983132 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 389/812] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:28.988961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6b4122da-5cb9-410f-a4ca-fbdc8eca8b59 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1116994639", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:29.027690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6b4122da-5cb9-410f-a4ca-fbdc8eca8b59 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.042261 Oct 04 17:51:29.040204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-061c552b-b4a9-4f7f-814c-e3595b570e90 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.046048 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 424/813] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Oct 4 17:51:28 2022] POST /compute/v2.1/flavors => generated 499 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:29.049406 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-061c552b-b4a9-4f7f-814c-e3595b570e90 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012843 Oct 04 17:51:29.060925 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 390/814] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:51:29.128010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.129217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:29.135965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.136707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.137189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.137919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.138545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.139233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.240433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1562819383", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "ce27549a-411c-46b1-b5ec-75f38c659936"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:29.349935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:29.368738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.379368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.381380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.382799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9de1512e-676e-4f3c-b7f9-bfe98b20ab95 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.258625 Oct 04 17:51:29.384099 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 425/815] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:29.403277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.409197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:29.423498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.424211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.424805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.425703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.426301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.427120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.528651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.546039 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2f24ac8-831c-4658-8e61-532f9387e2d7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1277 microversion: 2.1 time: 0.159085 Oct 04 17:51:29.547070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 426/816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:29.552282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.553047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:29.561869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.562610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.563133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.563837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.564337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.564756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.761372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.777786 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41676542-fb0d-4bdd-933f-b3a3346534fe tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.229149 Oct 04 17:51:29.780559 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 427/817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:29.794592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.797332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:29.816121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.816863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.817481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.818341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.818959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.819580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.925163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.935807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b9a36c0-17d5-4f80-955a-186b0c592350 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1294 microversion: 2.1 time: 0.153769 Oct 04 17:51:29.947401 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 428/818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:29.956703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f58610bd-baf8-44bd-abd6-f1a0f7445738 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a4faf0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.008402 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f58610bd-baf8-44bd-abd6-f1a0f7445738 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.059865 Oct 04 17:51:30.009300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 429/819] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:30.392098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:30.394044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:30.394780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:30.395867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:30.396701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:30.409839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.410518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.412325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.413022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.413699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.414858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.416486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.417967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.426646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.427204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.427651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.428378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.428840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.429344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.449721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:30.456499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:30.479403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:30.483574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:30.581979 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-763bc8a0-bf72-4086-ba2b-63129c115a3f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342600 Oct 04 17:51:30.597617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 391/820] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:51:30.632588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.632588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.645598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.646445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.647814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.648579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.649035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.650986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.729006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.739081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.740574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.742029 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c6d0522-30be-4e60-b6f3-5babdd495e76 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.336646 Oct 04 17:51:30.743065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 430/821] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:30.748061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dbc91964-c3d2-4019-b31e-7102ce661c51 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.748528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dbc91964-c3d2-4019-b31e-7102ce661c51 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.845923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dbc91964-c3d2-4019-b31e-7102ce661c51 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.862768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dbc91964-c3d2-4019-b31e-7102ce661c51 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1279 microversion: 2.1 time: 0.117957 Oct 04 17:51:30.863645 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 431/822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:30.868586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.869388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.893070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.893879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.895548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.896242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.896726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.897161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.046347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:31.058842 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f13ca64-a2f1-451d-9820-bad1c1e969ba tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1277 microversion: 2.1 time: 0.464460 Oct 04 17:51:31.075067 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 392/823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1277 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:31.078132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.087350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:31.098048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.099087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.099765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.101040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.101728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.102350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.169998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:31.180354 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c06047af-1386-431c-9d8a-7ae6f158fb15 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.315847 Oct 04 17:51:31.181553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 432/824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:31.186162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef14cc89-4d39-49b8-823a-0078711fa9e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341d51280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.246967 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef14cc89-4d39-49b8-823a-0078711fa9e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.064302 Oct 04 17:51:31.250635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 433/825] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:31.703216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:31.713663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-06cd3b03-d973-484d-8eba-18f7817aca43 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1300 microversion: 2.1 time: 0.649938 Oct 04 17:51:31.733961 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 393/826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1300 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:31.768247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.769450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:31.783777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.784391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.784937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.785777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.786328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.788055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.801156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:31.899609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.900632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:31.917060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.921480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.922780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.924435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.930319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.934798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.115682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.125609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.133096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.134540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ab3cbfa-6cfc-4b70-b36f-5c86d0fd80fa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.370934 Oct 04 17:51:32.136965 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 434/827] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:32.141790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:32.142652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:32.149041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.149847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.150511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.151474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.152177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.153341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.251654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.273540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.281022 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c54be98-0815-47fc-8faf-93444dbe565c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1331 microversion: 2.1 time: 0.385773 Oct 04 17:51:32.285469 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 394/828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1331 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:32.299142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:32.300444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:32.301300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf29ceeb-4955-49aa-a36e-c7b4e5079345 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1277 microversion: 2.1 time: 0.162876 Oct 04 17:51:32.301980 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 435/829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:32 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:32.316155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-481ec005-e124-4b4f-a494-a9d40e82b045 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341b1a8b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:32.340501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.341224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.342054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.343116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.343824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.344478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.417397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-481ec005-e124-4b4f-a494-a9d40e82b045 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.114344 Oct 04 17:51:32.418827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 436/830] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:32 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:32.631502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:32.642169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.642972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.643717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.657981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] Creating event network-changed:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h1-831193-17 Oct 04 17:51:32.663254 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-40b92ff5-efb5-4162-b6d3-545ba09a4e58 req-13403fea-6075-4e8f-890e-fb39dc6c6325 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036335 Oct 04 17:51:32.664390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 437/831] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:32.742635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:32.743974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:32.756924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.764623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.766285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.769284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.774257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.775101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.932718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.947450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77fe4465-b671-410d-b17c-e1792cb786aa tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1300 microversion: 2.1 time: 0.209608 Oct 04 17:51:32.948041 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 438/832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:32 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:33.166196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.168321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.179406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.180312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.180998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.182114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.182794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.183474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.297995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.310716 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dbe11add-8d3e-430f-a9dd-f1c528204a06 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 1.023496 Oct 04 17:51:33.311355 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 395/833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:32 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:33.316061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.316674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.334820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.335400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.336054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.336778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.337240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.343413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.436817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.451886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.458492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.459734 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af80346a-91e5-425b-91ef-92118e43c753 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.297741 Oct 04 17:51:33.460324 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 439/834] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:33.468366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.469218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.482966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.483750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.484420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.485436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.485899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.486429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.566592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.578345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-71400d7c-45a4-43cc-b2aa-b551ea373282 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1277 microversion: 2.1 time: 0.113605 Oct 04 17:51:33.578579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:33.594813 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 440/835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:33.594813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e793b294-2a7a-412e-97d7-c5cce184fac4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a5faf0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.602796 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5abe25c1-72d0-43fb-be04-73edeebf699f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1337 microversion: 2.1 time: 0.290174 Oct 04 17:51:33.603988 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 396/836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1337 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:33.678738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e793b294-2a7a-412e-97d7-c5cce184fac4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.098566 Oct 04 17:51:33.679575 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 441/837] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:33.977833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.978478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.992345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.992868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.993300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.994012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.001411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.002776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.336368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:34.336996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:34.357641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.358054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.358491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.359235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.359687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.360170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.725127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:34.743454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6627cfdc-eb99-42f3-8dfa-ef1548b9b365 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.413317 Oct 04 17:51:34.744305 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 442/838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:34 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:34.753925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:34.754557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:34.783300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.783960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.784422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.785197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.787152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.790838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.064919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.078202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.079753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.083840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9663859-2c31-4ef5-a741-754cae21e391 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.338691 Oct 04 17:51:35.095975 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 443/839] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:34 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:35.102362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.102987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.121159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.121758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.122215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.127779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.128569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.129167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.256308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.265209 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-472c6e17-fa9b-46fa-973c-949ba0d8e0a9 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1300 microversion: 2.1 time: 1.292680 Oct 04 17:51:35.265795 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 397/840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1300 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:35.278664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.288009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.304453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.304964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.305833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.306577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.307068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.307713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.404304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.416125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0be48c8b-ed6e-4a1d-9c73-7942ac5934f7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.318130 Oct 04 17:51:35.432255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 444/841] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:35.439094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0f9bc65-6bda-47ec-bea1-507b2b791709 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a5f9d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.515844 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0f9bc65-6bda-47ec-bea1-507b2b791709 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.082074 Oct 04 17:51:35.525614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 445/842] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:35.769963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.770846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.776058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.791871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.792372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.793439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.794213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.794686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.795215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.023339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.031962 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41e246cd-d8f5-4e60-9178-f87ae2827738 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.757628 Oct 04 17:51:36.037015 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 398/843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:36.115716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.116713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.125961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.133780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.135363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.136041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.137562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.138527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.139328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.143578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec7fc388-8c03-465f-ab48-2b41c3dcc295 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.377327 Oct 04 17:51:36.152023 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 446/844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:36.295693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.296676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.314019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.315387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.316371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.317365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.318695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.319571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.843796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.858050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.873113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.874684 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e4a4481-50f7-4641-90ac-23f284e8f2a0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.575383 Oct 04 17:51:36.875561 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 447/845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:36.887829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.900330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:36.901588 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ef9a68c-a36c-4d64-8b35-830067edb7db tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.789911 Oct 04 17:51:36.904438 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 399/846] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:36.908077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.912819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8f343002-0fcf-477b-a003-ac31be9f61b4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341eb6670>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.926414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.926414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.926414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.926726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.927370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.928795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.967109 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8f343002-0fcf-477b-a003-ac31be9f61b4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.061332 Oct 04 17:51:36.967712 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 400/847] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:36.991086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:37.024098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.031181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.034437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.058331 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] Creating event network-changed:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h1-831193-17 Oct 04 17:51:37.073822 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-fa76d65d-7689-4030-8017-d67832e57646 req-49202279-0988-4fc2-9cc7-89e074e015a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104841 Oct 04 17:51:37.075075 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 401/848] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:37.102373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.103539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:37.116408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:37.124094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.125645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.138012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.139510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.140232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.140913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.184643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:37.196803 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f8a1d99-8f0a-4716-9217-d71994b51bc4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.312596 Oct 04 17:51:37.198118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 448/849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:37.203908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.204708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:37.213171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.213772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.214221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.217163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.218142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.219022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.417560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:37.427571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f219f19-eb2a-49aa-acc0-cb3b06e6cb50 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1501 microversion: 2.1 time: 0.227886 Oct 04 17:51:37.437957 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 449/850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:37.437957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d70836b-a650-4fbd-9a80-4a70b5b4788d", "tag": "80c7950b-3d22-4153-a74f-99ef8625a1b7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:37.445408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.445903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.446340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.459484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] Creating event network-changed:80c7950b-3d22-4153-a74f-99ef8625a1b7 for instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d on n-h1-831193-17 Oct 04 17:51:37.464613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a176d4d0-619c-43a6-9d7e-a1478bf22b24 req-8cabc3be-a235-4693-8ae6-38f33fea7fdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Oct 04 17:51:37.465611 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 450/851] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:37.479772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:37.488782 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e951a79-e7f1-4915-9803-a62dac4919c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.412210 Oct 04 17:51:37.508176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 402/852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:37.904647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.906516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:37.915932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:37.919385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.920908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.921780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.925826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.926536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.927676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.938089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.938858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:37.946376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.947190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.947855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.949671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.950585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.951277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.957453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:38.177639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.198004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1037a200-8baa-4cdf-af31-1cf8a6258648 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.298855 Oct 04 17:51:38.199261 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 451/853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:38.206708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-750174da-9e05-427c-b676-ccbdde8d4d50 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a153a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.273602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-750174da-9e05-427c-b676-ccbdde8d4d50 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.072423 Oct 04 17:51:38.274450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 452/854] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:38.290605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.291498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.306747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.307605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.308524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.310174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.310925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.311670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.357245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:38.518645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9038a574-3272-40ca-ad7c-8786d84c63b9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 204 len: 0 microversion: 2.1 time: 0.231846 Oct 04 17:51:38.528962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 453/855] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:38 2022] DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:38.528962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.529307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.537656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.538532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.539097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.540004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.540776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.541700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.571288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:38.666363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.679128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.688743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.690003 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df898aad-d6bf-4c0f-92dc-2eaa8d817fa0 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.759584 Oct 04 17:51:38.690518 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 403/856] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:38.707658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.708277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.728805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.729337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.729751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.731963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.732448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.732892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.771409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.780542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d02dea5-a7fd-4a16-87c4-b07e9c62db30 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.257670 Oct 04 17:51:38.781136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 454/857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:38.798524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.798524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.798524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.798524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.798958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.798958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.798958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.798958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.987849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:38.997195 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d466cd91-917e-4ce5-8700-8196e7507b3a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.213598 Oct 04 17:51:39.002800 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 455/858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:39.010490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1859893621", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "1616054151", "adminPass": "***", "networks": [{"uuid": "c1a98b93-57dc-41a0-a33e-3b11a477943e"}], "security_groups": [{"name": "tempest-securitygroup--724195362"}], "key_name": "tempest-keypair-1942937255", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:39.079826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:39.092998 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e2c64f1-5ad6-4615-878e-a08d92bc9e34 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1491 microversion: 2.1 time: 0.401234 Oct 04 17:51:39.095868 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 404/859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1491 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:39.124532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2b759e9-1d7d-4c7b-8c92-bc7cd92c8da7 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '.version_select at 0x7f6341f4d1f0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:39.129100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2b759e9-1d7d-4c7b-8c92-bc7cd92c8da7 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.130278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2b759e9-1d7d-4c7b-8c92-bc7cd92c8da7 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.130978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2b759e9-1d7d-4c7b-8c92-bc7cd92c8da7 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.143628 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2b759e9-1d7d-4c7b-8c92-bc7cd92c8da7 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.025795 Oct 04 17:51:39.145213 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 405/860] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:51:39 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:39.161785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:39.164703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:39.166514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] validate_networks() for [('c1a98b93-57dc-41a0-a33e-3b11a477943e', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:39.174497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.175147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.176328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.177638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.180103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.181074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.877860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:39.878762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:39.880733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:39.881300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:39.881594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:39.905198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=55 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:39.912631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.915602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.916485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.920678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.922177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.923713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.978573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for project 67f8b905a51742a18aea0297cd1f119d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:39.993586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Getting quotas for user 51f1d73e7fbc42ecafb89f0875d5d70d and project 67f8b905a51742a18aea0297cd1f119d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:40.017851 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-23fd6cd9-5e1c-4a4a-920c-91a1a1e41ca3 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 200 len: 1644 microversion: 2.1 time: 0.859718 Oct 04 17:51:40.039982 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 406/861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:39 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 1644 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:40.040627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:40.049621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:40.055002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.060884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.072080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.072830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.076729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.077669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.078294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.078886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.232233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67ebcbc0-9039-4b49-bdb3-2fa6ab02d64b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.227435 Oct 04 17:51:40.235428 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 456/862] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:40.248268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8db79e1-db84-4c88-8d45-aa9486a8cac0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a4f550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.431076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:40.466772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=16 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:40.476023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8db79e1-db84-4c88-8d45-aa9486a8cac0 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.236740 Oct 04 17:51:40.476840 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 457/863] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:40.489073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.498908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.528465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.529148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.531086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.535432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.539205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.541649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.665119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:40.676828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f39fb42b-5ec0-4d9c-9c95-f142eba0688f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.626094 Oct 04 17:51:40.696572 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 407/864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:40.710968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e9e98d-0bac-4176-ab18-b935ccd4d5cb", "tag": "c8b48788-07cf-403d-aa82-09ab6410d357"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:40.733801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.734279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.734792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.769447 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] Creating event network-changed:c8b48788-07cf-403d-aa82-09ab6410d357 for instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb on n-h2-831193-17 Oct 04 17:51:40.786010 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c88be290-c7c6-4133-93c7-76eb8830ba19 req-3bbdef85-ec6f-482d-b73f-5534494e3529 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087491 Oct 04 17:51:40.799606 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 408/865] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:40.805119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.805834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.845156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.845695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.846147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.846861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.850262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.850938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.935221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:41.963008 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c7b64ee-adb8-47e9-b44c-d3afd7d9b512 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 1.161650 Oct 04 17:51:41.971791 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 409/866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:41.979749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:41.987289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:42.005777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.017019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.018166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.018642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.019439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.019914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.020352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.026572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.032844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.034733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6062a0b2-585e-4703-ba84-7c55148bbb00 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 1.556931 Oct 04 17:51:42.040367 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 458/867] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:42.048125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-872918446", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "35bfa742-c59f-4f7e-a228-2ef392c75418"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:42.176148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] validate_networks() for [('35bfa742-c59f-4f7e-a228-2ef392c75418', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:42.337113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.349913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b197f385-84ad-40aa-b645-d6705573170c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.376586 Oct 04 17:51:42.350817 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 410/868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:41 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.367770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.367770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:42.376439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.378284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.379757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.390449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.393904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.399901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.539623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.553561 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7000aba9-9b44-4a20-8972-eda8229846d2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1317 microversion: 2.1 time: 0.201328 Oct 04 17:51:42.555369 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 411/869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.560509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ddea12ec-051d-43a0-b85b-0e66f3b39a53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6342029af0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.619682 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ddea12ec-051d-43a0-b85b-0e66f3b39a53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1455 microversion: 2.1 time: 0.062761 Oct 04 17:51:42.620677 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 412/870] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.627638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.629088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:42.638561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.639460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.640092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.641091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.641741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.642358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.832979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.854489 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad470703-5377-4626-aaf5-ff14989f6a47 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.231322 Oct 04 17:51:42.860179 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 413/871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.872935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a046af5f-6cb0-47e9-809a-06155b0fa81f", "tag": "323e8924-c463-460c-b397-a3273113074b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:42.883981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.884463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.885001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.899227 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] Creating event network-changed:323e8924-c463-460c-b397-a3273113074b for instance a046af5f-6cb0-47e9-809a-06155b0fa81f on n-h1-831193-17 Oct 04 17:51:42.906312 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c7afe3cf-fd3e-4d3b-a6e8-9ae9c23edab6 req-070ae583-5139-4619-ba50-be5ef8151342 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039678 Oct 04 17:51:42.910140 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 414/872] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:42.956799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "name": "network-vif-plugged", "status": "completed", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:42.981095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.981568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.982269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.996910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] Creating event network-vif-plugged:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h1-831193-17 Oct 04 17:51:43.002533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f1d79e5c-4777-4aed-9123-a21b642ef452 req-c51a15b3-c3d1-4905-812a-662d66a439ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052655 Oct 04 17:51:43.004359 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 415/873] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:43.010635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.011580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.019001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.019719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.020309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.021183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.021775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.022358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.337221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:43.338244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:43.338882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:43.339503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:43.340628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:43.358116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.358616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.359074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.359834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.360301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.360737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.409247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:43.422017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for user 6f2ae8c47aca4786b8bde4da30d84158 and project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:43.447917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.459357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:43.462252 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2fc53e90-ead1-452e-8a8b-a55e4863ddf2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.452755 Oct 04 17:51:43.464710 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 416/874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:43.468272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:43.476469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.477286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.488094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.488815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.489449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.490380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.491839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.492832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.597251 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3412d70c-ee37-4824-b94d-96c627ea23cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555232 Oct 04 17:51:43.598893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 459/875] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:43.604628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.605263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.623202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.623995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.624593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.625477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.627398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.630789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.913848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.926937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.928652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.929802 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08496d9f-2536-4198-9c8b-6db11fcab9bb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.460037 Oct 04 17:51:43.930578 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 417/876] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:43.935057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.946305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.957870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.969092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.969663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.970028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.970966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.971680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.972384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.980177 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9368b8b8-1ada-4233-acf8-f3faabc32884 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.376234 Oct 04 17:51:43.983583 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 460/877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:43.995924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-efeb7ea0-0eeb-48e2-a7b1-07f2366bc768 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.999086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-efeb7ea0-0eeb-48e2-a7b1-07f2366bc768 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.076056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.088903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aec40160-28a9-41cd-b0d7-08aaa5e6d195 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1325 microversion: 2.1 time: 0.157404 Oct 04 17:51:44.104031 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 418/878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.113076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe4da09f-ead0-4549-998d-d8489822e37f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63420291f0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.186466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe4da09f-ead0-4549-998d-d8489822e37f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1464 microversion: 2.1 time: 0.080796 Oct 04 17:51:44.187975 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 419/879] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.193768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db13119-c61f-4371-b78b-9957079b8055", "name": "network-vif-deleted", "tag": "9625451c-873a-413d-9044-94e317965aff"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:44.217866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.218692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.219400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.234291 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] Creating event network-vif-deleted:9625451c-873a-413d-9044-94e317965aff for instance 1db13119-c61f-4371-b78b-9957079b8055 on n-h2-831193-17 Oct 04 17:51:44.241350 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b00b3517-a10e-42e2-9f92-bad9257b1d6f req-6a476b38-1dcc-4fa1-94fb-11d4ee08a5bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050938 Oct 04 17:51:44.242214 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 420/880] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:44.249346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.250432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.254223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-efeb7ea0-0eeb-48e2-a7b1-07f2366bc768 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.257861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.258805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.259563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.260855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.261635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.262824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.272848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-efeb7ea0-0eeb-48e2-a7b1-07f2366bc768 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1210 microversion: 2.1 time: 0.278611 Oct 04 17:51:44.273554 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 461/881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1210 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.278284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7a1fdbc-6c18-4c40-a890-2d82ef1b646c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a15c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.357901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7a1fdbc-6c18-4c40-a890-2d82ef1b646c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 200 len: 1464 microversion: 2.1 time: 0.082202 Oct 04 17:51:44.359588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 462/882] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.374582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.375243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.396205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.396939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.397377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.399240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.399914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.401035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.666535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.679507 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5839a5d1-f8a5-4374-9c96-7e277bef4c1c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.431805 Oct 04 17:51:44.679743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.688433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-027afe06-6c18-4815-98ea-9465e3e9c6d6 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1466 microversion: 2.1 time: 0.319409 Oct 04 17:51:44.697184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 463/883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1466 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.697184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.697470 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 421/884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.698919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.711403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.711984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.712527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.713237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.713689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.720737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1806161144"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:44.723621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.725348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.738104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.738744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.739244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.740647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.741326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.741940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.910390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.921802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e638552e-3f8f-471b-a461-da527d37c957 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.229849 Oct 04 17:51:44.931712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 464/885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.963448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.964594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.984494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.986558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.988261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.989738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.990528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.991298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.116394 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ba97cc7-ec8e-42ff-a41c-a62fd55f30da tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "POST /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219/action" status: 202 len: 0 microversion: 2.1 time: 0.400091 Oct 04 17:51:45.121620 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 422/886] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:44 2022] POST /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 17:51:45.138224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.142798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.173536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.174173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.178334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.181792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.182327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.184465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.304773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.315317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.316777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.317953 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14976c8b-09ad-4079-88db-846b754f5c1e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1410 microversion: 2.25 time: 0.359000 Oct 04 17:51:45.321128 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 465/887] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1410 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:45.326352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "name": "network-vif-plugged", "status": "completed", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:45.350303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.350786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.353349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.375340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] Creating event network-vif-plugged:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h1-831193-17 Oct 04 17:51:45.386457 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a7a14948-2f36-4153-bc9b-a47edae3bb52 req-68052d3d-b0f3-494f-8228-4e6716a843cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064085 Oct 04 17:51:45.388196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 466/888] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:45.399559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.400625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.407733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.408856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.409379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.411324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.411806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.412447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.496792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.507414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6afeb9a6-686c-46e0-a85f-3d195fd3f28b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1325 microversion: 2.1 time: 0.117638 Oct 04 17:51:45.509394 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 467/889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1325 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.515190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd7109e-936c-4014-ae9f-61ccd8f88292 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a11430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.565692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.566731 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bd7109e-936c-4014-ae9f-61ccd8f88292 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.056027 Oct 04 17:51:45.567352 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 468/890] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.569596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:45.577888 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-32d77182-73b8-4ced-a619-79ae581fa36a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.453233 Oct 04 17:51:45.578976 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 423/891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.583786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.584627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.598224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.599824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.601016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.602831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.604456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.605484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.693132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.701233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b307543a-ac11-43d9-926b-dec143ab2d12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1262 microversion: 2.1 time: 0.124514 Oct 04 17:51:45.701808 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 469/892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1262 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.702939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.703599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.710916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.711490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.712042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.712614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.713066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.713489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.946190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.946838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.953626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.954121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.954566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.955528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.955971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.956705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.123888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.132393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5541e479-f887-4740-a35d-7805889ef9ee tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.190221 Oct 04 17:51:46.132980 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 470/893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:46.235296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.243490 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-065582dd-0c0e-4d94-a4eb-498038dc9b07 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.543999 Oct 04 17:51:46.243946 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 424/894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:46.348355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.349228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.361863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.362389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.363784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.371898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.372632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.373170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.536506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.540024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.550101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.551225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.552226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.553306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.553924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.554570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.677478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.686341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.689883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.694150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ed0eeb0-677f-4500-9801-742b409deeb4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1605 microversion: 2.25 time: 0.349928 Oct 04 17:51:46.699728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.712185 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 471/895] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:46.716666 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2160eb87-199a-40d3-8f71-12f6bd6ecc9b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1323 microversion: 2.1 time: 0.186040 Oct 04 17:51:46.729047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80326381-bdf0-43ae-9495-7d40aebd4568 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a5f940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.732916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 425/896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:46.763505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.764971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.776718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.778012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.779482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.781004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.782050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.783601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.835201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80326381-bdf0-43ae-9495-7d40aebd4568 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.121773 Oct 04 17:51:46.843417 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 472/897] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:46.844213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.844833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.862950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.863467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.863900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.864608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.865064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.865482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.158553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.176206 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26d1a91f-7bd8-483a-be7d-6b6d730bc195 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1268 microversion: 2.1 time: 0.337753 Oct 04 17:51:47.176774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 473/898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1268 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:47.181765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.182442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.195360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.199878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.200608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.201525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.201991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.202415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.284708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.299071 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c8ae65b2-fdaf-4d94-b331-6af8836c31ab tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.564145 Oct 04 17:51:47.299658 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 426/899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:47.315742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.316727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.328842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.329441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.330812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.331675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.332310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.332759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.376131 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9678f4a3-fcbb-44d1-b708-652d42639f0d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.198041 Oct 04 17:51:47.378545 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 474/900] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:47.392260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.393285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.401923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.402765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.404076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.405160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.405948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.406567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.818272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.836736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8543c20-2f70-4876-8a9f-a5e421e7a861 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.455898 Oct 04 17:51:47.838081 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 475/901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:47.843574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.846032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.849999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.852858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.853610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.854274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.857726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.857726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.857726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.861924 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6f15d905-3bb5-408d-a631-c2ab58e7e0bd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.555926 Oct 04 17:51:47.861924 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 427/902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:47.866410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dc8084fa-7943-471f-b47e-608ad5183baa tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341c5ff70>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.956884 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dc8084fa-7943-471f-b47e-608ad5183baa tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.092182 Oct 04 17:51:47.958664 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 428/903] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.203398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.204032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.211109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.211983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.212613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.213334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.213953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.214393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.255980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.268478 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8cceb47-1185-4996-9184-e251cb79f899 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.428280 Oct 04 17:51:48.269354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 476/904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.325974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.331613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.352774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.353284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.353712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.354433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.354894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.356033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.742483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.760030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-776d10bf-fdc0-44e9-b615-620a755f12fe tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1379 microversion: 2.1 time: 0.437578 Oct 04 17:51:48.761134 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 477/905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1379 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.865043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.866088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.870896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.875336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.877198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.877631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.878710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.879365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.880490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.891250 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8746bb56-dd42-46cc-86c9-025493be14db tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.692921 Oct 04 17:51:48.900189 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 429/906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:48.905879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.906690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.912819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:48.920651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.922050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.923801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.924864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.925587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.926238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.166617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.181487 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88d23985-d40f-4fd9-b178-cbd1b298a3a0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.279810 Oct 04 17:51:49.182764 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 430/907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.200780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62509b93-2f3c-41e6-928b-ef296f95c127 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f634213f5e0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.271595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.291651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-60eefbb8-0d02-4eba-97e5-f5c945a2b507 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.434255 Oct 04 17:51:49.298914 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62509b93-2f3c-41e6-928b-ef296f95c127 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.114832 Oct 04 17:51:49.301324 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 431/909] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.314335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 478/909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:49.314335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.314814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:49.317159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e9e98d-0bac-4176-ab18-b935ccd4d5cb", "name": "network-vif-plugged", "status": "completed", "tag": "c8b48788-07cf-403d-aa82-09ab6410d357"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:49.323340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.324655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.325255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.326143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.326762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.327369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.333845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.334446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.334961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.352653 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] Creating event network-vif-plugged:c8b48788-07cf-403d-aa82-09ab6410d357 for instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb on n-h2-831193-17 Oct 04 17:51:49.360670 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-48dcaed0-af08-4cd3-a02b-ee9f8f99b0ee req-ccc1de57-8380-44e1-9aeb-9be36a000931 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056997 Oct 04 17:51:49.361707 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 432/910] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:49.634175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cf741e-4631-468a-8c97-56e5677881b8", "tag": "02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:49.658573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.659430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.661496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.687784 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] Creating event network-changed:02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b for instance 66cf741e-4631-468a-8c97-56e5677881b8 on n-h1-831193-17 Oct 04 17:51:49.694748 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-180dcaaa-8f87-4b56-8a2c-61d7d065b3ba req-9ef74317-6699-4d25-8611-712e0a8c0e93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067267 Oct 04 17:51:49.695404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 433/911] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:49.781205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.786859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.789632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:49.800471 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6adf0a1e-70a2-4c5a-8c2a-c94df6b1eece tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.491254 Oct 04 17:51:49.801060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.801547 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 479/912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.801661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.802005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.802726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.803310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.805272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.883813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:49.897416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.898081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.898700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.912280 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] Creating event network-changed:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h1-831193-17 Oct 04 17:51:49.919698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9165de88-13a9-4427-a0e2-88cab6ec789b req-6b903dc1-d1c9-4737-b883-287dff78b260 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039524 Oct 04 17:51:49.921036 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 480/913] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:49.928157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.928779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:49.936680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.937520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.938196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.939958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.940672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.941318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.114548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.124410 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f603c62d-2fbd-4152-98d7-87ef2f90d857 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1529 microversion: 2.1 time: 0.343717 Oct 04 17:51:50.125215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 434/914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1529 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:50.149104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.150381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.156684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.157189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.157635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.158354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.158827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.159830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.301280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.312487 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1689bef-82c7-4b32-be5f-8b08b9927475 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1529 microversion: 2.1 time: 0.168123 Oct 04 17:51:50.313106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 435/915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1529 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.318881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.320090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.327677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.328497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.329151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.330257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.330789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.331326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.432930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.443805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a948b23-a241-48e9-a650-a0c4717cfccd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.521159 Oct 04 17:51:50.445795 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 481/916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.474044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.475188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.484332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.485281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.485912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.486818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.487492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.488173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.721039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.732109 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb047b80-7ffb-4510-b918-853562d98dbd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1319 microversion: 2.1 time: 0.417462 Oct 04 17:51:50.733324 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 436/917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.738336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d2bf58a-c36b-48ce-b378-06b403a7dbf2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341f4dca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.797513 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5d2bf58a-c36b-48ce-b378-06b403a7dbf2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.062839 Oct 04 17:51:50.798705 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 437/918] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.803480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-59bc2bdf-c025-4ce6-af0b-a9feea033c56 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.842847 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-59bc2bdf-c025-4ce6-af0b-a9feea033c56 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/ce27549a-411c-46b1-b5ec-75f38c659936" status: 202 len: 0 microversion: 2.1 time: 0.042503 Oct 04 17:51:50.843780 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 438/919] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:50 2022] DELETE /compute/v2.1/flavors/ce27549a-411c-46b1-b5ec-75f38c659936 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:51:50.849639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.850526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.856089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.865269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cdf98bc1-4ab0-409e-8b1b-6c9c0d544c42 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.403671 Oct 04 17:51:50.868453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.869515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 482/920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.869677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.870588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.872709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.873412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.874039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.883024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4455ebdd-1a56-4f8f-81d7-96cc2370bbcd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.926447 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4455ebdd-1a56-4f8f-81d7-96cc2370bbcd tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.055210 Oct 04 17:51:50.927120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 483/921] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.947553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:50.950586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.957160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.957896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.958488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.959401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.960412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.960998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.001260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.011443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Old instance type tempest-test_resize_flavor_-1116994639, new instance type m1.heat {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 17:51:51.029206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:51.029632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:51.032432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:51.033243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:51.033672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:51.173975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-280cd926-ca83-4b51-a2c4-cfe0870ab234 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414/action" status: 202 len: 0 microversion: 2.1 time: 0.230543 Oct 04 17:51:51.175126 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 484/922] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:50 2022] POST /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:51:51.183126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:51.184762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:51.195934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:51.201729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.208205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.208945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.209855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.210651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.211267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.496019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.505775 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-95d1dbfe-93fb-4422-9ca7-d52c5c6a5541 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1538 microversion: 2.1 time: 0.326482 Oct 04 17:51:51.507094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 485/923] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1538 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:51.512931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}, {"server_uuid": "a046af5f-6cb0-47e9-809a-06155b0fa81f", "name": "network-vif-plugged", "status": "completed", "tag": "323e8924-c463-460c-b397-a3273113074b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:51.524909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.525657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.527020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.556385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Creating event network-vif-unplugged:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:51:51.559628 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] Creating event network-vif-plugged:323e8924-c463-460c-b397-a3273113074b for instance a046af5f-6cb0-47e9-809a-06155b0fa81f on n-h1-831193-17 Oct 04 17:51:51.628577 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-475bc058-bd77-4dc1-a204-2d0dba663664 req-a4c38ee2-e0a7-4c5e-8547-926b0f49efeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.116542 Oct 04 17:51:51.629277 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 486/924] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:51.647926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:51.648644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:51.680357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.680867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.681377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.686143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.687682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.688143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.702583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.720615 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-93c45553-dd9a-4be8-86ef-035c61b2068c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.875201 Oct 04 17:51:51.721667 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 439/925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:51.759612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:51.760234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:51.778309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.778803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.782641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.783012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.783515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.784021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.925419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.942551 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e62778a9-a3c9-422a-b775-030a3238f06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.308066 Oct 04 17:51:51.955543 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 487/926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:51.964059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e1c306bb-26f6-419d-8124-d5d27349a168 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a664c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.057983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e1c306bb-26f6-419d-8124-d5d27349a168 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.101088 Oct 04 17:51:52.065867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 488/927] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.065867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.065867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.071658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.072155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.072680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.073584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.074600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.075051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.164949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.175712 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36ee7067-aa7d-4f3b-b97e-8e7e03d0ddca tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1469 microversion: 2.1 time: 0.420255 Oct 04 17:51:52.176307 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 440/928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.187097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acee0e99-55b1-4963-b49a-d3f09c9250b0", "tag": "c42df1a1-e456-42cb-b731-8b5eb199a70e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:52.198127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.198610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.199714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.216322 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] Creating event network-changed:c42df1a1-e456-42cb-b731-8b5eb199a70e for instance acee0e99-55b1-4963-b49a-d3f09c9250b0 on n-h2-831193-17 Oct 04 17:51:52.222781 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-7c1dcf2c-4af3-463d-b82c-4f02cac44549 req-af0d1223-75b3-426f-8b6a-5ce42f245ccb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045260 Oct 04 17:51:52.224181 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 441/929] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:52.232188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.233886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.240761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.241543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.242402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.244002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.245142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.246201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.303225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.316037 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-485630b4-c72e-429a-9189-3a5568a9449f tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.255984 Oct 04 17:51:52.317445 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 489/930] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.482212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.492221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-73d86415-e5b9-4aac-9643-482a4ec1a6a5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1319 microversion: 2.1 time: 0.264512 Oct 04 17:51:52.493504 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 442/931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.533564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.534183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.542777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.543228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.543672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.544391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.544892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.545373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.720739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.728898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc70c245-578c-43d7-b222-70a31a0355a9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1538 microversion: 2.1 time: 0.199751 Oct 04 17:51:52.729703 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 490/932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1538 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:52.758639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.763980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.771932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.773111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.773586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.774739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.775242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.775686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.962212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.973857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.974565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.976054 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be934930-42d6-4614-b7f6-c1c94815198c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.223681 Oct 04 17:51:52.977428 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 443/933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.986889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.987431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.988635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.989361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.989834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.990255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.077165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d5fd70e9-ce99-40db-88ed-cb14119ee5a8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63420c9700>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.176811 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d5fd70e9-ce99-40db-88ed-cb14119ee5a8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.106264 Oct 04 17:51:53.177883 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 444/934] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:53.315241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.329636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a8a74f0-229f-4120-b0da-9186149baf33 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.360503 Oct 04 17:51:53.330239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 491/935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:53.346960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.348024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:53.362423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.363503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.364138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.365176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.365803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.366396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.519778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.520410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:53.542534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:53.548906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.549744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.550821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.556097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.557033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.557812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.593380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.607997 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b8c1776d-fe35-43d2-b58b-bfbb9e895922 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.271020 Oct 04 17:51:53.608874 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 445/936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:53.649016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d70836b-a650-4fbd-9a80-4a70b5b4788d", "name": "network-vif-plugged", "status": "completed", "tag": "80c7950b-3d22-4153-a74f-99ef8625a1b7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:53.668247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.669016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.669696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.691639 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] Creating event network-vif-plugged:80c7950b-3d22-4153-a74f-99ef8625a1b7 for instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d on n-h1-831193-17 Oct 04 17:51:53.707910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4f565295-811f-4c1e-8794-df8961544cce req-59d5bc52-97c3-4cd7-bf72-4bc2f356f0e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064311 Oct 04 17:51:53.709848 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 446/937] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:53.762814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.763725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:53.798511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.807966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.809410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.811013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.811856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.812519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.845843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.858529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87d1a851-5b4d-4657-ab7b-aef4f4729126 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1319 microversion: 2.1 time: 0.345068 Oct 04 17:51:53.860732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 492/938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.002888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.005346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.019051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.019983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.020609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.022365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.023149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.027690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.259484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=13 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:54.313476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:54.323801 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-018284c5-9a8b-4cdc-9192-f6987ac827fa tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.325184 Oct 04 17:51:54.329094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 493/939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:54.334689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:54.338410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0ee9616-9ebe-4f05-85d8-f5bffa0b0d43 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419be820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.354352 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bb19a653-bffa-4f0f-8f35-5fb86150e11b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1538 microversion: 2.1 time: 0.599088 Oct 04 17:51:54.363114 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 447/940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1538 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.363114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.365372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.373744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.374246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.374721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.375663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.376127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.376716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.381605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:54.416860 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0ee9616-9ebe-4f05-85d8-f5bffa0b0d43 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.085693 Oct 04 17:51:54.426350 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 494/941] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.546126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:54.554527 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8f9a105f-b59b-4e01-b225-fff8f77b81f7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.197447 Oct 04 17:51:54.559410 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 448/942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.635494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.636554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.643998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.644588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.645278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.646347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.646810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.647449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.812114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:54.828681 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51238e41-471f-40b0-864b-f3e57ff4bfcb tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.195872 Oct 04 17:51:54.831180 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 495/943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.886294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.887633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.894251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.894828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.895360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.896313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.896971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.897611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.066972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.076644 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83fed77f-7b8e-480f-87c6-43b1201e7255 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1319 microversion: 2.1 time: 0.196571 Oct 04 17:51:55.094685 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 449/944] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:55.350096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.351442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.363136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.364177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.365177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.366124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.366792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.367477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.377996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.379368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.390956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.391546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.392063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.392852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.393379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.393944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.591733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.606246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.609322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1fdc7b35-057a-49b7-b789-cfbce28d065b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.264433 Oct 04 17:51:55.610659 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 496/945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.614775 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7e615fff-5186-475b-bb43-277f427ea807 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1538 microversion: 2.1 time: 0.240579 Oct 04 17:51:55.617506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5d55fd3-014c-43a2-b912-efab39a6f720 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419bee50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.632189 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 450/946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1538 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.637681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.638296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.644981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.645484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.645923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.646829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.647452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.647889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.677969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5d55fd3-014c-43a2-b912-efab39a6f720 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.066016 Oct 04 17:51:55.679352 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 497/947] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.731803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271236f-c547-44f0-9916-f884faebc219", "name": "network-vif-plugged", "status": "completed", "tag": "10d9a6ec-45cc-431b-bce1-58cc29f185a5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:55.755909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.756313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.756754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.782193 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] Creating event network-vif-plugged:10d9a6ec-45cc-431b-bce1-58cc29f185a5 for instance a271236f-c547-44f0-9916-f884faebc219 on n-h1-831193-17 Oct 04 17:51:55.810812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.828183 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba413200-ef54-43d1-abfd-84237c5caaf7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.194129 Oct 04 17:51:55.829427 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 451/948] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.853216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.854267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.861178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.861669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.862103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.862814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.863294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.864016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.866951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cd9ecc67-acdf-4733-963b-f4a6769ce2bf req-c2d48a6d-a626-4279-8c6f-d6f6ed065b67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141294 Oct 04 17:51:55.867612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 498/949] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:56.014055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:56.024450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-053ea092-1bcd-4d9a-9579-9fb39f97fb5b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1367 microversion: 2.1 time: 0.175076 Oct 04 17:51:56.027299 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 452/950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:56.101964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:56.101964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:56.110435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.110928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.111420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.112119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.112571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.112995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.293732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:56.298087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:56.305082 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55627c6d-9978-4e18-9b79-d320829543cb tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1469 microversion: 2.1 time: 0.207943 Oct 04 17:51:56.319674 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 499/951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:56 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:56.334989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:56.341981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:56.342984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Searching by: {'reservation_id': 'r-pj0zybgj', 'deleted': False, 'project_id': 'c329d327a97e476581dc870e8e71a712'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:51:56.353369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.353981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.355026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.356541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.357071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.357585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.547290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:51:56.659598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:56.662886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:56.709061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.712399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.714380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.716849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.722757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.726839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.803197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:56.815715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.816278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.816726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.008218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:57.019416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-509921d1-49eb-4c6e-86ca-a882e234f339 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.374768 Oct 04 17:51:57.021245 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 500/952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:56 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.044402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.045351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.057110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.058570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.060292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.061384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.062117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.063382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.264855 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-670615f0-e26f-4a0b-a9ab-27093f016000 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-pj0zybgj" status: 200 len: 2931 microversion: 2.1 time: 0.938567 Oct 04 17:51:57.265836 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 453/953] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Oct 4 17:51:56 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pj0zybgj => generated 2931 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.271008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3ca3ca5-cb5c-4c83-95fc-909b9e69e75d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63422c7d30>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.307407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:57.316185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-135def09-1a24-4d67-b482-59a9cfafaf4e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1538 microversion: 2.1 time: 0.293576 Oct 04 17:51:57.316783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 501/954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1538 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.328270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.328966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.360279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.363061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.364403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.366884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.368173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.369715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.377643 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3ca3ca5-cb5c-4c83-95fc-909b9e69e75d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.110519 Oct 04 17:51:57.380913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 454/955] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.412071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.412846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.446537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.447066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.447640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.449998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.452288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.452765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.575063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:57.584842 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41887c64-d90d-4629-bc3c-f4a4428893cb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.266989 Oct 04 17:51:57.590254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 502/956] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.608921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.645219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_groups [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Querying cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) for 2 instances {{(pid=128770) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 17:51:57.645961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.646548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.647006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.674472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:57.685587 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e795f57-8c09-4626-b332-6b520a2b1617 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1557 microversion: 2.1 time: 0.301297 Oct 04 17:51:57.687539 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 455/957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1557 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.714428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c13d493-9532-4317-b84f-8da5eb242ab3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/bb184c12-004c-408a-806a-a91c0861450f" status: 200 len: 271 microversion: 2.1 time: 0.122411 Oct 04 17:51:57.715637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 503/958] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/os-server-groups/bb184c12-004c-408a-806a-a91c0861450f => generated 271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:57.719067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.719549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.722709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:57.729880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.730991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.731452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.732308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.732763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.733183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.733684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.734308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.748908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.749461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.749895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.750609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.751097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.753770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.940757 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-47357bea-860a-46eb-ad5b-cbf25e44cd24 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226737 Oct 04 17:51:57.941735 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 456/959] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:57.948921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acee0e99-55b1-4963-b49a-d3f09c9250b0", "name": "network-vif-plugged", "status": "completed", "tag": "c42df1a1-e456-42cb-b731-8b5eb199a70e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:57.964407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.967513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.968350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.986192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c03bb20-aa94-4814-9d01-9b1e9912175a tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 200 len: 1622 microversion: 2.1 time: 0.258192 Oct 04 17:51:57.988470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 504/960] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 1622 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.993137 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] Creating event network-vif-plugged:c42df1a1-e456-42cb-b731-8b5eb199a70e for instance acee0e99-55b1-4963-b49a-d3f09c9250b0 on n-h2-831193-17 Oct 04 17:51:58.013681 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-d857e5fa-dd47-4b9e-84aa-2063dc1eeceb req-a3a70f00-d16b-4ec0-b882-27ccaa52464a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069294 Oct 04 17:51:58.017399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.018012 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 457/961] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:58.019878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:58.027593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.028409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.029643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.030635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.031331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.032188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.059338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.060107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:58.074441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.075139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.075708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.076448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.076908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.083659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.289851 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a485884-1df6-460a-904c-ad5288755d87 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1622 microversion: 2.1 time: 0.264590 Oct 04 17:51:58.291268 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 505/962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1622 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:58.345284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.346957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:58.360257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.365292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.366018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.367192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.367782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.368325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.435481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:58.445903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9336894a-420d-461e-a23e-0b498d8a7ff7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.392800 Oct 04 17:51:58.461338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 458/963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:58.466808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-479733414", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "15b565ff-d036-43bf-bd95-f99596021e22"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:58.570193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:58.578537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dae9c921-64e5-4fdc-b4e3-f99b3fc59364 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.237322 Oct 04 17:51:58.579885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 506/964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:58.584337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84d61011-8e9d-45b4-8ca6-a5bfd88a9fa9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a4fb80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.607112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:58.653797 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84d61011-8e9d-45b4-8ca6-a5bfd88a9fa9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.072850 Oct 04 17:51:58.658403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 507/965] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:58.661606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.661606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:58.669950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.670539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.671092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.671873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.672398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.672892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.881931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:58.897625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5aab9ccc-c92a-4150-82d7-c351835ea6bc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1310 microversion: 2.1 time: 0.241604 Oct 04 17:51:58.898467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 508/966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:59.175133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:59.175515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:59.180255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:59.180255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:59.180255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:59.194606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.197450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.199323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.200504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.201050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.201542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.228136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:59.238275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:59.265248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:59.267724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:59.372096 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36dc2412-1bed-4bff-8128-b2f180d60315 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921444 Oct 04 17:51:59.380569 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 459/967] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:59.393111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85c99c45-4ef9-4f7b-a170-3ee81674e044 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:59.394469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85c99c45-4ef9-4f7b-a170-3ee81674e044 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:59.470010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:59.471527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:59.513896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.515049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.516830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.517846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.518683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.519333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.548093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85c99c45-4ef9-4f7b-a170-3ee81674e044 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:59.562713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85c99c45-4ef9-4f7b-a170-3ee81674e044 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1216 microversion: 2.1 time: 0.181242 Oct 04 17:51:59.584086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 509/968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:59 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1216 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:59.610515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:59.611168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:59.625740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.626246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.626690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.627446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.627881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.628314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.909898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:59.948560 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d024fbf7-22b7-43f4-84f2-ebce1cad557a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.340134 Oct 04 17:51:59.952077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 510/969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:59 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:59.968224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-743a9a21-49c8-4707-8e72-1cc18331d6f1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419f0940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.032329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-743a9a21-49c8-4707-8e72-1cc18331d6f1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.079164 Oct 04 17:52:00.038845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 511/970] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:51:59 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:00.054808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.055819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.067555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.072275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.073126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.074706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.076168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.077154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.273940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:00.289893 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27e7e1a3-cfbd-441b-99b7-f23f6317c0c5 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1491 microversion: 2.1 time: 0.248641 Oct 04 17:52:00.290112 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 512/971] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1491 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:00.304849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cf741e-4631-468a-8c97-56e5677881b8", "name": "network-vif-plugged", "status": "completed", "tag": "02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:00.310689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.311222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.311657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.334758 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] Creating event network-vif-plugged:02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b for instance 66cf741e-4631-468a-8c97-56e5677881b8 on n-h1-831193-17 Oct 04 17:52:00.341203 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-472d57de-ab10-4414-ac70-92c3c78ad872 req-1c201aeb-51c5-4493-8eca-9a223b597305 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049734 Oct 04 17:52:00.343661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 513/972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:00.348866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:00.349523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.350937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.357548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.358077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.358520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.359283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.359741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.360169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.404511 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b063a20b-d47d-45c6-b931-e348255e4e17 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.917815 Oct 04 17:52:00.439493 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 460/973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:59 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:00.602064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.603887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.627533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.633791 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c927e026-0de2-4b8f-9499-0ef922971353 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1644 microversion: 2.1 time: 0.282937 Oct 04 17:52:00.635059 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 514/974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1644 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:00.642145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a046af5f-6cb0-47e9-809a-06155b0fa81f", "tag": "323e8924-c463-460c-b397-a3273113074b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:00.647708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.648288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.649072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.649559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.650008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.662387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.663768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.664413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.681401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] Creating event network-changed:323e8924-c463-460c-b397-a3273113074b for instance a046af5f-6cb0-47e9-809a-06155b0fa81f on n-h1-831193-17 Oct 04 17:52:00.687441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-87d2a6bf-f247-4c7a-9334-6c42ad1479c2 req-0bc71fb2-13fc-4fd2-96f7-16b907c97d4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050595 Oct 04 17:52:00.689382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 515/975] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:00.696570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.698048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.706268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.707219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.707988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.708980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.709649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.710451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.754657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:00.764910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22a930a4-7497-42b8-8661-ec2bb9c0aa88 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1268 microversion: 2.1 time: 0.179289 Oct 04 17:52:00.766353 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 461/976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:00.977065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.977683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.001765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.002272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.005696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.008663 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e3ea02b3-0917-46c4-aeb3-95ae5fb0f4ea tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1644 microversion: 2.1 time: 0.317681 Oct 04 17:52:01.010149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 516/977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1644 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.023184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.023698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.024147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.032965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.038699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.039537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.044349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.045835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.048201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.050455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.118971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cd321a5-1b76-4201-9876-02b3da485078 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.089875 Oct 04 17:52:01.120141 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 517/978] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:01.127287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5fc4af42-2f4d-42de-85cb-e75ccc0e223e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419bec10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.193215 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5fc4af42-2f4d-42de-85cb-e75ccc0e223e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.071955 Oct 04 17:52:01.202449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 518/979] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.207701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:01.208241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.215308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.216598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.217345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.218253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.218723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.219728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.301453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b3aa043-feb9-4c2f-a8f0-0c15a6020333 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0/action" status: 202 len: 0 microversion: 2.1 time: 0.098030 Oct 04 17:52:01.305160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 519/980] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:01 2022] POST /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:01.319046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.320261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.327921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.328412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.328852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.330003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.330542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.330978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.445963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:01.464655 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c37750c-4858-44e3-8282-53ab661f7fc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.492820 Oct 04 17:52:01.469988 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 462/981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.473825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.474708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.488415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.489116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.489770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.490830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.491481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.492079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.541743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87f6a7f6-6b47-4d48-8451-b96dd8078de5 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1649 microversion: 2.1 time: 0.227811 Oct 04 17:52:01.544026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 520/982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1649 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.750434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:01.761735 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e2da592f-624e-4fbe-8f4e-a200658bf581 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1390 microversion: 2.1 time: 0.291956 Oct 04 17:52:01.762487 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 463/983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1390 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.804318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.808327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.840624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.846349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.847151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.848349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.849336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.856523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.016742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:02.024175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:02.030156 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e13d9bde-19ee-42f5-a604-54b9caeef2b1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1276 microversion: 2.1 time: 0.239605 Oct 04 17:52:02.031067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 521/984] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:02.209356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b5161bbe-b40c-4918-b658-91c4999baba3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63420d2160>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.278046 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b5161bbe-b40c-4918-b658-91c4999baba3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.072690 Oct 04 17:52:02.278649 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 464/985] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:02.488320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.489212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:02.501766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.503176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.503796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.504703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.505984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.506661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.565929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.567063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:02.575526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.576263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.576908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.577851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.578804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.579471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.780241 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60e8a1b5-43dd-4673-8885-45772d28a43d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1629 microversion: 2.1 time: 0.218081 Oct 04 17:52:02.781953 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 465/986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1629 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:02.792618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.793991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:02.802511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.803775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.804276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.805559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.806094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.806921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.882378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:02.899762 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9eb8a6c-f9e1-4af3-b311-1a11ec6b6d24 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.415622 Oct 04 17:52:02.902423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 522/987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:02.911434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831193-17", "block_migration": true, "disk_over_commit": false}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:02.920184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:02.946208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.946713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.949936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.954358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.954863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.955333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.013043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lazy-loading 'flavor' on Instance uuid acee0e99-55b1-4963-b49a-d3f09c9250b0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:03.047636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Going to try to live migrate instance to n-h1-831193-17 {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:52:03.084319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:03.095080 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab3fa48f-3de5-4337-bb50-88f053b1786b tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1590 microversion: 2.1 time: 0.308270 Oct 04 17:52:03.106725 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 466/988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1590 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:03.117102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:03.117730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:03.150477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.152478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.153374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.154344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.154972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.155625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.431985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:03.444008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:03.449586 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a40ff08b-92cd-441b-960e-8ca98f46d0ef tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.341892 Oct 04 17:52:03.451120 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 467/989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:03 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:03.456853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:03.457582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:03.466303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.467167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.467854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.468821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.469498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.470163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.573690 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-708d3b8e-d990-4707-b6e0-fc151a854fe1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121141 Oct 04 17:52:03.575256 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 468/990] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:52:03 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:03.580159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36eb7ced-df9d-4187-9f09-e5442caf6a41 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6342286ca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:03.650285 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36eb7ced-df9d-4187-9f09-e5442caf6a41 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.073581 Oct 04 17:52:03.667130 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 469/991] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:03 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:03.949182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:03.949839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:03.961074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.961679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.967896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.969025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.969682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.970506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:04.265668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:04.274242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-43d704ea-b4c5-4033-8006-413d0bf521de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.329870 Oct 04 17:52:04.275049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 470/992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:03 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:04.475016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:04.475947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:04.486502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:04.495218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:04.495728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:04.496502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:04.496969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:04.497404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.036796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:05.052359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ae3cddc-1749-498d-bb12-aaa075b5ca4a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.580987 Oct 04 17:52:05.053534 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 471/993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:04 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:05.059296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4de8f409-70f3-4c02-bb8d-a2ddb7bf07b8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63420ba820>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:05.151002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4de8f409-70f3-4c02-bb8d-a2ddb7bf07b8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.088646 Oct 04 17:52:05.151781 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 472/994] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:05 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:05.162963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3235f9-5c47-4913-832e-992a80c41371", "tag": "704a5bc8-08b9-499b-aa9a-b21b3c2639ae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:05.203977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.204470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.204909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.221520 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] Creating event network-changed:704a5bc8-08b9-499b-aa9a-b21b3c2639ae for instance 3d3235f9-5c47-4913-832e-992a80c41371 on n-h2-831193-17 Oct 04 17:52:05.238721 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5d9bdd88-cd47-4a10-b9fc-0e7cfe6b1300 req-90f230eb-7513-41a7-b51a-b2292a0d74a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085245 Oct 04 17:52:05.239588 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 473/995] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:05.313266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:05.316736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:05.332431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.333340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.333957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.341459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.342213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.342872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.788234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:05.820641 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc2eb29d-15aa-4f12-b8d3-749f59a0e562 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.506177 Oct 04 17:52:05.822446 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 474/996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:05 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:06.082324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.084826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:06.092758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.094242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.095386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.097009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.097746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.098203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.328378 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1519cd6a-407a-4234-afe1-4d6e5bcbf9cb tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0/action" status: 202 len: 0 microversion: 2.1 time: 3.424801 Oct 04 17:52:06.333766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 523/997] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:02 2022] POST /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0/action => generated 0 bytes in 3431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:06.341794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84fe56ad-22fa-444a-b4c3-57a17012e00b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419a7ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.346949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:06.365059 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-19d4fe8f-ee4b-42ca-a6e0-c2fafafbbdff tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.286613 Oct 04 17:52:06.378537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 475/998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:06.392907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.394978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:06.445899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.450491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.451275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.453660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.454864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.455941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.497811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84fe56ad-22fa-444a-b4c3-57a17012e00b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.161736 Oct 04 17:52:06.498658 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 524/999] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:06.503346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cf741e-4631-468a-8c97-56e5677881b8", "tag": "02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:06.531824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.539607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.546166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.559175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] Creating event network-changed:02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b for instance 66cf741e-4631-468a-8c97-56e5677881b8 on n-h1-831193-17 Oct 04 17:52:06.565326 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0026c9dc-ae27-4ac5-8065-876b26b43e2d req-9dc4107c-0b7f-4800-9b7e-402fa4092db6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065350 Oct 04 17:52:06.566807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 525/1000] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:06.572918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.574835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:06.581902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.582682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.597116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.598495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.599853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.600524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.925518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:06.936715 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54d011d2-0943-4f17-bfad-0230b04fd14d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.367925 Oct 04 17:52:06.937580 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 526/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:06.967050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.970207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:06.984871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.986367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.987701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.988707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:06.989323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:06.989939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.033781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:07.045459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3c1f118a-7703-47c9-be5c-fd1cd3a899e0 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1590 microversion: 2.1 time: 0.665139 Oct 04 17:52:07.072835 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 476/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1590 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:07.397728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:07.407404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:07.418657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.425070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.425872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.426839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.428710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.429229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.552564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:07.570532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf67c90b-b369-4f22-a8a9-0053f909ac2f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.631695 Oct 04 17:52:07.583559 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 527/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:07.597122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c795decd-a40e-47b8-aa6f-703c6880258a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341940a60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:07.686630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c795decd-a40e-47b8-aa6f-703c6880258a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1455 microversion: 2.1 time: 0.101686 Oct 04 17:52:07.688128 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 528/1004] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:07 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:07.966951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:07.967671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:07.975120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.976027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.976702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.977593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.978274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.978853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.089416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:08.103373 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0584de3f-866e-4eed-8e6c-fef386afc3f0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.711900 Oct 04 17:52:08.104709 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 477/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:07 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:08.276054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abd7a765-52c7-4c2a-8dcd-f878c0aeb1a5"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:08.279013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:08.285269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.285850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.286359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.287544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.288277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.288924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.300950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:08.311717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8f5b286-d810-46df-8048-d5bf5047a494 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.349072 Oct 04 17:52:08.313002 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 529/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:07 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:08.603547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:08.605886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:08.613395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.614173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.614607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.615560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.616022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.616483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.679944 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-289e37e9-2e27-4b68-884e-77b410456ff7 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "POST /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407735 Oct 04 17:52:08.687131 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 478/1007] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 17:52:08 2022] POST /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:08.706341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-42f694d1-a6a7-44c8-a571-9bd14a123887 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341ae7550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:08.775372 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-42f694d1-a6a7-44c8-a571-9bd14a123887 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1464 microversion: 2.1 time: 0.074705 Oct 04 17:52:08.776507 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 479/1008] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:08 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:08.786723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:08.789901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e3959d32-be05-433b-8f4d-048ccc310b55 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341adf4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:08.795729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef2aa756-b85d-482f-a948-a9cad45a249e tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.198123 Oct 04 17:52:08.796316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 530/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:08 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:08.844324 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e3959d32-be05-433b-8f4d-048ccc310b55 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 200 len: 1464 microversion: 2.1 time: 0.058132 Oct 04 17:52:08.844916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 480/1010] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:08 2022] GET /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 1464 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:08.859654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:08.860269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:08.866364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.866845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.867314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:08.868005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:08.868456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:08.868874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.017729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:09.030442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e69726b6-77f9-4698-b457-15ce438340e3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1467 microversion: 2.1 time: 0.175028 Oct 04 17:52:09.031640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 531/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:08 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1467 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:09.054499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-400800062"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:09.057014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.064587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.065061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.065491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.066405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.066870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.067314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.131880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.132791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.142483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.142996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.143470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.144195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.148268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.148729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.210855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:09.250005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:09.347163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:09.362338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ebe0872-c215-423b-8b62-581c65d696d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.237931 Oct 04 17:52:09.366156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 532/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:09.371926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.372982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.383399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.384552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.385546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.387646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.388693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.389641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.428099 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c22e0541-01a7-41e1-8213-7d84c3bbd18a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "POST /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.377220 Oct 04 17:52:09.431571 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 481/1013] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:09 2022] POST /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:52:09.452450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-536ea69b-2c3a-42f8-961f-dd5e576bcc1e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341adfc10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.515973 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-536ea69b-2c3a-42f8-961f-dd5e576bcc1e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.076922 Oct 04 17:52:09.525217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 482/1014] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:09.554557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:09.591079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:09.607931 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3159d89-cf3e-4bc7-9fda-a9ec23c70e2d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.240277 Oct 04 17:52:09.610355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 533/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:09.684286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acee0e99-55b1-4963-b49a-d3f09c9250b0", "name": "network-vif-unplugged", "status": "completed", "tag": "c42df1a1-e456-42cb-b731-8b5eb199a70e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:09.695866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.696622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.697272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.710283 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] Creating event network-vif-unplugged:c42df1a1-e456-42cb-b731-8b5eb199a70e for instance acee0e99-55b1-4963-b49a-d3f09c9250b0 on n-h2-831193-17 Oct 04 17:52:09.716031 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4e0781bd-1c31-4b7f-85b7-c269ba71c898 req-08a38d9f-7a9f-4e49-af87-6a17d8a82290 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036852 Oct 04 17:52:09.717342 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 483/1016] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:09.826312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.827409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.838801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.843485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.844055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.844896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.846064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.847545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.028078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:10.036141 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0cb5971-3df5-40c4-b8ff-db5851c500f7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.220205 Oct 04 17:52:10.036734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 534/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:10.394499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.395606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:10.402348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.402847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.403381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.404082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.404539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.404973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.540643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c7551fb-3a79-4766-bacf-db30034689f7 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419a7c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.546423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:10.555047 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-18eab52c-3cb1-45d3-ba35-cf3b073dc7cd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.164837 Oct 04 17:52:10.555842 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 484/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:10.587887 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c7551fb-3a79-4766-bacf-db30034689f7 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.051002 Oct 04 17:52:10.588556 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 535/1019] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:10.635476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.636093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:10.642363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.642859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.643320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.644025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.644485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.644964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.786971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:10.795879 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-463cb10b-b752-4f30-b846-718e6053e398 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.164256 Oct 04 17:52:10.796460 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 485/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:11.060413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.061098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:11.067893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.068388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.069089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.070091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.070882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.071378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.078848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:11.222355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:11.231127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63b8ed4e-0132-4691-b887-a1b09cd4419a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.175185 Oct 04 17:52:11.239686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 536/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:11.388245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3235f9-5c47-4913-832e-992a80c41371", "name": "network-vif-plugged", "status": "completed", "tag": "704a5bc8-08b9-499b-aa9a-b21b3c2639ae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:11.399975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.400701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.401358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.416004 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] Creating event network-vif-plugged:704a5bc8-08b9-499b-aa9a-b21b3c2639ae for instance 3d3235f9-5c47-4913-832e-992a80c41371 on n-h2-831193-17 Oct 04 17:52:11.422234 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3c714ab7-e3c6-4d09-a338-eebca8a0d8c0 req-664d0dae-e788-454f-9223-9c4c40df9ddc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Oct 04 17:52:11.423702 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 486/1022] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:11.578071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.579171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:11.586719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.587595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.588225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.589247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.589891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.591268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.605817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c8bdc78-ae05-4ef2-915f-810ef5649567 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341adfe50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.674912 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c8bdc78-ae05-4ef2-915f-810ef5649567 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.073832 Oct 04 17:52:11.683639 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 487/1023] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:11.739203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acee0e99-55b1-4963-b49a-d3f09c9250b0", "tag": "c42df1a1-e456-42cb-b731-8b5eb199a70e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:11.752558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.753385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.754698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.771259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:11.778779 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] Creating event network-changed:c42df1a1-e456-42cb-b731-8b5eb199a70e for instance acee0e99-55b1-4963-b49a-d3f09c9250b0 on n-h2-831193-17 Oct 04 17:52:11.780621 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7faa6b0b-8c5a-4212-b73a-1ee49897e57f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.206724 Oct 04 17:52:11.781381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 537/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:11.798365 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f54a358d-30ba-40fe-847c-f4bd5b013a16 req-7ebddd13-819d-4bca-8970-e64da29c45ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066077 Oct 04 17:52:11.799058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 488/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:11.819100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.819969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:11.827448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.827934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.828371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.829074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.831440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.831918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.025227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:12.034041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0257534f-cbdd-4568-a60d-8fad9bc9cad2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.219275 Oct 04 17:52:12.034809 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 538/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:12.254455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:12.255200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:12.270382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.270876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.271357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.272111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.272564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.272985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.419689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:12.427858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e1080f9d-fed5-48f8-bd35-201df42fa4de tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.177746 Oct 04 17:52:12.428444 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 489/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:12 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:12.690806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34e211af-4b16-4b6a-b47c-d03794f05890 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a4f5e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:12.738743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34e211af-4b16-4b6a-b47c-d03794f05890 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.051736 Oct 04 17:52:12.739385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 539/1028] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:12 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:12.803911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:12.804704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:12.812325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.812819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.813258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.813967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.814452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.815042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.956468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:12.960137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:12.966314 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78731e6f-5909-4e6b-a3e6-55068b595dea tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1316 microversion: 2.1 time: 0.166576 Oct 04 17:52:12.966989 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 490/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:12 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.057246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.057884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:13.065142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.065630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.066063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.066767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.067297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.067723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.221263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:13.230647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15bbe37e-ad5b-4a94-8d41-2046bad8061a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.176675 Oct 04 17:52:13.231288 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 540/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.439582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271236f-c547-44f0-9916-f884faebc219", "name": "network-vif-unplugged", "status": "completed", "tag": "10d9a6ec-45cc-431b-bce1-58cc29f185a5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:13.451785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.452775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:13.458876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:13.461744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.462088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.462468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.462735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.463000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.463153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.464200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.465030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.465460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.473690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:13.488335 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] Creating event network-vif-unplugged:10d9a6ec-45cc-431b-bce1-58cc29f185a5 for instance a271236f-c547-44f0-9916-f884faebc219 on n-h1-831193-17 Oct 04 17:52:13.494758 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3fa65e91-18ca-471a-bfa3-f26f251b5ad8 req-203c8b38-9d74-442b-abae-60124548c5ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059443 Oct 04 17:52:13.495883 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 491/1031] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:13.631803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:13.641266 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb2d84d9-7451-4160-83fd-d7825576a368 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.193264 Oct 04 17:52:13.642144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 541/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.756484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c6b7f7a3-e36f-49f2-8211-6b561dee4ff4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341ae7040>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.812000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c6b7f7a3-e36f-49f2-8211-6b561dee4ff4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.060542 Oct 04 17:52:13.825239 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 492/1033] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.992207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.993336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:14.012760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.013660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.014324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.015432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.016131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.016769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.200273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:14.209669 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ffa2201-a256-4be3-9ca4-27633b26f192 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1466 microversion: 2.1 time: 0.222995 Oct 04 17:52:14.210569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 542/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:14.238313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:14.239085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:14.256484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:14.257382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:14.268451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.269515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.270442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.271746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.272446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.273798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.275244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.275760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.276208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.276961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.277426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.277859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.506021 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4be15d2c-7ec4-4053-a9b5-bdd455df6d08 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1619 microversion: 2.1 time: 0.271395 Oct 04 17:52:14.519939 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 493/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:14 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1619 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:14.537638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:14.548246 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef4fb2f4-9082-4d70-a5a3-981d9b8fdc9d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.295892 Oct 04 17:52:14.555856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 543/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:14 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:14.599577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1392522025", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["15b565ff-d036-43bf-bd95-f99596021e22"]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:14.665157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:14.666039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:14.675739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.676499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.677214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.678148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.678821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.679570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.692130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:14.975941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:14.986462 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-def59e5b-e1f3-46c0-9c87-81451edb8842 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.325184 Oct 04 17:52:14.990050 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 544/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:14 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:15.012983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13f4fac9-b59a-4fa9-9595-2e44d984f985 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341940f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:15.053861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:15.054412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:15.054770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:15.055547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:15.055976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:15.078642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.079623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.080245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.081216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.081914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.082807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.093805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13f4fac9-b59a-4fa9-9595-2e44d984f985 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.101568 Oct 04 17:52:15.096867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 545/1038] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:14 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:15.127210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:15.138339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:15.176640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:15.179610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:15.262838 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57faa4cb-e6fe-4b2f-a2a7-df8105e5139c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668126 Oct 04 17:52:15.265181 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 494/1039] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:15.275859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31558cca-f36a-4794-950f-3c114e17289a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:15.276768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31558cca-f36a-4794-950f-3c114e17289a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:15.387303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31558cca-f36a-4794-950f-3c114e17289a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:15.403284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31558cca-f36a-4794-950f-3c114e17289a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1217 microversion: 2.1 time: 0.131225 Oct 04 17:52:15.408229 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 546/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:15 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:15.514582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-plugged", "status": "completed", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:15.528927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.529687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.530331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.542031 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] Creating event network-vif-plugged:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:52:15.547593 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-04cdbdbd-b031-442f-80fe-e07fa4a5047f req-ba3e4c3d-ba6f-408c-b13f-bfbd9b10137b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Oct 04 17:52:15.548454 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 495/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:15.573396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:15.575773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:15.585344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.586678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.587511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.588430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.589027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.590577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.769897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:15.780558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd7c6aa5-5722-4144-b4aa-78692eb824b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1501 microversion: 2.1 time: 0.212440 Oct 04 17:52:15.791227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 547/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:15 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:16.016527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.018266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:16.032703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.034632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.038371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.039364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.040149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.040764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.111729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff70ef5a-8158-4893-a91a-80dbedad4271 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341940430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.164204 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff70ef5a-8158-4893-a91a-80dbedad4271 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.057418 Oct 04 17:52:16.164801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 548/1043] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:16.375782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:16.387920 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94f7d263-8300-4e31-afac-75955d1ef4e5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.375809 Oct 04 17:52:16.388842 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 496/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:16.433979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.434819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:16.442688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.447081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.447733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.448502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.448980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.449411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.569639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:16.578414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55e09f49-da5a-4a37-bb90-33b6d7178ab0 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1269 microversion: 2.1 time: 0.148164 Oct 04 17:52:16.579359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 549/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:16.805178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.806578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:16.816380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.816977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.817494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.818297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.818826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.819512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.128793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:17.142576 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f34d662c-5eef-4a26-ba01-03e42ee608ca tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1476 microversion: 2.1 time: 0.341283 Oct 04 17:52:17.156434 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 497/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:17.184703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db3bbb5c-65d5-48c7-a29d-feaa0d9b9dc9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341ab0160>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:17.196826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-588ffb0e-d0f4-4de8-a791-73d2c40b73d4 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '.version_select at 0x7f63419405e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:17.203364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-588ffb0e-d0f4-4de8-a791-73d2c40b73d4 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.204153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-588ffb0e-d0f4-4de8-a791-73d2c40b73d4 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.204616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-588ffb0e-d0f4-4de8-a791-73d2c40b73d4 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.251854 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-588ffb0e-d0f4-4de8-a791-73d2c40b73d4 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2757 microversion: 2.1 time: 0.085829 Oct 04 17:52:17.253140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 550/1047] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:52:17 2022] GET /compute/v2.1/os-migrations => generated 2757 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:17.280367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:17.281105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:17.298788 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db3bbb5c-65d5-48c7-a29d-feaa0d9b9dc9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.122142 Oct 04 17:52:17.308944 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 498/1048] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:17 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:17.314543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.315126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.317680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.320143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.321870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.322326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.414791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:17.418579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:17.440735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.441250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.441702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.442430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.442887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.443339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.525529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f66033a5-f9ea-45b2-8a28-a633d3a1fe90 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1629 microversion: 2.1 time: 0.252734 Oct 04 17:52:17.525837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 551/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:17 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1629 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:17.585492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ca9fabe-5678-48d8-b1bf-4b816890c67a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: .version_select at 0x7f63419f0670>, body: {"keypair": {"name": "tempest-keypair-864939728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnz6imk/SXyI9v0wuUraai/WIRyKGSRbYaMs5G2zAVfapERRruzHULx013bhjLiic80TIcHXauxCq8PeGlPYZZtEsgElWZ0C8D006w0wxH7xK9VmihF01zJ6NrlxhwMHA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:17.615454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:17.632670 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ddd14796-31a4-484a-b737-d16d038d2176 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.222615 Oct 04 17:52:17.636335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6ca9fabe-5678-48d8-b1bf-4b816890c67a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for project 72cf8480aeb94879a38b896077eaf56a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:17.638683 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 499/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:17 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:17.650404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6ca9fabe-5678-48d8-b1bf-4b816890c67a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for user 6f2ae8c47aca4786b8bde4da30d84158 and project 72cf8480aeb94879a38b896077eaf56a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:17.652873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:17.654624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:17.670672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.672358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.676116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.677159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.679269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.682563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.720897 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ca9fabe-5678-48d8-b1bf-4b816890c67a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152230 Oct 04 17:52:17.736403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 552/1051] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:52:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:17.871014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:17.883221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-744e9558-3579-472b-8d61-06a851019c92 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1277 microversion: 2.1 time: 0.242418 Oct 04 17:52:17.887538 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 500/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:17 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:18.320380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa2fbcb6-3a14-4bb0-8178-c45b7bdb4142 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f634193a820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:18.439174 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa2fbcb6-3a14-4bb0-8178-c45b7bdb4142 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.122277 Oct 04 17:52:18.441281 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 553/1053] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:18 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:18.676189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:18.678191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:18.690889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:18.695939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.696465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.696926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.701351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.702691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.703490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.909388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:18.910335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:18.924590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.940225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.944463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.947696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.952757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.953347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.254818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:19.278586 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fedf9535-ce74-4a94-805e-96057b1e8088 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.606532 Oct 04 17:52:19.292351 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 501/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:18 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:19.392275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:19.404989 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cf7843a-7e0d-422d-93b3-8a14ebc16459 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.496968 Oct 04 17:52:19.437350 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 554/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:18 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:19.455833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc5ad112-10ee-4575-92d6-a45cb901472a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341af2310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:19.549868 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc5ad112-10ee-4575-92d6-a45cb901472a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.097883 Oct 04 17:52:19.555451 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 502/1056] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:19 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:20.198478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2106695698", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "35bfa742-c59f-4f7e-a228-2ef392c75418"}], "security_groups": [{"name": "tempest-securitygroup--671476847"}], "key_name": "tempest-keypair-864939728", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:20.204468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e291ad8-dded-4de9-be32-1f16218fad95", "tag": "8d7c0f27-e6d3-4b7a-843d-0028ea28c22b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:20.227707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.228478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.236365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.252905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] Creating event network-changed:8d7c0f27-e6d3-4b7a-843d-0028ea28c22b for instance 7e291ad8-dded-4de9-be32-1f16218fad95 on n-h2-831193-17 Oct 04 17:52:20.258572 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-679e28c6-db35-441a-ba32-d8fb094e14c0 req-a1d5d8fe-dcf2-4580-9873-fa39251b2f36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058268 Oct 04 17:52:20.259807 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 503/1057] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:20.308668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:20.309411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:20.316505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.317092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.323974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.325149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.328013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.328682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.462777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] validate_networks() for [('35bfa742-c59f-4f7e-a228-2ef392c75418', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:20.503324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:20.514543 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a05e7184-3d20-40e9-b57e-7b0e66c58985 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.210886 Oct 04 17:52:20.520568 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 504/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:20 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:20.539543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:20.540301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:20.555846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.556626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.557234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.558856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.559706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.560604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.739123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:20.741224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd083924-f459-414b-82a4-ea7ebd740a75 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.217469 Oct 04 17:52:20.748879 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 505/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:20 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:20.759190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5608fbbb-fa74-4557-acde-4bbdc03ab6b1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a3c4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:20.812963 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5608fbbb-fa74-4557-acde-4bbdc03ab6b1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.062662 Oct 04 17:52:20.813826 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 506/1060] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:20 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:21.217649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:21.218153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:21.219536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:21.219536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:21.219844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:21.230733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.231359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.231874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.232688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.233219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.233718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.251875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:21.257863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Getting quotas for user 6f2ae8c47aca4786b8bde4da30d84158 and project 72cf8480aeb94879a38b896077eaf56a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:21.272364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:21.274690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:21.326713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67e7ca33-b265-4955-b9da-78ba58a36157 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.132377 Oct 04 17:52:21.339321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31e485e9-d286-4f8d-9124-317dcf56c06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.340845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31e485e9-d286-4f8d-9124-317dcf56c06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.344730 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 555/1061] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:21.405536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31e485e9-d286-4f8d-9124-317dcf56c06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:21.413813 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31e485e9-d286-4f8d-9124-317dcf56c06b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1234 microversion: 2.1 time: 0.079275 Oct 04 17:52:21.416633 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 507/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:21.543417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.544098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.555253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.555766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.556207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.557639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.558291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.558881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.739004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:21.750405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c33b1e9-659a-4a6b-8fc8-23dc11c52627 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.211299 Oct 04 17:52:21.751687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 556/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:21.772593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.773485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.780456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.781251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.781878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.782785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.783485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.784098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.829500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a3f617f-46b3-4a89-b326-bb09c506a68c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419bef70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.899255 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a3f617f-46b3-4a89-b326-bb09c506a68c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.073421 Oct 04 17:52:21.908496 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 557/1064] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:21.998526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:22.011527 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b6da86c-cd35-4f91-b1c6-20d72334e71e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.246363 Oct 04 17:52:22.012373 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 508/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:22.444916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:22.445721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:22.460919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.463594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.472141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.473104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.474092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.474913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.695785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:22.717358 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31e24d5e-9d4d-4058-896d-af7123834e64 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1286 microversion: 2.1 time: 0.272308 Oct 04 17:52:22.718028 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 558/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:22 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:22.784794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:22.785417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:22.797146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.797797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.798798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.800498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.801286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.801768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.915977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4366038c-44d1-4c82-8c7e-c5e2637393cc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f634193a820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:22.987390 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4366038c-44d1-4c82-8c7e-c5e2637393cc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.075512 Oct 04 17:52:22.987983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 559/1067] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:22 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:23.034727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.035396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.042418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.042925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.043401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.044122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.044589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.045024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.074973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.087889 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe3e9218-2ed3-4b35-8fee-04f4dd7db074 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.312196 Oct 04 17:52:23.088823 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 509/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:22 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.282875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.311558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5cbb464-35f0-4359-88cc-391ab49b7024 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.280872 Oct 04 17:52:23.312510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 560/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.315240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.317594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.324104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.324591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.325031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.325736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.326193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.326622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.360551 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08cfe8b7-307c-46ef-83f4-226c9a61d881 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052550 Oct 04 17:52:23.361976 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 510/1070] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:23.381246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.382425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.393199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.394056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.394815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.395608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.396269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.396808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.573533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lazy-loading 'services' on Instance uuid 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:23.748887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.749500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.766618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.767585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.767585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.768526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.768886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.769319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.791601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ada72ff-dc6f-4b15-9f90-3289e762b0d2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments/abd7a765-52c7-4c2a-8dcd-f878c0aeb1a5" status: 202 len: 0 microversion: 2.1 time: 0.417598 Oct 04 17:52:23.804602 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 561/1071] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 17:52:23 2022] DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments/abd7a765-52c7-4c2a-8dcd-f878c0aeb1a5 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:23.916765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.927663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-887c6efd-b9f0-41d5-b3ce-57b0b496f3a6 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1304 microversion: 2.1 time: 0.185263 Oct 04 17:52:23.941446 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 511/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.004167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-507c92cd-6e96-4191-bd90-d27999dfa784 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418bea60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.059458 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-507c92cd-6e96-4191-bd90-d27999dfa784 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.059350 Oct 04 17:52:24.067628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 562/1073] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.116536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.117247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:24.126832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.127633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.128181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.128968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.129465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.129903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.336050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.336975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:24.348708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.350438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.351261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.352900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.353625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.354313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.362216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:24.372039 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-86546567-8b32-49da-b80e-616dfb68bf81 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.260602 Oct 04 17:52:24.376341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 512/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:24 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.553738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:24.562536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-014475d5-89c1-4230-a9e5-8ea608d9db7e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.230993 Oct 04 17:52:24.564223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 563/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:24 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.960018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.961368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:24.969855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.970704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.971451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.972580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.973356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.974307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.076759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-757793f3-f391-490c-94c3-936ec83005d1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419a7d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.108282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:25.151382 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-757793f3-f391-490c-94c3-936ec83005d1 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.080473 Oct 04 17:52:25.160909 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 564/1076] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:25.402264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.403134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.412639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.418163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.418884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.421149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.421817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.426012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.434974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.444195 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4cf68d0f-2393-4d5e-a411-49c7a9ed5e05 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.490070 Oct 04 17:52:25.444803 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 513/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:24 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:25.606501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.607643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.618121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.620541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.621944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.624367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.631159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.634861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.809506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.829178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24769dce-4cd5-42fe-901b-ea518e980bde tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.428834 Oct 04 17:52:25.831818 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 565/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:26.001962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.012311 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-afdd6940-759c-4c2d-94f9-6a31af77a67a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.425960 Oct 04 17:52:26.015776 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 514/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.168999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1b65aa6-b9fb-438d-8be0-cd33d5de6ec9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a2f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.231131 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c1b65aa6-b9fb-438d-8be0-cd33d5de6ec9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.067300 Oct 04 17:52:26.231961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 566/1080] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.469554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.470315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.486658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.487557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.488227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.489145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.489704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.490226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.496435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:26.670598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:26.692582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.698930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.699501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.753563 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] Creating event network-changed:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h2-831193-17 Oct 04 17:52:26.774080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ad4bdb63-cf83-49c8-94b3-681d4db39e77 req-99035985-43ff-4c45-84a1-1fe4de44370d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108042 Oct 04 17:52:26.775315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 567/1081] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:26.847318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.862787 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b304e3b6-e541-4a5e-b053-475625125bc7 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.397103 Oct 04 17:52:26.865047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.868494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.869201 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 515/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.876338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.883862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.895456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.896621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.902428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.903734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.043759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.053352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:27.097627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.098135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.098579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.099324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.099789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.100218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.449559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:27.457754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77f2f4e3-a7c9-47fa-916b-15eb36898054 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.597166 Oct 04 17:52:27.458349 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 568/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.470148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7edc3be5-d2e7-40ee-80a9-a4e3019c1f42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a2430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.595723 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7edc3be5-d2e7-40ee-80a9-a4e3019c1f42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1454 microversion: 2.1 time: 0.131740 Oct 04 17:52:27.596384 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 569/1084] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.645136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:27.666766 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-239a3f71-5bc3-45e4-9ee3-5f1c416162e5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.626665 Oct 04 17:52:27.669101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 516/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.693840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e291ad8-dded-4de9-be32-1f16218fad95", "name": "network-vif-plugged", "status": "completed", "tag": "8d7c0f27-e6d3-4b7a-843d-0028ea28c22b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:27.715453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.716313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.717126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.722185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:27.731692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] Creating event network-vif-plugged:8d7c0f27-e6d3-4b7a-843d-0028ea28c22b for instance 7e291ad8-dded-4de9-be32-1f16218fad95 on n-h2-831193-17 Oct 04 17:52:27.737855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-300622ef-997e-459d-93b8-cba69b2d0ad9 req-5a2ab6d5-817b-406f-843e-15c69d64e9e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052983 Oct 04 17:52:27.739354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 570/1086] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:27.896563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.897931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:27.910741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.911608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.912398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.913636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.914995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.916144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.095678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.103943 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-66ed1bd2-80de-4c97-b7cc-4a9b7d298aa8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.214848 Oct 04 17:52:28.104519 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 517/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.486719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.487436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.496273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.496774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.497203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.498204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.498351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.498954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.611644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ef8d19e8-fad4-4a76-8e88-f4d6ee4a7114 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341ddeee0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.652411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.661707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a840e157-1376-48f4-b524-56b3142d1d1f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.179841 Oct 04 17:52:28.663126 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ef8d19e8-fad4-4a76-8e88-f4d6ee4a7114 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1463 microversion: 2.1 time: 0.055232 Oct 04 17:52:28.663381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 571/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.664264 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 518/1089] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1463 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:28.681211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8692d978-a817-4e17-bc03-12387df4e33c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a9160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.697882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.698555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.705675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.706196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.706640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.707638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.708102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.708536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.735884 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8692d978-a817-4e17-bc03-12387df4e33c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 200 len: 1463 microversion: 2.1 time: 0.058457 Oct 04 17:52:28.737254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 572/1090] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 1463 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.751574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.752540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.759336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.760076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.760705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.761447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.761905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.762467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.865115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.874154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1c69f206-7cc6-49ef-b639-f8443729e2f2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.180341 Oct 04 17:52:28.874734 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 519/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:28.927437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.936521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17ac7a30-680a-42c9-b76b-a72732fe5edc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1479 microversion: 2.1 time: 0.189153 Oct 04 17:52:28.937294 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 573/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1479 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.127489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.128091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.144780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.146900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.147622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.148374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.148870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.149251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.327054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:29.336503 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41ff4900-c9e2-44eb-b970-64bd1a9efb8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.213091 Oct 04 17:52:29.337101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 520/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.684256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.684814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.690940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.691495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.691924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.692618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.693070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.693500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.827741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:29.835970 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50230676-e6c3-4c41-8451-f973194f38e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1543 microversion: 2.1 time: 0.155678 Oct 04 17:52:29.836625 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 574/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1543 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.897241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.897938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.904370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.904868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.905307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.906036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.906498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.906943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.960064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.960680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.967454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.968197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.968715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.969483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.970173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.970660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.062533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.071520 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9ddccba6-9219-4d8c-8638-52e3a151a914 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1317 microversion: 2.1 time: 0.178151 Oct 04 17:52:30.072429 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 521/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.119777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.129052 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8da4c1aa-b371-437a-b511-c21e5832d952 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1466 microversion: 2.1 time: 0.172692 Oct 04 17:52:30.129757 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 575/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1466 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:30.153278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb69cd07-fb52-4846-aefa-e9cd46b711e2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341af24c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.261783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fb69cd07-fb52-4846-aefa-e9cd46b711e2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-10-04T17%3A50%3A44Z" status: 200 len: 1902 microversion: 2.1 time: 0.112262 Oct 04 17:52:30.262553 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 522/1097] 10.222.0.33 () {58 vars in 1199 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?changes-since=2022-10-04T17%3A50%3A44Z => generated 1902 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.276967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c850d765-7ea3-4233-9ad7-4a7e6e797a2f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341840700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.354514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c850d765-7ea3-4233-9ad7-4a7e6e797a2f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2092303207" status: 200 len: 485 microversion: 2.1 time: 0.081848 Oct 04 17:52:30.357601 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 576/1098] 10.222.0.33 () {58 vars in 1231 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2092303207 => generated 485 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.370996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.372558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.373137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2033032-5cf7-4b01-96bc-22ce702be913 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418bedc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.391488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.392007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.392461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.393267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.393738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.394182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.491367 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2033032-5cf7-4b01-96bc-22ce702be913 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?server=3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 957 microversion: 2.1 time: 0.121035 Oct 04 17:52:30.501062 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 577/1099] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?server=3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 957 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:30.511611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-743734d7-6c35-4c8c-9d24-302cf81a583a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a11670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.560729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.563437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-743734d7-6c35-4c8c-9d24-302cf81a583a tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219" status: 200 len: 485 microversion: 2.1 time: 0.056418 Oct 04 17:52:30.564321 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 578/1100] 10.222.0.33 () {58 vars in 1317 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219 => generated 485 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.568859 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1dde2079-4874-439e-9982-d25931a5019a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.211141 Oct 04 17:52:30.569173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.581179 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 523/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:30.581410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.581540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86221a63-9f11-4035-890c-72963d1f4b95 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a6f940>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.581624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.590317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.590813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.591605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.592079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.592510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.635825 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-86221a63-9f11-4035-890c-72963d1f4b95 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219" status: 200 len: 485 microversion: 2.1 time: 0.062898 Oct 04 17:52:30.636801 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 524/1102] 10.222.0.33 () {58 vars in 1303 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219 => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.652340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f764ecc0-dee5-4bae-be1c-93d578887ac3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086020 Oct 04 17:52:30.653590 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 579/1103] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:52:30.656978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-25e90b06-de4c-4005-8870-2e1c9ae163d8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341a3c430>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.750450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.752629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.761267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.762077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.762781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.764166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.764691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.765310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.805960 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-25e90b06-de4c-4005-8870-2e1c9ae163d8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.157048 Oct 04 17:52:30.806255 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1497c379-42e8-4d78-8315-17d03540a93e tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059432 Oct 04 17:52:30.811315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 580/1105] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:52:30.812324 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 525/1105] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.824476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8df6da12-1e4c-4e47-a1b6-39a2a73d4511 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418be1f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.860348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.861483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.870372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.871232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.871847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.872730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.873342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.873925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.918491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8df6da12-1e4c-4e47-a1b6-39a2a73d4511 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.098732 Oct 04 17:52:30.919156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 581/1106] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.927834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.927834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.933177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.933838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.934379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.935254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.936012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.936678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.969744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:31.084288 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43347a46-21a1-41c2-9b26-7276e99eef48 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 204 len: 0 microversion: 2.1 time: 0.163526 Oct 04 17:52:31.085780 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 582/1107] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:30 2022] DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:31.095502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca26482c-a895-4e36-854d-f41d2a295ab3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a91f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.184858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca26482c-a895-4e36-854d-f41d2a295ab3 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.097067 Oct 04 17:52:31.185904 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 583/1108] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:31.195201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.196523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.203876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.209978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.210887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.212549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.212889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.213692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.215238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a515ddd6-738f-41ed-8dab-08576307b1c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1542 microversion: 2.1 time: 0.358045 Oct 04 17:52:31.215951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.227345 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 526/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1542 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:31.235323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.236050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.243465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.244066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.244593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.246259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.246417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:31.246745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.247214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.266457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:31.373295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.382113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2384c5e0-4c56-469b-a905-442836764933 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1467 microversion: 2.1 time: 0.194359 Oct 04 17:52:31.389527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 584/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1467 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.401000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e4ba5b3-8bb9-4759-9ed4-1f1059f5be53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418678b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.410569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:31.513318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.526025 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7520d42d-ccf7-446d-b9b3-0fffec4226d3 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1681 microversion: 2.1 time: 0.295658 Oct 04 17:52:31.544483 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 527/1111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.544483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "name": "network-vif-unplugged", "status": "completed", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:31.555778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.556285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.556731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.581636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e4ba5b3-8bb9-4759-9ed4-1f1059f5be53 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T17%3A50%3A36Z" status: 200 len: 6333 microversion: 2.1 time: 0.189747 Oct 04 17:52:31.582239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 585/1112] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T17%3A50%3A36Z => generated 6333 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.588789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Creating event network-vif-unplugged:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h2-831193-17 Oct 04 17:52:31.595928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.597237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.602971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] Instance 520a7b7c-9b29-442c-935c-fac291d15414 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:52:31.608491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.609046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.610745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.614467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.617588 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-450b4c6a-69b4-439d-a991-6da1a8962859 req-bc818662-fad5-472a-8d76-02a54b03a791 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088416 Oct 04 17:52:31.617817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.618479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.618719 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 528/1113] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:31.630496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.631536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.639001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.639536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.639978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.640700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.641161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.641584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.802260 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e9d171c-1196-46f8-8552-7e25ef8b82bf tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1620 microversion: 2.1 time: 0.210470 Oct 04 17:52:31.805285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 586/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1620 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.811647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6d37137-4ef8-467d-9d83-ec30cba357d8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a9e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.877533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.886816 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4898950e-3d7c-465a-aae5-2133bc3934dc tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.261830 Oct 04 17:52:31.887455 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 529/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.895716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2084319424", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "15b565ff-d036-43bf-bd95-f99596021e22"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:31.896443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6d37137-4ef8-467d-9d83-ec30cba357d8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2092303207" status: 200 len: 665 microversion: 2.1 time: 0.090938 Oct 04 17:52:31.897402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 587/1116] 10.222.0.33 () {58 vars in 1252 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2092303207 => generated 665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:31.918157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8ed6e8c-2b1a-4cb5-913c-c53d485764c9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418bef70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.958147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:32.020594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8ed6e8c-2b1a-4cb5-913c-c53d485764c9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1467 microversion: 2.1 time: 0.107234 Oct 04 17:52:32.021384 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 588/1117] 10.222.0.33 () {58 vars in 1338 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219 => generated 1467 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:32.038619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89a948ab-11f8-4af7-898b-5512e8db3932 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341840820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.101336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89a948ab-11f8-4af7-898b-5512e8db3932 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1467 microversion: 2.1 time: 0.068429 Oct 04 17:52:32.107811 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 589/1118] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa271236f-c547-44f0-9916-f884faebc219 => generated 1467 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.119741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7904147-3842-40f4-8ec6-0c877ffa4832 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341867ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.246047 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7904147-3842-40f4-8ec6-0c877ffa4832 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.130955 Oct 04 17:52:32.246703 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 590/1119] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.252151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.252455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.262731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.262731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.262731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.263514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.263984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.264419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.403705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:32.411418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:32.412128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-876fd2ad-329c-4d04-b519-ae35efc6a0f9 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1542 microversion: 2.1 time: 0.164234 Oct 04 17:52:32.412540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:32.412893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 591/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.418105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfe192fe-f89f-4665-a575-765d0092c5e8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f6341840160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.424758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:32.425343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:32.425795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:32.435865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.436358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.436796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.437538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.437993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.438416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.457362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:32.463528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Getting quotas for user 0b3ef557b26f4264a285ba77bceb5a09 and project c329d327a97e476581dc870e8e71a712. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:32.480520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:32.483481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:32.493815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfe192fe-f89f-4665-a575-765d0092c5e8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.079818 Oct 04 17:52:32.494798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 592/1121] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.513215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e01543c-964e-4c43-8da3-84ab1d2746cd tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f634184c4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.558501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-51ab7b34-37f2-464e-9be0-9a7b03f30323 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669939 Oct 04 17:52:32.559678 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 530/1122] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:32.569770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.570405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.570758 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e01543c-964e-4c43-8da3-84ab1d2746cd tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857" status: 200 len: 784 microversion: 2.1 time: 0.062784 Oct 04 17:52:32.571630 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 593/1123] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857 => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:32.579885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.580660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.581165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-512eb837-c12a-45fe-b497-bf417112e492 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.581901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-512eb837-c12a-45fe-b497-bf417112e492 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.582280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.583456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.584209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.584831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.649856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-512eb837-c12a-45fe-b497-bf417112e492 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:32.658551 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-512eb837-c12a-45fe-b497-bf417112e492 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1217 microversion: 2.1 time: 0.081065 Oct 04 17:52:32.659740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 594/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.664166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6307b38a-3fb7-4986-bd8d-b1bde17e59c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418a9e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.750446 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6307b38a-3fb7-4986-bd8d-b1bde17e59c8 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.089739 Oct 04 17:52:32.751145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 595/1125] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.768060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff8ecfaa-f491-4684-b1c7-0d335453ec76 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418be4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.866461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:32.875359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec12ef18-f452-4136-a045-5eddcc09d20c tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1681 microversion: 2.1 time: 0.309609 Oct 04 17:52:32.877551 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 531/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:32.915018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.918143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.926395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.927096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.927797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.928801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.929577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.930173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.145449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:33.158401 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55dc3483-2943-4448-be45-260e1c1ca22c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.248721 Oct 04 17:52:33.158956 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 532/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:33.438321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.439835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:33.453705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.455198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.455884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.456808 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff8ecfaa-f491-4684-b1c7-0d335453ec76 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83" status: 204 len: 0 microversion: 2.1 time: 0.692671 Oct 04 17:52:33.457572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.457572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.458031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.459206 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 596/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] DELETE /compute/v2.1/images/f1297687-df09-4ecb-afef-8c624ac2ba83 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:52:33.475241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e7e20e1-3166-499d-b37c-4514626450ed tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63417f99d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.151061 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e7e20e1-3166-499d-b37c-4514626450ed tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe" status: 204 len: 0 microversion: 2.1 time: 0.684771 Oct 04 17:52:34.152136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 597/1129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:33 2022] DELETE /compute/v2.1/images/ca72b784-b2a6-4baf-b6b1-62cb521040fe => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:34.157513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.158158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.165504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.166002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.166435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.167891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.168437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.168876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.239493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.250001 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd8b259a-e768-4648-a33a-fe62bf4bd0aa tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1269 microversion: 2.1 time: 0.096423 Oct 04 17:52:34.250847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 598/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.256637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:34.266177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:34.268956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.269684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.270269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.286072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Creating event network-changed:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h2-831193-17 Oct 04 17:52:34.293653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] Instance 520a7b7c-9b29-442c-935c-fac291d15414 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:52:34.293985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.307710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a5b648bf-28f5-4c43-bbbf-7aef49f69d74 req-bcf6eb93-ed07-4585-8cee-e2442a97e1e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054462 Oct 04 17:52:34.309160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 599/1131] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:34.311446 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b48d01cf-0c13-4258-bbe9-997f0ca4ba5f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1474 microversion: 2.1 time: 0.876889 Oct 04 17:52:34.312939 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 533/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:33 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1474 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:34.327415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "name": "network-vif-plugged", "status": "completed", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:34.334709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.335364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.336085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.339006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.340975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.350686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] Creating event network-vif-plugged:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h2-831193-17 Oct 04 17:52:34.351771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.352503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.353129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.354404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.355753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.356246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.356814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2a87d2ab-7aa4-48cf-a017-e060390cf074 req-7f0b8562-fe84-4ad7-818c-60a8aeb1ea10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046017 Oct 04 17:52:34.357875 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 600/1133] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:34.366804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cdcaa00-e424-404b-a9f6-d0edff065a45 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63418beca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.873348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.886732 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8566317b-625f-4f5e-8f09-345d84ee5031 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1681 microversion: 2.1 time: 0.555642 Oct 04 17:52:34.893514 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 534/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1681 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.906843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.913025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.923423 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cdcaa00-e424-404b-a9f6-d0edff065a45 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f" status: 204 len: 0 microversion: 2.1 time: 0.561303 Oct 04 17:52:34.924344 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 601/1135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] DELETE /compute/v2.1/images/d1965430-da68-45ac-a2ba-015ad8d9e12f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:34.933657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.934550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.936799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.937312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.937756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.938474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.938933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.939394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.944128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.945680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.946400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.949405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.949405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.949405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.995366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:35.095264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3822d6e3-5c84-4847-8b0b-b1356af26234 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 204 len: 0 microversion: 2.1 time: 0.165983 Oct 04 17:52:35.099892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 602/1136] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:34 2022] DELETE /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:35.106647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.107593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.114217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.115088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.115829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.116831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.117522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.118222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.123326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:35.296105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.304206 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5363852-4bcc-45a6-ab4a-b52be21e6da4 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1473 microversion: 2.1 time: 0.202605 Oct 04 17:52:35.304807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 603/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.323321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.324155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.330648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.331251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.331685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.332500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.332987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.333408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.412750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.422529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f647726a-b9a7-4c2a-9d76-d02f45097ff5 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1275 microversion: 2.1 time: 0.108546 Oct 04 17:52:35.423401 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 604/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.428262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.429089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.435345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.435848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.436498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.437386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.438014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.438606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.506401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.520271 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7276a354-9917-477e-aa8c-74843650dce1 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1359 microversion: 2.1 time: 0.624902 Oct 04 17:52:35.522137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 535/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1359 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.627091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.639558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37db1bef-8147-4c66-928a-b8b51aab9e7a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1471 microversion: 2.1 time: 0.214825 Oct 04 17:52:35.641027 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 605/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.664952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:35.666087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.672899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.673843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.674530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.675816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.676474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.677120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.715105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:35.727638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.728225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.728808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.729678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.730212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.730636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.762992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:35.772395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:35.919543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.920240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.938919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.939640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.939872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.940851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.941459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.942038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.944739 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ef9d59d7-fd78-4475-85b3-772512a654a3 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414/action" status: 202 len: 0 microversion: 2.1 time: 0.283084 Oct 04 17:52:35.948153 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 536/1141] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:35 2022] POST /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:35.963651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.964740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.976576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.977657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.978735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.981961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.984252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.985437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.043190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.058336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4967bc0-59c8-4580-a6ea-92f536861cc2 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1613 microversion: 2.1 time: 0.143544 Oct 04 17:52:36.059756 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 606/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1613 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:36.320673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.328175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.329320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.336308 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-64b14128-e849-4fd8-b0e8-99d3f8ff9ac8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1470 microversion: 2.1 time: 0.383081 Oct 04 17:52:36.336907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 537/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:36.341811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.342457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.343209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.344559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.349098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.350100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.354780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cfef55-6ba9-4a00-b36f-e79dae6fd2d0", "name": "network-vif-deleted", "tag": "14dec5c6-007e-4a91-ab88-7205693169a8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:36.366934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.367693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.376032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.406545 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] Creating event network-vif-deleted:14dec5c6-007e-4a91-ab88-7205693169a8 for instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 on n-h1-831193-17 Oct 04 17:52:36.420310 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-efcb7e18-4c28-4e0a-8d1b-8a13b0217994 req-df1cb5e3-a789-4635-815f-c9ad9125a316 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071445 Oct 04 17:52:36.423570 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 538/1144] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:36.433997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cfef55-6ba9-4a00-b36f-e79dae6fd2d0", "name": "network-vif-unplugged", "status": "completed", "tag": "14dec5c6-007e-4a91-ab88-7205693169a8"}, {"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:36.471362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.471860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.472589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.498400 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Creating event network-vif-unplugged:14dec5c6-007e-4a91-ab88-7205693169a8 for instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 on n-h1-831193-17 Oct 04 17:52:36.501186 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] Creating event network-vif-unplugged:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:52:36.521665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-31922f43-6d6a-41f0-a839-f389287c295f req-4bd594f7-bb41-411b-92d4-f2c642ab70a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.096420 Oct 04 17:52:36.535174 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 539/1145] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:36.546830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.547905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.562652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.563301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.563641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.564369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.564834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.565272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.637743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.647802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c2cb17d-1481-400b-b9d0-0a52dc6a2a3e tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1473 microversion: 2.1 time: 0.324121 Oct 04 17:52:36.648468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 607/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:36.661044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.663763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.687139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.691461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.696828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.702228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.702879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.703216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.958374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.971812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88467093-525d-4c93-bf32-0f8405506223 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1540 microversion: 2.1 time: 0.319314 Oct 04 17:52:37.000497 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 608/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1540 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.009974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.014441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.016111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.025056 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54dd858e-46ac-4fd2-95b8-3c7809c82cd3 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.488338 Oct 04 17:52:37.026070 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 540/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.047415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.048172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.048767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.050641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.051361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.051941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.098713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.100853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.112331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.115495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.118028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.121937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.123440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.124114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.243004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.254328 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08b28436-c5b3-4dc9-b20f-ffacbeed9f8f tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1326 microversion: 2.1 time: 0.161454 Oct 04 17:52:37.259083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 541/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.259966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da7b5a92-8428-4bfd-9f56-b3e24037858a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257986 Oct 04 17:52:37.260552 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 609/1150] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:37.373199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.380037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.390686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:37.418389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.419264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.419992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.421225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.422021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.422796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.674173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.675257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.685870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.689525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.692051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.697767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.699420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.701772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.984818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.998297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15dc9109-a28d-4cfc-8c35-cd61df0c851f tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1473 microversion: 2.1 time: 0.323564 Oct 04 17:52:37.998938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 610/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:38.052358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:38.052997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:38.070622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.071163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.071602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.072326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.072781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.073277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.384686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:38.408144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04b74258-75ee-4125-9e2d-9f68bd5615bc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.358593 Oct 04 17:52:38.409544 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 611/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:38 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:38.418387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:38.420299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:38.434165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.436071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.436953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.438398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.439236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.440030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.487733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.488678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.490028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.490868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lazy-loading 'fault' on Instance uuid 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:38.578060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f34bf323cd41a489655373a9123b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60536b45e94840a78065a08a9cce0eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:38.588004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5b37a43-f173-43b8-a1b9-55dd1a9cb4ce tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 200 len: 1331 microversion: 2.1 time: 0.177011 Oct 04 17:52:38.588773 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 612/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:38 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:38.630306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:38.640634 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31df2b94-9d74-423a-8836-4b2fe5e0aebf tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1470 microversion: 2.1 time: 1.275968 Oct 04 17:52:38.641233 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 542/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1470 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.027910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.028534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.034917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.035507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.035942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.036684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.037267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.037963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.211817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:39.223966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.225074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.225901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.227260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.236904 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7f4bdce-acad-4de5-a2c9-02d8c0d0f2f9 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1473 microversion: 2.1 time: 0.213183 Oct 04 17:52:39.238207 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 613/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.254580 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] Creating event network-changed:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h2-831193-17 Oct 04 17:52:39.263998 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-d189861b-bcbd-4468-80b8-cbcf215537c1 req-a39547ee-845a-4d8b-b8c3-daabc89a6e62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059521 Oct 04 17:52:39.264877 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 543/1156] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:39.435132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.436053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.448394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.452067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.458071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.463936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.468116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.470173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.617041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.618278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.632870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.634676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.638654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.639701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.640427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.644806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.674293 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] HTTP exception thrown: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Request method failure captured: Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 HTTP/1.1 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIl_FSuPMAuDCdCdMb24vq-q2J2F9OwcG5clB5o88VHwP7XSYgHhBeLPnb3LUmTffeZppPjkij5mLFhHbRiBwWbh6IYHPkvhf4VBvP33S4KlIzG48CkVnHdECPOyOaby7LmcC6xCzH3IyErNRIFWagr4MKFGBu_QCTB6LHFQclc_b0 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:39.676529 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 86f34bf323cd41a489655373a9123b06 Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:39.678187 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '07cfef55-6ba9-4a00-b36f-e79dae6fd2d0'} Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:39.679165 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:39.680687 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:39.683342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Returning 404 to user: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:39.684945 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-725a80a3-22a9-466a-bd6a-ddf8d7e8f004 tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 404 len: 111 microversion: 2.1 time: 0.074407 Oct 04 17:52:39.686136 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 544/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:52:39.691146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271236f-c547-44f0-9916-f884faebc219", "name": "network-vif-deleted", "tag": "10d9a6ec-45cc-431b-bce1-58cc29f185a5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:39.718003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.718003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.718003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.742619 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] Creating event network-vif-deleted:10d9a6ec-45cc-431b-bce1-58cc29f185a5 for instance a271236f-c547-44f0-9916-f884faebc219 on n-h1-831193-17 Oct 04 17:52:39.764603 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6de61c50-d4d6-4eb5-80e4-40ac1bfa93ae req-c83c6076-0f93-44d8-b11b-a3d39e17af08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076840 Oct 04 17:52:39.766115 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 545/1158] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:39.782981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.789506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.790649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.803163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.803952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.807576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f60b5525-0301-41fe-a04d-a5b0bb2cc744 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.377711 Oct 04 17:52:39.807930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.809523 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 614/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.824692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.825515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.828231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.830178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b425cf7-9ee5-473b-aa39-3e144d474cfb tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '.version_select at 0x7f63417f9d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.903334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b425cf7-9ee5-473b-aa39-3e144d474cfb tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447655907" status: 202 len: 0 microversion: 2.1 time: 0.091047 Oct 04 17:52:39.905979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 615/1160] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 17:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447655907 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:40.213101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.234430 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b799ef01-1365-4aa2-b786-f740b49ddb7d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1470 microversion: 2.1 time: 0.466185 Oct 04 17:52:40.237671 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 546/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:40.266985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.270052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.289396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.294209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.295131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.297355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.299362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.300831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.349478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.349963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.350583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.351261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lazy-loading 'fault' on Instance uuid a271236f-c547-44f0-9916-f884faebc219 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:40.445557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.457865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-357c95ea-83f7-4f4d-8f13-8304a843bcfc tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 200 len: 1307 microversion: 2.1 time: 0.195657 Oct 04 17:52:40.458474 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 616/1162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:40.849784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.852110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.865446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.867060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.869101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.870832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.872135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.873329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.192114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:41.215271 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bdf8cd5e-eda9-4913-a030-fe1266de8f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.373564 Oct 04 17:52:41.230981 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 547/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:41.270297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.271469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.279700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.280453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.281065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.281960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.282571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.283177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.489879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.490921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: a271236f-c547-44f0-9916-f884faebc219] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.505345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.506399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.519245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.520739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.521597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.522328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.556500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] HTTP exception thrown: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Request method failure captured: Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 HTTP/1.1 Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJrhcK-hrFH5UzFOmXJKE9FWvH4xaXLvWsqZtMapgdUkWhslNOssazqYn9eigohsIPATUDxGOdSxluInnC4LK_KOUU1zofqONQ7H7zVrnHQRg83CmOtEmq2uOU2WClfikYHgZMtcubGiec5SoJuzWHQpJ1F3_sb1-7AICnEEKUaXbo Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 720a616ccdf64ea8bf6dd7d43cd7304d Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:41.558968 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 720a616ccdf64ea8bf6dd7d43cd7304d Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListImageFiltersTestJSON-1684927253-project Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 7c05b59c6c964deab8eb775ca2cb8b15 Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListImageFiltersTestJSON-1684927253-project Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. Oct 04 17:52:41.560561 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a271236f-c547-44f0-9916-f884faebc219'} Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:41.561461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. Oct 04 17:52:41.563863 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:41.565458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Returning 404 to user: Instance a271236f-c547-44f0-9916-f884faebc219 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:41.565458 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-975db60c-4437-4695-917d-827ba2ee925b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219" status: 404 len: 111 microversion: 2.1 time: 0.078501 Oct 04 17:52:41.565458 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 548/1164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/a271236f-c547-44f0-9916-f884faebc219 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:41.569695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.570196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.576698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.577197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.577977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.578870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.579509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.580104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.619586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:41.662672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:41.671844 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c0afa82-7855-4f03-8b11-ed983ffe71df tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1470 microversion: 2.1 time: 0.409224 Oct 04 17:52:41.672732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 617/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:41.754921 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3c63f02-a7f8-4f50-980f-ec590f99734b tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 204 len: 0 microversion: 2.1 time: 0.188933 Oct 04 17:52:41.755771 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 549/1166] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:41 2022] DELETE /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:41.768159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.769049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.779356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.780381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.781008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.785355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.786183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.786803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.793536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6262e96e-3d3f-4a13-814b-7a032cade923", "tag": "c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:41.807156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.808045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.808666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.822838 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] Creating event network-changed:c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7 for instance 6262e96e-3d3f-4a13-814b-7a032cade923 on n-h1-831193-17 Oct 04 17:52:41.832285 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0492968a-ec41-400c-b163-74e481b00d17 req-beb0cfac-dfd0-43c2-af8b-501bf476ddd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047420 Oct 04 17:52:41.833403 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 550/1167] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:42.001948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:42.011837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9be0c413-5b0c-49b9-9251-cd0213554a42 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1472 microversion: 2.1 time: 0.248843 Oct 04 17:52:42.012921 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 618/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:42.246960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.249780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:42.262479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.263299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.264089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.265533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.266395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.267613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.472197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:42.514911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:42.523955 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-43b19d01-06a9-45ff-a5ba-0845fd1ec2a7 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.286899 Oct 04 17:52:42.524703 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 551/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:42 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:42.709045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.710227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:42.718931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:42.721942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.722891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.723527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.724600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.725226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.725797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.938077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:42.947243 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e70ac36e-b4cc-4a03-857f-e3b5c103975c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1470 microversion: 2.1 time: 0.244781 Oct 04 17:52:42.948105 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 619/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:42 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:43.036795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.037648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.045494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.046168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.046848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.047823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.048296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.048901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.230603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.244663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-27d6a38a-2b9b-4688-8495-d7b47258aead tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1472 microversion: 2.1 time: 0.212210 Oct 04 17:52:43.246260 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 552/1171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.549831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.550610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.557384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.557954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.558392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.559133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.559581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.560003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.580486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:43.754511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.764808 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91eff543-e5da-4fa5-96f3-7fc8ee1d92dd tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.219545 Oct 04 17:52:43.765491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 620/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.975625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.976683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.999400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.000257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.001025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.001950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.002667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.003868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.041234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:44.283117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:44.284088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:44.291715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.292895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.293544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.294445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.295128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.295906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.511248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:44.528019 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-443ad4e0-e8d7-4844-8664-72ae8da15ffc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1536 microversion: 2.1 time: 0.559173 Oct 04 17:52:44.528963 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 553/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1536 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:44.749841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:44.759554 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86fc5829-006a-4f99-b07f-8e55ae69e88d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1472 microversion: 2.1 time: 0.480920 Oct 04 17:52:44.765813 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 621/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:44 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:44.796909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:44.797825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:44.805323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.806224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.806923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.807911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.808545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.809140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.052124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.074213 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b79784a-6628-494c-ba93-dce86f55869b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.282911 Oct 04 17:52:45.076595 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 554/1175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:44 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:45.224596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669e2a-260a-4e12-aafe-687ca1f4f7ab", "name": "network-vif-deleted", "tag": "4c8e583c-ce09-40ce-a78f-173f83799b52"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:45.261218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.262906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.264584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.292001 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] Creating event network-vif-deleted:4c8e583c-ce09-40ce-a78f-173f83799b52 for instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab on n-h2-831193-17 Oct 04 17:52:45.299936 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b3d06ddc-464b-4d11-8e77-f39a893d028a req-8d0b8a97-5c32-475b-8b34-0e81db0b78ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082629 Oct 04 17:52:45.301257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 622/1176] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:45.566955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.566955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:45.576211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.577013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.577673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.578817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.579742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.580421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.588065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:45.615679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.619787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.620127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.650125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Creating event network-changed:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h1-831193-17 Oct 04 17:52:45.666737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] Instance 520a7b7c-9b29-442c-935c-fac291d15414 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:52:45.680737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ff515d76-0111-4c0b-b38b-4e823946424e req-035a50a4-45fe-48a4-a6fb-457299bb49ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107386 Oct 04 17:52:45.681958 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 623/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:45.699689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.700725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:45.712701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.716457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.717585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.718548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.720692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.723507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.743605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=5 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:45.973470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:46.005216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-994e1141-f64d-4af2-a055-d891e197e817 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 2345 microversion: 2.25 time: 0.312798 Oct 04 17:52:46.015719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 624/1178] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 2345 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:46.035130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.035760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.043010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.043544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.043990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.044716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.045179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.045602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.093598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.094414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.096051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.096550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.097128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lazy-loading 'fault' on Instance uuid 3b669e2a-260a-4e12-aafe-687ca1f4f7ab {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:46.108254 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7f4169f0-a8a7-4a58-8e22-598914385af6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1536 microversion: 2.1 time: 0.547394 Oct 04 17:52:46.110949 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 555/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1536 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.119622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.123852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.124532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.125209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.126158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.126775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.127446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.158799 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb76ec3c-cc8a-4b40-8bb5-e50599753914 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045729 Oct 04 17:52:46.160058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 556/1180] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:46.174351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262e96e-3d3f-4a13-814b-7a032cade923", "name": "network-vif-plugged", "status": "completed", "tag": "c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:46.186173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.186942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.187655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.192200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c05b59c6c964deab8eb775ca2cb8b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720a616ccdf64ea8bf6dd7d43cd7304d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.203899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd1f58f1-8f67-4981-99c6-d344a1d95899 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 200 len: 1307 microversion: 2.1 time: 0.186450 Oct 04 17:52:46.211145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 625/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.223816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.224890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.228194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] Creating event network-vif-plugged:c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7 for instance 6262e96e-3d3f-4a13-814b-7a032cade923 on n-h1-831193-17 Oct 04 17:52:46.247612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.248377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.249058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.254710 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-123bc5ee-52aa-4517-ac0f-d61176fc7e56 req-2760d1db-f0a5-4d95-8981-0c23ccc4043f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084624 Oct 04 17:52:46.256703 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 557/1182] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:46.257763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.260452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.263987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.719137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.720280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.739181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.741218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.742880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.744745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.746285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.746907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.774689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] HTTP exception thrown: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Request method failure captured: Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 HTTP/1.1 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIl_FSuPMAuDCdCdMb24vq-q2J2F9OwcG5clB5o88VHwP7XSYgHhBeLPnb3LUmTffeZppPjkij5mLFhHbRiBwWbh6IYHPkvhf4VBvP33S4KlIzG48CkVnHdECPOyOaby7LmcC6xCzH3IyErNRIFWagr4MKFGBu_QCTB6LHFQclc_b0 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:46.777365 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 86f34bf323cd41a489655373a9123b06 Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.778968 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '07cfef55-6ba9-4a00-b36f-e79dae6fd2d0'} Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:46.779898 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.781362 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.783950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Returning 404 to user: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:46.784995 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26cf34ca-84e1-4f61-8f0b-df0cb62ea02d tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 404 len: 111 microversion: 2.1 time: 0.070851 Oct 04 17:52:46.786122 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 558/1183] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:46 2022] DELETE /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:52:46.796354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.804679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] [instance: 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.813406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.826571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9326150-7827-4eed-b569-8ce9554751bf tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.619085 Oct 04 17:52:46.826946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.828051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 626/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.833661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.835201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.836781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.838782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.840951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.886224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] HTTP exception thrown: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Request method failure captured: Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 HTTP/1.1 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHIl_FSuPMAuDCdCdMb24vq-q2J2F9OwcG5clB5o88VHwP7XSYgHhBeLPnb3LUmTffeZppPjkij5mLFhHbRiBwWbh6IYHPkvhf4VBvP33S4KlIzG48CkVnHdECPOyOaby7LmcC6xCzH3IyErNRIFWagr4MKFGBu_QCTB6LHFQclc_b0 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:46.887974 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60536b45e94840a78065a08a9cce0eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 60536b45e94840a78065a08a9cce0eb7 Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2017555730 Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 86f34bf323cd41a489655373a9123b06 Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2017555730-project Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.889312 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '07cfef55-6ba9-4a00-b36f-e79dae6fd2d0'} Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:46.890043 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. Oct 04 17:52:46.891253 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:46.893257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] Returning 404 to user: Instance 07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:46.893257 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce300e67-08b3-4041-8bee-c737899b077a tempest-AttachSCSIVolumeTestJSON-2017555730 tempest-AttachSCSIVolumeTestJSON-2017555730-project] 10.222.0.33 "GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0" status: 404 len: 111 microversion: 2.1 time: 0.099508 Oct 04 17:52:46.895662 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 559/1185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/07cfef55-6ba9-4a00-b36f-e79dae6fd2d0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:47.140733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.144361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.160539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.163380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.164815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.169498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.170601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.171249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.230418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.231056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] [instance: 3b669e2a-260a-4e12-aafe-687ca1f4f7ab] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.243740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.244562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.245240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.246158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.246817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.248048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.289355 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] HTTP exception thrown: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Request method failure captured: Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab HTTP/1.1 Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJrhcK-hrFH5UzFOmXJKE9FWvH4xaXLvWsqZtMapgdUkWhslNOssazqYn9eigohsIPATUDxGOdSxluInnC4LK_KOUU1zofqONQ7H7zVrnHQRg83CmOtEmq2uOU2WClfikYHgZMtcubGiec5SoJuzWHQpJ1F3_sb1-7AICnEEKUaXbo Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 720a616ccdf64ea8bf6dd7d43cd7304d Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:47.291311 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/720a616ccdf64ea8bf6dd7d43cd7304d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 720a616ccdf64ea8bf6dd7d43cd7304d Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1684927253 Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListImageFiltersTestJSON-1684927253-project Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 7c05b59c6c964deab8eb775ca2cb8b15 Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListImageFiltersTestJSON-1684927253-project Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. Oct 04 17:52:47.292839 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '3b669e2a-260a-4e12-aafe-687ca1f4f7ab'} Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:47.293577 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. Oct 04 17:52:47.294764 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:47.297561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Returning 404 to user: Instance 3b669e2a-260a-4e12-aafe-687ca1f4f7ab could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:47.298692 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e97ad1dd-c097-4074-bc86-34794870b536 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab" status: 404 len: 111 microversion: 2.1 time: 0.072904 Oct 04 17:52:47.304875 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 560/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/3b669e2a-260a-4e12-aafe-687ca1f4f7ab => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:52:47.315175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ebdb47de-a6b0-49d6-ace8-e86312bbda5c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63419da4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.496265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:47.510861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f51fb3d1-eaf8-4159-b2cd-4840c1a30934 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1536 microversion: 2.1 time: 0.381915 Oct 04 17:52:47.512465 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 627/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1536 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:47.732188 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ebdb47de-a6b0-49d6-ace8-e86312bbda5c tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad" status: 204 len: 0 microversion: 2.1 time: 0.422649 Oct 04 17:52:47.732838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 561/1188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] DELETE /compute/v2.1/images/58f55812-aa95-4b80-ab68-8036b50f6cad => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:52:47.743803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-479a98c9-1f0f-4d63-ba0e-1325bee484c2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f634181be50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.871070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.871950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.885614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.886365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.887018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.895083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.896269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.897164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.168491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-479a98c9-1f0f-4d63-ba0e-1325bee484c2 tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a" status: 204 len: 0 microversion: 2.1 time: 0.431050 Oct 04 17:52:48.169069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 628/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] DELETE /compute/v2.1/images/50ef28d4-98b6-44df-a453-02b8d26fae0a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:48.181147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e9e5e4a-1150-4813-bd2f-9d563c151e6d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] Calling method '.version_select at 0x7f63417f9790>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.296055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:48.305364 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c44bb26b-7950-4d78-a6b1-9ed25279799d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.440077 Oct 04 17:52:48.319676 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 562/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:48.411074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e9e5e4a-1150-4813-bd2f-9d563c151e6d tempest-ListImageFiltersTestJSON-1684927253 tempest-ListImageFiltersTestJSON-1684927253-project] 10.222.0.33 "DELETE /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4" status: 204 len: 0 microversion: 2.1 time: 0.236138 Oct 04 17:52:48.411648 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 629/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:48 2022] DELETE /compute/v2.1/images/a981369a-20dc-48ce-b972-4893102f9df4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:52:48.555102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.555845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:48.567687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.568450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.569128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.570299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.571103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.571863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.859617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:48.868695 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec8b4db2-5f38-4445-9447-aff36919cbd6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1536 microversion: 2.1 time: 0.325392 Oct 04 17:52:48.869769 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 563/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:48 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1536 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:48.995144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "963142d6-1264-44b9-9068-93aa0b8cd298", "device": "/dev/xvdb"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:48.998774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:49.005571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.006562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.007234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.008274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.008888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.009468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.332939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:49.333678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:49.343555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.344408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.345153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.346670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.347453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.348191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.566748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:49.578791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4700a0dc-88b3-47e7-a2e3-e1d600153e47 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1317 microversion: 2.1 time: 0.248547 Oct 04 17:52:49.579438 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 564/1193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:49 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:49.898628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:49.899817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:49.926652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.927594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.928415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.929657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.930469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.931309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.282064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:50.289944 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83abf38c-de5b-41f9-bb23-a598adc17265 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1536 microversion: 2.1 time: 0.398626 Oct 04 17:52:50.290523 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 565/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:49 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1536 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:50.484927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Calling method '.version_select at 0x7f6341a111f0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.574180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.576584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.578607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.582524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.584384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.590331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.709912 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d744646f-1510-410c-bc1d-95c2c943251b tempest-AbsoluteLimitsTestJSON-1183645861 tempest-AbsoluteLimitsTestJSON-1183645861-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.418024 Oct 04 17:52:50.723019 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 566/1195] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:50.752244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.757690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.778616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f0ce33e-6e60-4cf3-a2ad-f3dfaa47dcdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.787608 Oct 04 17:52:50.780439 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 630/1196] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 17:52:48 2022] POST /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 194 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:50.793800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.794399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.794952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.795829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.796488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.797144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.320857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.327352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:51.344243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.346841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.356127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.357957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.359867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.361234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.722323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:51.735892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-85d703fb-5a63-45f5-8cdb-e2084c535818 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1467 microversion: 2.1 time: 1.021144 Oct 04 17:52:51.746297 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 567/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1467 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:51.768284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.768995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:51.790074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.790582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.791016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.799820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.800317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.800762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.139175 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e1ad9e08-591d-4897-a165-08286ba17a36 tempest-ServersOnMultiNodesTest-1362648984 tempest-ServersOnMultiNodesTest-1362648984-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1620 microversion: 2.1 time: 0.373817 Oct 04 17:52:52.139175 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 568/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1620 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:52.163664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.164328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.173373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.174014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.175214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.176055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.176624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.177426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.224879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:52.335318 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-169bf221-b474-49ec-9b74-da87223d3a63 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 204 len: 0 microversion: 2.1 time: 0.176948 Oct 04 17:52:52.336638 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 569/1199] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:52 2022] DELETE /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:52:52.346612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.347815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.355705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.356234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.356666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.357425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.358092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.358547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.646275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:52.658839 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01ecb42b-c002-4072-9ba8-a6abfbb43164 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1473 microversion: 2.1 time: 0.317019 Oct 04 17:52:52.675668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:52.677000 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 570/1200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:52.685218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de6685e6-6dc7-428a-83bd-cc996f2deb0b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1529 microversion: 2.1 time: 1.372632 Oct 04 17:52:52.686231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "name": "network-vif-plugged", "status": "completed", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:52.686550 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 631/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1529 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:52.711053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.712405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.716395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.717364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.720019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.726847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.727795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.730543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.731571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.735603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.737248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.776180 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] Creating event network-vif-plugged:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h1-831193-17 Oct 04 17:52:52.804977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0c77d023-8503-40f7-a468-1cc45477b2af req-62ecb59f-37a7-48f2-b7b6-b6defff73f02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123466 Oct 04 17:52:52.807375 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 571/1202] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:53.117363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:53.129935 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90eb43e8-ca4a-43da-b6f4-ec598323c091 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1529 microversion: 2.1 time: 0.423559 Oct 04 17:52:53.131527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 632/1203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1529 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:53.162760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a106208f-84ba-42ef-a609-8d67868c5027 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.174878 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a106208f-84ba-42ef-a609-8d67868c5027 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] HTTP exception thrown: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a106208f-84ba-42ef-a609-8d67868c5027 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Request method failure captured: Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/flavors/ce27549a-411c-46b1-b5ec-75f38c659936 HTTP/1.1 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHH9kDApossUD2lqtM4dVj-y5Bn4DmHOaBgP_A6JFY9T38wOTQi7AUQFGmbo31rABIteHN-XDLn-Gw8urgYCQZqygNFvm9BY37hlDSKUBwGG1cyG0gaYjtBkm2KOUGOA7gV2rRvyc6AWrLPYJebUwKU3GeUuMBvFYMIQdeT8_O_uvIY Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 06621baf96d541649ee96173cb87f959 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-MigrationsAdminTest-2057907966 Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:52:53.189495 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06621baf96d541649ee96173cb87f959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_06621baf96d541649ee96173cb87f959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06621baf96d541649ee96173cb87f959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/06621baf96d541649ee96173cb87f959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-MigrationsAdminTest-2057907966 Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 06621baf96d541649ee96173cb87f959 Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-MigrationsAdminTest-2057907966 Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-MigrationsAdminTest-2057907966-project-admin Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 15a514bb8e3042169f795fd117db8886 Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-MigrationsAdminTest-2057907966-project-admin Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. Oct 04 17:52:53.192401 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ce27549a-411c-46b1-b5ec-75f38c659936'} Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:53.193913 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. Oct 04 17:52:53.198943 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:53.204522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a106208f-84ba-42ef-a609-8d67868c5027 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Returning 404 to user: Flavor ce27549a-411c-46b1-b5ec-75f38c659936 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:53.204522 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a106208f-84ba-42ef-a609-8d67868c5027 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/ce27549a-411c-46b1-b5ec-75f38c659936" status: 404 len: 109 microversion: 2.1 time: 0.042652 Oct 04 17:52:53.204522 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 572/1204] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:53 2022] DELETE /compute/v2.1/flavors/ce27549a-411c-46b1-b5ec-75f38c659936 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:53.430065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1147104509", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:53.495710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:53.691020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.691020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:53.720160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.722710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.723315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.724137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.725341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.728093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.835792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:53.837623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:53.838329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:53.839597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:53.840234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:53.850761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.851630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.852285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.853354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.854060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.854748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.875527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:53.881864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Getting quotas for user 0d0d5ddca82c4d8c83e182837bec0c27 and project b1f02c42a7e1479bb776a01901053d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:53.898976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:53.904216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:54.005877 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0626ee69-d8e6-4094-8227-5d42aa4ab6af tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579525 Oct 04 17:52:54.014913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 633/1205] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:52:54.025316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6c6e8ce-9bf5-4e94-9f41-feafd17e02ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.026348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6c6e8ce-9bf5-4e94-9f41-feafd17e02ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:54.150496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6c6e8ce-9bf5-4e94-9f41-feafd17e02ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.150708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6c6e8ce-9bf5-4e94-9f41-feafd17e02ef tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1213 microversion: 2.1 time: 0.134491 Oct 04 17:52:54.151352 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 634/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.567087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.583665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f988b0a0-e1f2-452a-911b-4bb587a58e07 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1473 microversion: 2.1 time: 0.890896 Oct 04 17:52:54.584337 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 573/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:53 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1473 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.652721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Calling method '.version_select at 0x7f63418bec10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.675793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.677658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.678817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.681361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.682297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.683425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.739644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:54.743930 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4534362f-68b3-418e-be4b-94f7595f96cf tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.334038 Oct 04 17:52:54.755973 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 635/1208] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:54.840467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1186251686", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:54.914757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:55.174701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.175537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.185053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.185991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.186588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.187540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.188174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.188759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.302378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:55.315870 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb5c441e-f3c7-424c-a2de-f722e69bcb64 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1265 microversion: 2.1 time: 0.145411 Oct 04 17:52:55.316613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 636/1209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:55.449357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Getting quotas for project ed17ea1ad1484a5a88ac6e38af521d6c. Resources: dict_keys(['metadata_items']) {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:55.455224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Getting quotas for user 2312350f1bc3492cb26a441190664cb4 and project ed17ea1ad1484a5a88ac6e38af521d6c. Resources: dict_keys(['metadata_items']) {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:55.470541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Request method failure captured: Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 1752 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHL2K0bmzwOG9FPbd6ewkQDy3LlOl_HRbkilhgX-qosJDKZAEvTi60zewXskE1wZwoQYrb1WfL5RvkjztPRfofqAPw8sfMchp2M9G2K90ri3SyWoMOJYoa9-VpS7JQkP4j36Jh3DepvEC70YYbU96CgtbPN2tKplBXfW1mZQPSj0-wM Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ed17ea1ad1484a5a88ac6e38af521d6c Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1354918276 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed17ea1ad1484a5a88ac6e38af521d6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed17ea1ad1484a5a88ac6e38af521d6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed17ea1ad1484a5a88ac6e38af521d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed17ea1ad1484a5a88ac6e38af521d6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1354918276 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ed17ea1ad1484a5a88ac6e38af521d6c Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1354918276 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 2312350f1bc3492cb26a441190664cb4 Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1186251686", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:52:55.473587 n-d-831193-17 devstack@n-api.service[128771]: exception: Maximum number of metadata items exceeds 128 Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1186251686', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:55.476814 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 17:52:55.481210 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:52:55.484748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:55.486439 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-90bc0e96-cea1-4128-a52f-da4d7d445815 tempest-AbsoluteLimitsNegativeTestJSON-1354918276 tempest-AbsoluteLimitsNegativeTestJSON-1354918276-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.650550 Oct 04 17:52:55.492836 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 574/1210] 10.222.0.33 () {60 vars in 1148 bytes} [Tue Oct 4 17:52:54 2022] POST /compute/v2.1/servers => generated 87 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:52:55.614767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.617036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.635770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.636539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.637221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.638127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.639288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.665802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.676812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262e96e-3d3f-4a13-814b-7a032cade923", "name": "network-vif-deleted", "tag": "c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:55.714286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.719399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.720229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.774171 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] Creating event network-vif-deleted:c9aa98e5-56f5-4e98-91f7-cb775ca8bbe7 for instance 6262e96e-3d3f-4a13-814b-7a032cade923 on n-h1-831193-17 Oct 04 17:52:55.793621 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6dcf1c4e-12b7-47f7-b804-342ae4dd9b35 req-7f4fcf61-2084-448a-a4ab-84fab10468b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122193 Oct 04 17:52:55.797169 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 575/1211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:52:55.929110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:55.944461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13339458-8a19-4002-a0eb-ba7f96ba7d5d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1431 microversion: 2.1 time: 0.331199 Oct 04 17:52:55.961112 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 637/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1431 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.343641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.344665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:56.384816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.387311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.393276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.395960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.400622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.402232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.861495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.866572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:56.873523 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dbbe0fd7-7040-4fcd-a3d4-1387b15fcdc0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1283 microversion: 2.1 time: 0.535866 Oct 04 17:52:56.889838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 576/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1283 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.981583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.982737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.010201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.010744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.011225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.011950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.013672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.014499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.110075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.112828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.113589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.114284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lazy-loading 'fault' on Instance uuid 6262e96e-3d3f-4a13-814b-7a032cade923 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:57.216023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:57.225804 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3283210-e52e-4225-9429-61efe8875f9a tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 200 len: 1307 microversion: 2.1 time: 0.255628 Oct 04 17:52:57.227107 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 638/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:57.897874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.898668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.928896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.928896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.928896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.931987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.936496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.937105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.100300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:58.113035 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bbd97f14-786c-4ac5-b4ae-9391863db71a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1271 microversion: 2.1 time: 0.217754 Oct 04 17:52:58.129325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 577/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:58.255567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.257778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6262e96e-3d3f-4a13-814b-7a032cade923] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.274842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.277806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.279359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.281605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.286546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.287474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.433872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 HTTP/1.1 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6262e96e-3d3f-4a13-814b-7a032cade923'} Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:58.449457 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 6262e96e-3d3f-4a13-814b-7a032cade923 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:58.454491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91f45304-d2c7-4086-83d0-74d776c2778b tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923" status: 404 len: 111 microversion: 2.1 time: 0.203901 Oct 04 17:52:58.457719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 639/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:58 2022] GET /compute/v2.1/servers/6262e96e-3d3f-4a13-814b-7a032cade923 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:58.469680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.470186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.482707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.483233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.483672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.485572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.486221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.486658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.602183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:58.833981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:58.851252 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4085be3-ca8a-4ea8-ba59-0ec15a907fbc tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 204 len: 0 microversion: 2.1 time: 0.389105 Oct 04 17:52:58.856557 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 578/1217] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:58 2022] DELETE /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:58.862165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.863123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.871543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.872330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.872947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.873835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.874459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.875139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.158530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.159565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.179508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.180596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.182232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.184204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.205088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.207944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.248931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.252897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:59.269190 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef161da9-9d2d-419d-b64e-2afd492eced1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1473 microversion: 2.1 time: 0.410952 Oct 04 17:52:59.276788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 640/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:58 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:59.552208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.566903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44c3c803-8891-4646-b2d3-b65db4f1fd3d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.426007 Oct 04 17:52:59.571100 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 579/1219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:59.750712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33a2c902-72b3-4d7a-8edf-85701322cc34"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:59.753147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.762180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.762762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.763229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.763944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.764401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.764824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.057327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:00.083955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.086127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.086842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.136742 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] Creating event network-changed:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:53:00.137601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a72901b4-ba6b-47cb-9ffc-3d2082f61d38 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "POST /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390834 Oct 04 17:53:00.138899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 641/1220] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 17:52:59 2022] POST /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:00.152127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-44d8613a-85d1-48b7-973c-415934166f85 req-9c90a9b9-8eb8-41b9-854e-2a0976f1deb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100516 Oct 04 17:53:00.153161 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 580/1221] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:00.307253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:00.309362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:00.316725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.317387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.319962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.321465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.324184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.324717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.599765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:00.602064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:00.622124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.622698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.626097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.626897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.627407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.630445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.688940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:01.232000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:01.242036 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1686ad6-ee37-48ee-ad8b-ae2b14d9ef4d tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1473 microversion: 2.1 time: 0.940163 Oct 04 17:53:01.246932 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 642/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:00 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1473 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:01.323857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e291ad8-dded-4de9-be32-1f16218fad95", "name": "network-vif-deleted", "tag": "8d7c0f27-e6d3-4b7a-843d-0028ea28c22b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:01.362436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.363023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.366508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.406185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] Creating event network-vif-deleted:8d7c0f27-e6d3-4b7a-843d-0028ea28c22b for instance 7e291ad8-dded-4de9-be32-1f16218fad95 on n-h2-831193-17 Oct 04 17:53:01.415596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ac032ffc-c90e-4982-a51a-e4da8599564c req-378f705b-3d3f-4acf-af80-00223927205a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096106 Oct 04 17:53:01.417972 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 643/1223] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:01.725590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:01.748639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.749994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:01.755774 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4f62a65-3806-4af0-959c-3cf0a7468ecd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 1.164015 Oct 04 17:53:01.766287 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 581/1224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:00 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:01.780336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.783067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.785420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.789038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.790662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.792386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.887480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:02.029979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-456c157a-b2c1-4691-b72b-f5aca6f18412 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 204 len: 0 microversion: 2.1 time: 0.291038 Oct 04 17:53:02.031060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 644/1225] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:01 2022] DELETE /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:53:02.040595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.041244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.054376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.054881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.055357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.056081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.056538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.063427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.274561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.275699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.289130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.290034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.295422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.296413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.297331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.297983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.338085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.353812 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-690f4c05-d5c5-4dce-bda2-2e53c9cea2fb tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1715 microversion: 2.1 time: 0.318163 Oct 04 17:53:02.356450 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 582/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1715 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:02.378550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.379655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.380258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.381152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lazy-loading 'fault' on Instance uuid 7e291ad8-dded-4de9-be32-1f16218fad95 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:02.512256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.523899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37390d7c-96a9-4f5b-b25a-ab1b0b46b895 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 200 len: 1307 microversion: 2.1 time: 0.254923 Oct 04 17:53:02.541625 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 645/1227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:02.784543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.786422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.798605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.800238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.802391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.806059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.806899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.807611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.232679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:03.244284 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eda0bacc-b374-48ac-bbbb-84ce632893be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.463080 Oct 04 17:53:03.247048 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 583/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:03.384352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.385325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.395900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.396462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.397025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.397967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.398839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.399484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.558619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.559663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 7e291ad8-dded-4de9-be32-1f16218fad95] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.573696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.574397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.575015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.577299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.578600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.579438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.643929 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 HTTP/1.1 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '7e291ad8-dded-4de9-be32-1f16218fad95'} Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:03.647087 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. Oct 04 17:53:03.652428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:03.657111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 7e291ad8-dded-4de9-be32-1f16218fad95 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:03.658307 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07addda9-e85f-4d80-b7f8-f6cd496961d2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95" status: 404 len: 111 microversion: 2.1 time: 0.106174 Oct 04 17:53:03.662233 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 584/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/7e291ad8-dded-4de9-be32-1f16218fad95 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:53:03.670816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.671688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.705523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.706104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.706612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.707431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.707966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.708596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.758051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:03.771326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:03.785060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd5436e0-b768-4126-99a7-1dba0858dd5c tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1715 microversion: 2.1 time: 0.407429 Oct 04 17:53:03.803907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 646/1230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1715 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:03.925527 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-666714f7-5c42-4ebf-a839-6399c2cdd393 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 204 len: 0 microversion: 2.1 time: 0.261677 Oct 04 17:53:03.926933 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 585/1231] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:03 2022] DELETE /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:03.935274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.936144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.943767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.944582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.945191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.946072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.946840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.947455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.117176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:04.128289 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-251f46a6-163a-4669-af4c-fd015f605103 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1472 microversion: 2.1 time: 0.196857 Oct 04 17:53:04.148221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 647/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:04.273146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.274194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:04.282659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.284114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.284581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.285316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.285781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.286207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.814236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.815925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:04.833166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:04.841162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:04.844970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.847992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.848449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.849198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.849657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.858183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.874058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:04.884535 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04848683-eb00-4d2b-b14f-33e2aa8e474b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.616064 Oct 04 17:53:04.888304 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 586/1233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:04 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:05.156490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.157805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:05.174395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.175436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.176102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.177405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.181918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.185843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.465557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:05.730724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:05.743071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ddae27af-1179-4eba-9fb1-b5f031210d01 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1715 microversion: 2.1 time: 0.936919 Oct 04 17:53:05.749002 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 648/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:04 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1715 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:06.069177 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-091d6b46-2ec2-489c-9e56-2ec3738b1331 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.317613 Oct 04 17:53:06.069824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 649/1235] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 17:53:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:53:06.082777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.087542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.120987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.122617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.123298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.124244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.126489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.127188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.388011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:06.403190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce96ec66-1365-457d-af51-c209b7d8bb02 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1472 microversion: 2.1 time: 1.252080 Oct 04 17:53:06.404584 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 587/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:05 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1472 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:06.414669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.415972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.425673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.426658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.428329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.431187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.432010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.433700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.815342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:06.833209 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4535a11a-e2f6-46e0-a170-6ff6c6c23c04 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.426242 Oct 04 17:53:06.836184 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 588/1237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:06.842943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f16ec9f-a3f6-4a99-8e77-88863141a081 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Calling method '.version_select at 0x7f6341ab0f70>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.923152 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-1f16ec9f-a3f6-4a99-8e77-88863141a081 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] HTTP exception thrown: Image not found. Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f16ec9f-a3f6-4a99-8e77-88863141a081 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Request method failure captured: Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMBR36FJCRelKnY4_2JIIfAFG_ZjCkHQ64dyEi5gGuGLUbEhFGrTrwExq1rSIriOucxqSObVmbheQc7eymnF_4gIPtzUeTUGImySyk9tZ2x6lZtu6I5ixMvYoevW67Q6fMPbuH8OQZxIaDnE-og61vUha_ZkYJTwNw55gsi_eiHmpQ Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 49017c73719a40d0992a3fddf12de0b9 Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '-1'} Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.935828 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f16ec9f-a3f6-4a99-8e77-88863141a081 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:06.940082 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f16ec9f-a3f6-4a99-8e77-88863141a081 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.100931 Oct 04 17:53:06.946041 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 589/1238] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 17:53:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:06.953038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.956157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.980907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.985019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.985667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.986455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.986944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.987428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.251437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:07.295216 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-af1c2151-a71d-4ee5-819b-d71e6d502df2 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1648 microversion: 2.1 time: 0.335881 Oct 04 17:53:07.295915 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 590/1239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1648 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:07.328665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d9e99cc-fb35-4390-877b-7488e3250a37 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Calling method '.version_select at 0x7f6341a27280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.403535 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3d9e99cc-fb35-4390-877b-7488e3250a37 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] HTTP exception thrown: Image not found. Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d9e99cc-fb35-4390-877b-7488e3250a37 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Request method failure captured: Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/images/17cbd515-0a6d-4029-913c-6e168b5cd78j HTTP/1.1 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMBR36FJCRelKnY4_2JIIfAFG_ZjCkHQ64dyEi5gGuGLUbEhFGrTrwExq1rSIriOucxqSObVmbheQc7eymnF_4gIPtzUeTUGImySyk9tZ2x6lZtu6I5ixMvYoevW67Q6fMPbuH8OQZxIaDnE-og61vUha_ZkYJTwNw55gsi_eiHmpQ Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 49017c73719a40d0992a3fddf12de0b9 Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '17cbd515-0a6d-4029-913c-6e168b5cd78j'} Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 17cbd515-0a6d-4029-913c-6e168b5cd78j to delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17cbd515-0a6d-4029-913c-6e168b5cd78j could not be found. Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.406075 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:07.417960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.428452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d9e99cc-fb35-4390-877b-7488e3250a37 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:07.428712 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d9e99cc-fb35-4390-877b-7488e3250a37 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/17cbd515-0a6d-4029-913c-6e168b5cd78j" status: 404 len: 62 microversion: 2.1 time: 0.126391 Oct 04 17:53:07.435863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 591/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:07 2022] DELETE /compute/v2.1/images/17cbd515-0a6d-4029-913c-6e168b5cd78j => generated 62 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:07.456589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3235f9-5c47-4913-832e-992a80c41371", "name": "network-vif-deleted", "tag": "704a5bc8-08b9-499b-aa9a-b21b3c2639ae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:07.497828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.498316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.498757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.536213 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] Creating event network-vif-deleted:704a5bc8-08b9-499b-aa9a-b21b3c2639ae for instance 3d3235f9-5c47-4913-832e-992a80c41371 on n-h2-831193-17 Oct 04 17:53:07.546583 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e0c673ff-19d0-488d-b566-8ddb6d271aa7 req-6c4609d9-d577-4437-b4c5-bf9c5cc299c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115975 Oct 04 17:53:07.547562 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 592/1241] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:07.553081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.553801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:07.569136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.569641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.570090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.570811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.571341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.571776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.591575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:07.642147 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49d3eb81-b9fa-4a3f-a74d-25de28aecd79 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 2423 microversion: 2.25 time: 1.561913 Oct 04 17:53:07.645801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 650/1242] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 2423 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:07.658132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29c74a53-b0da-40fd-bc62-b5872441285f tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Calling method '.version_select at 0x7f63417c7430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.696011 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-29c74a53-b0da-40fd-bc62-b5872441285f tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] HTTP exception thrown: Image not found. Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29c74a53-b0da-40fd-bc62-b5872441285f tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Request method failure captured: Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/a84011a9-4e3d-4890-81c4-864ea053f6cd1 HTTP/1.1 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMBR36FJCRelKnY4_2JIIfAFG_ZjCkHQ64dyEi5gGuGLUbEhFGrTrwExq1rSIriOucxqSObVmbheQc7eymnF_4gIPtzUeTUGImySyk9tZ2x6lZtu6I5ixMvYoevW67Q6fMPbuH8OQZxIaDnE-og61vUha_ZkYJTwNw55gsi_eiHmpQ Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 49017c73719a40d0992a3fddf12de0b9 Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a84011a9-4e3d-4890-81c4-864ea053f6cd1'} Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a84011a9-4e3d-4890-81c4-864ea053f6cd1 to delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a84011a9-4e3d-4890-81c4-864ea053f6cd1 could not be found. Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.705923 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:07.710694 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:07.720294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29c74a53-b0da-40fd-bc62-b5872441285f tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:07.721524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29c74a53-b0da-40fd-bc62-b5872441285f tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/a84011a9-4e3d-4890-81c4-864ea053f6cd1" status: 404 len: 62 microversion: 2.1 time: 0.072622 Oct 04 17:53:07.734820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 651/1243] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:07 2022] DELETE /compute/v2.1/images/a84011a9-4e3d-4890-81c4-864ea053f6cd1 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:07.765971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cf741e-4631-468a-8c97-56e5677881b8", "name": "network-vif-deleted", "tag": "02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:07.773395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.781840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.783600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.784320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lazy-loading 'fault' on Instance uuid 3d3235f9-5c47-4913-832e-992a80c41371 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:07.804069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.804764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.806602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.864888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] Creating event network-vif-deleted:02cbdc0b-bbf6-406a-9ef3-b0ccf9c3592b for instance 66cf741e-4631-468a-8c97-56e5677881b8 on n-h1-831193-17 Oct 04 17:53:07.880717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c579ebf0-f12b-4617-b4dc-63de6d46a248 req-280c43cd-a908-4acc-a230-7f4da67b5da7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143208 Oct 04 17:53:07.883808 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 652/1244] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:07.899224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831193-17", "block_migration": "auto"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:07.906014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:07.926972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.927753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.928522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.930448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.931425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.933302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.963491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:07.971066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:07.980538 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cbb77e27-863e-4e49-a231-411f294a3471 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 200 len: 1306 microversion: 2.1 time: 0.431698 Oct 04 17:53:07.983523 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 593/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:07 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 1306 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:07.994251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dface982-b3f2-4072-a780-e2d58b7b70f2 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Calling method '.version_select at 0x7f6341af2ca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.009233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'flavor' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:08.049296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Going to try to live migrate instance to n-h2-831193-17 {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:53:08.058817 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-dface982-b3f2-4072-a780-e2d58b7b70f2 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] HTTP exception thrown: Image not found. Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dface982-b3f2-4072-a780-e2d58b7b70f2 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Request method failure captured: Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/images/tempest-invalid-996228233 HTTP/1.1 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMBR36FJCRelKnY4_2JIIfAFG_ZjCkHQ64dyEi5gGuGLUbEhFGrTrwExq1rSIriOucxqSObVmbheQc7eymnF_4gIPtzUeTUGImySyk9tZ2x6lZtu6I5ixMvYoevW67Q6fMPbuH8OQZxIaDnE-og61vUha_ZkYJTwNw55gsi_eiHmpQ Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 49017c73719a40d0992a3fddf12de0b9 Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'tempest-invalid-996228233'} Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-996228233 to delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-996228233 could not be found. Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.061187 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:08.065225 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.069739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dface982-b3f2-4072-a780-e2d58b7b70f2 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:08.071986 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dface982-b3f2-4072-a780-e2d58b7b70f2 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-996228233" status: 404 len: 62 microversion: 2.1 time: 0.086424 Oct 04 17:53:08.072880 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 594/1246] 10.222.0.33 () {58 vars in 1203 bytes} [Tue Oct 4 17:53:07 2022] DELETE /compute/v2.1/images/tempest-invalid-996228233 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:08.088419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.092810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:08.127909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.132495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.133250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.137831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.139639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.140561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.329338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:08.344221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-005448d4-4657-47c5-a6d5-18953dea8b9b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.269176 Oct 04 17:53:08.345166 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 595/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:08 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:08.352130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ee74d80-bc89-4bee-92e1-481e1fd67761 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Calling method '.version_select at 0x7f63419eb430>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.383785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0ee74d80-bc89-4bee-92e1-481e1fd67761 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] HTTP exception thrown: Image not found. Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ee74d80-bc89-4bee-92e1-481e1fd67761 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Request method failure captured: Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/images/b6bd48b2-e53c-4937-909b-5e7d744a0312 HTTP/1.1 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMBR36FJCRelKnY4_2JIIfAFG_ZjCkHQ64dyEi5gGuGLUbEhFGrTrwExq1rSIriOucxqSObVmbheQc7eymnF_4gIPtzUeTUGImySyk9tZ2x6lZtu6I5ixMvYoevW67Q6fMPbuH8OQZxIaDnE-og61vUha_ZkYJTwNw55gsi_eiHmpQ Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/154f6c7813f74713823a44dc0ed1406b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 154f6c7813f74713823a44dc0ed1406b Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-460398657 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 49017c73719a40d0992a3fddf12de0b9 Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-460398657-project Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: exception: Image not found. Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'b6bd48b2-e53c-4937-909b-5e7d744a0312'} Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6bd48b2-e53c-4937-909b-5e7d744a0312 to delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6bd48b2-e53c-4937-909b-5e7d744a0312 could not be found. Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.386642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:08.390595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:08.399380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ee74d80-bc89-4bee-92e1-481e1fd67761 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] Returning 404 to user: Image not found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:08.400489 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0ee74d80-bc89-4bee-92e1-481e1fd67761 tempest-ImagesDeleteNegativeTestJSON-460398657 tempest-ImagesDeleteNegativeTestJSON-460398657-project] 10.222.0.33 "DELETE /compute/v2.1/images/b6bd48b2-e53c-4937-909b-5e7d744a0312" status: 404 len: 62 microversion: 2.1 time: 0.054093 Oct 04 17:53:08.403835 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 596/1248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:08 2022] DELETE /compute/v2.1/images/b6bd48b2-e53c-4937-909b-5e7d744a0312 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:08.428368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.432245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:08.451242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.455920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.457077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.458200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.458829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.460784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.582961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.583482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.583924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.597531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lazy-loading 'fault' on Instance uuid 66cf741e-4631-468a-8c97-56e5677881b8 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:08.755141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51f1d73e7fbc42ecafb89f0875d5d70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f8b905a51742a18aea0297cd1f119d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:08.768495 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4153c6ce-3df3-456f-af25-e156e5bb7c05 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 200 len: 1355 microversion: 2.1 time: 0.360576 Oct 04 17:53:08.808368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 597/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:08 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 1355 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:09.010367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.011423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 3d3235f9-5c47-4913-832e-992a80c41371] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.024366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.025039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.027959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.028896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.029632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.030243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.060879 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 HTTP/1.1 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '3d3235f9-5c47-4913-832e-992a80c41371'} Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:09.062579 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. Oct 04 17:53:09.066826 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.069267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 3d3235f9-5c47-4913-832e-992a80c41371 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:09.070407 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3744127a-00c1-4563-8d59-1c0f0e847662 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371" status: 404 len: 111 microversion: 2.1 time: 0.065221 Oct 04 17:53:09.074883 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 598/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/servers/3d3235f9-5c47-4913-832e-992a80c41371 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:09.080603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.083481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.099334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.100117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.100799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.102423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.103589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.105176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.159130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:09.348699 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7156c62d-91bc-43ab-af7c-284349e397c6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 204 len: 0 microversion: 2.1 time: 0.271733 Oct 04 17:53:09.350298 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 599/1251] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:09 2022] DELETE /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:09.363970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.365525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.383970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.385326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.387384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.389653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.391208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.392315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.489343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:09.723518 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9197ba16-7200-4760-b257-c65be7f00e8e tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 204 len: 0 microversion: 2.1 time: 0.366794 Oct 04 17:53:09.724306 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 600/1252] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:09 2022] DELETE /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:09.743313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.746178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.761303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.761846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.762459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.763771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.764241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.764668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.044108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:10.080851 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4968336-7600-42a1-8fc6-8bb9c72aa5c5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 0.351184 Oct 04 17:53:10.082806 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 601/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:10.098708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.099526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:10.107880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.108524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.109063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.109987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.110548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.111258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.434509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:10.452127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fcbba1c9-8ea5-4d94-96e3-dd78ce9e1928 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1475 microversion: 2.1 time: 0.367618 Oct 04 17:53:10.467737 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 602/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:10.486070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.491787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:10.519216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.519729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.520176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.520892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.521353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.521784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.570088 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 HTTP/1.1 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '66cf741e-4631-468a-8c97-56e5677881b8'} Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:10.573193 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:10.577250 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:10.580784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:10.582388 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f08338bb-f4bd-4822-b8fa-932a86a93b3f tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 404 len: 111 microversion: 2.1 time: 0.112695 Oct 04 17:53:10.585935 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 603/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:10.598933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "name": "network-vif-plugged", "status": "completed", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:10.627320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.627747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.628188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.653004 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] Creating event network-vif-plugged:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:53:10.674626 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-58a641fc-9c34-4e15-9a30-c98c0b357378 req-baf775ae-0ed8-44fc-9684-944fd0990153 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087273 Oct 04 17:53:10.676198 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 604/1256] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:11.208200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Calling method '.version_select at 0x7f63419ef4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.277437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG neutronclient.v2_0.client [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist", "detail": ""}} {{(pid=128771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:11.278062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.security_group_api [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Neutron security group 63b244d1-adcb-4386-8a34-9629204717b3 not found {{(pid=128771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:11.278596 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] HTTP exception thrown: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.278596 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Request method failure captured: Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-security-groups/63b244d1-adcb-4386-8a34-9629204717b3 HTTP/1.1 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMGpsOG8Zkih31rQoturuEFIzdUZuyzG1rij7rmZXLeQkC-lSs4lKdv_2PNt8NqvqwselgaLE33VZ9b2_nEeLFiIQ4RQak6NRvUdV0qEXUNtjpAfCaH42iQBM0eUdpkWmjBPYPYeAffgt-8T8lQqvo2InNGqbqpHUe_3iGogYnUzaE Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: af304a0a8dee476fb8a4d07581ffb6a9 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: exception: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '63b244d1-adcb-4386-8a34-9629204717b3'} Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:11.312544 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Returning 404 to user: Security group 63b244d1-adcb-4386-8a34-9629204717b3 does not exist Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-799c2bbc-5042-4c3e-837c-5efa3b2f2165'] {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:11.316466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2dfa252-bfd1-4820-b698-c44752b9a2ce tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/63b244d1-adcb-4386-8a34-9629204717b3" status: 404 len: 194 microversion: 2.1 time: 0.637154 Oct 04 17:53:11.319916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 605/1257] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:10 2022] DELETE /compute/v2.1/os-security-groups/63b244d1-adcb-4386-8a34-9629204717b3 => generated 194 bytes in 642 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:11.324375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.337206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:11.347325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.347840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.348368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.350877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.351428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.351876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.402192 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 HTTP/1.1 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1db13119-c61f-4371-b78b-9957079b8055'} Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:11.405315 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:11.409183 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-39548678-94e6-4266-b4a5-3465f62274b7 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 404 len: 111 microversion: 2.1 time: 0.086643 Oct 04 17:53:11.410820 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 606/1258] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:11 2022] DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:11.416519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.417202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:11.432011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.433030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.433481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.434209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.434673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.435183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.878284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cde6fd9-fe0a-4a87-b240-2127f60a434b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/action" status: 202 len: 0 microversion: 2.25 time: 3.992335 Oct 04 17:53:11.880654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 653/1259] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:53:07 2022] POST /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/action => generated 0 bytes in 3996 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:11.901714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5c97b78-9341-4511-9417-ee20be72d047 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014737 Oct 04 17:53:11.903144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 654/1260] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 17:53:11 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:53:11.918191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.920000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:11.927965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.928826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.929590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.930555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.932126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.933555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.955468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 HTTP/1.1 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '1db13119-c61f-4371-b78b-9957079b8055'} Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.959463 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:11.964186 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.968907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:11.970993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba62c446-803f-45d6-90c1-31c48eadeec9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 404 len: 111 microversion: 2.1 time: 0.066330 Oct 04 17:53:11.974298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 655/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:12.307953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96891c6a-f75a-4b1e-adf3-2b64a03abd84 tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] Calling method '.version_select at 0x7f63418be430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.402330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96891c6a-f75a-4b1e-adf3-2b64a03abd84 tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] 10.222.0.33 "GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857" status: 200 len: 784 microversion: 2.1 time: 0.423702 Oct 04 17:53:12.403755 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 656/1262] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857 => generated 784 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:12.433935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.437518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.457317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.458521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.462871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.465174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.465736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.468292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.557157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:12.586482 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e689051f-5ebd-4477-933a-2fd3b5b2257c tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1313 microversion: 2.1 time: 1.175178 Oct 04 17:53:12.587334 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 607/1263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1313 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:12.599300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.599300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.599300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.599300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lazy-loading 'fault' on Instance uuid 6d70836b-a650-4fbd-9a80-4a70b5b4788d {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:12.607342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:12.616874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.627589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.659247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.663802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.664609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.666327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.669878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.670688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.834163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:12.850320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fcdc0a1f-9bdc-4903-8c5c-6b8dadf16b1f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 200 len: 1309 microversion: 2.1 time: 0.442369 Oct 04 17:53:12.851425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 657/1264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:12.871547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13792d43-e3ba-4f3d-8c02-0ecd51381ddb tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Calling method '.version_select at 0x7f634193a700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.162953 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13792d43-e3ba-4f3d-8c02-0ecd51381ddb tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.309577 Oct 04 17:53:13.174995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 658/1265] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:13.181418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d70836b-a650-4fbd-9a80-4a70b5b4788d", "name": "network-vif-deleted", "tag": "80c7950b-3d22-4153-a74f-99ef8625a1b7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:13.234003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:13.242971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.244720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.248993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.256626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:13.266809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:13.269326 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d77a386c-b5dd-4451-bf2a-b0c7535d8fba tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.666797 Oct 04 17:53:13.277252 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 608/1266] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:13.290128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] Creating event network-vif-deleted:80c7950b-3d22-4153-a74f-99ef8625a1b7 for instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d on n-h1-831193-17 Oct 04 17:53:13.291502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0f03aa5-9f1f-43e5-8916-4562ce0d0f85 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '.version_select at 0x7f63419fec10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.312391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c7f83c57-7737-4a20-97b1-38cbc9867ead req-92518947-3bef-4230-9213-734026c27c9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135769 Oct 04 17:53:13.313813 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 659/1267] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:13.322142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-229f9bb1-ae92-48ed-aaf3-60d2a614751e tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] Calling method '.version_select at 0x7f63418beaf0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.348390 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c0f03aa5-9f1f-43e5-8916-4562ce0d0f85 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942937255" status: 202 len: 0 microversion: 2.1 time: 0.069510 Oct 04 17:53:13.349184 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 609/1268] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942937255 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:13.354809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e9e98d-0bac-4176-ab18-b935ccd4d5cb", "name": "network-vif-deleted", "tag": "c8b48788-07cf-403d-aa82-09ab6410d357"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:13.386525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.387023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.387503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.431375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-229f9bb1-ae92-48ed-aaf3-60d2a614751e tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.116433 Oct 04 17:53:13.432165 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 660/1269] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/images => generated 445 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:13.442862 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] Creating event network-vif-deleted:c8b48788-07cf-403d-aa82-09ab6410d357 for instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb on n-h2-831193-17 Oct 04 17:53:13.444944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Calling method '.version_select at 0x7f63419a8c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.470242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-55729d39-0b25-4fa6-a111-7ba3b540c7fd req-5c59a06b-8a67-4d38-991d-39b205e8411d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119252 Oct 04 17:53:13.491536 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 610/1270] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:13.498760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9f902d0-6f0d-42ab-8187-5a5046611d88 tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] Calling method '.version_select at 0x7f6341983790>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.674682 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9f902d0-6f0d-42ab-8187-5a5046611d88 tempest-ListImagesTestJSON-19844885 tempest-ListImagesTestJSON-19844885-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.181417 Oct 04 17:53:13.688015 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 611/1271] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:13.696885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.698800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.708350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.709108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.709704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.711296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.711911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.712534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.767514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.768237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 17:53:13.768237 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Request method failure captured: Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/681c4505-14b9-49f4-a9b0-2cd23f9152fc HTTP/1.1 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMGpsOG8Zkih31rQoturuEFIzdUZuyzG1rij7rmZXLeQkC-lSs4lKdv_2PNt8NqvqwselgaLE33VZ9b2_nEeLFiIQ4RQak6NRvUdV0qEXUNtjpAfCaH42iQBM0eUdpkWmjBPYPYeAffgt-8T8lQqvo2InNGqbqpHUe_3iGogYnUzaE Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: af304a0a8dee476fb8a4d07581ffb6a9 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: exception: Insufficient rights for removing default security group. Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '681c4505-14b9-49f4-a9b0-2cd23f9152fc'} Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.774440 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-8dea34e6-d998-470a-9fc7-b9df4722b5a1'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.778890 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a1211ee-1ceb-4f9e-8de2-16fe7b1fc093 tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/681c4505-14b9-49f4-a9b0-2cd23f9152fc" status: 400 len: 182 microversion: 2.1 time: 0.342102 Oct 04 17:53:13.781762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 661/1272] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/681c4505-14b9-49f4-a9b0-2cd23f9152fc => generated 182 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:13.806608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Calling method '.version_select at 0x7f634193a280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.857437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.858119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Neutron security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.858655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] HTTP exception thrown: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.858655 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Request method failure captured: Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-security-groups/9e0e5709-3c2e-45b0-90bd-b44e457da783 HTTP/1.1 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMGpsOG8Zkih31rQoturuEFIzdUZuyzG1rij7rmZXLeQkC-lSs4lKdv_2PNt8NqvqwselgaLE33VZ9b2_nEeLFiIQ4RQak6NRvUdV0qEXUNtjpAfCaH42iQBM0eUdpkWmjBPYPYeAffgt-8T8lQqvo2InNGqbqpHUe_3iGogYnUzaE Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: af304a0a8dee476fb8a4d07581ffb6a9 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9e0e5709-3c2e-45b0-90bd-b44e457da783'} Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.861106 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] Oct 04 17:53:13.865435 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.869134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Returning 404 to user: Security group 9e0e5709-3c2e-45b0-90bd-b44e457da783 does not exist Oct 04 17:53:13.869134 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-2de0368e-18bf-4820-8bd9-3e35e61bc6ec'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.870830 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ccb3e9d-ef19-4f51-90c1-a749608a485b tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/9e0e5709-3c2e-45b0-90bd-b44e457da783" status: 404 len: 194 microversion: 2.1 time: 0.082304 Oct 04 17:53:13.871881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 662/1273] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/os-security-groups/9e0e5709-3c2e-45b0-90bd-b44e457da783 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.884161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.885097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 6d70836b-a650-4fbd-9a80-4a70b5b4788d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.895600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.896480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.897078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.899787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.900499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.901136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.927570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d HTTP/1.1 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6d70836b-a650-4fbd-9a80-4a70b5b4788d'} Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.930486 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. Oct 04 17:53:13.937936 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.940359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 6d70836b-a650-4fbd-9a80-4a70b5b4788d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.941408 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2bc834b5-85cf-43d4-9746-9566fdd054c9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d" status: 404 len: 111 microversion: 2.1 time: 0.067718 Oct 04 17:53:13.942135 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 663/1274] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/servers/6d70836b-a650-4fbd-9a80-4a70b5b4788d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.952140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Action: 'update', calling method: .version_select at 0x7f634234a0d0>, body: {"security_group": {"name": "tempest-sg-1105279060", "description": "tempest-description-1457295509"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:14.015160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:14.016005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Neutron security group cc302d20-3154-4f18-976e-32479bcbc3e6 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:14.017008 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] HTTP exception thrown: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.017008 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Request method failure captured: Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/os-security-groups/cc302d20-3154-4f18-976e-32479bcbc3e6 HTTP/1.1 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 102 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMGpsOG8Zkih31rQoturuEFIzdUZuyzG1rij7rmZXLeQkC-lSs4lKdv_2PNt8NqvqwselgaLE33VZ9b2_nEeLFiIQ4RQak6NRvUdV0qEXUNtjpAfCaH42iQBM0eUdpkWmjBPYPYeAffgt-8T8lQqvo2InNGqbqpHUe_3iGogYnUzaE Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8258ce1b49504f2db6b8b5e6fc685ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8258ce1b49504f2db6b8b5e6fc685ce4 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-608004916 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: af304a0a8dee476fb8a4d07581ffb6a9 Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-608004916-project Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: {"security_group": {"name": "tempest-sg-1105279060", "description": "tempest-description-1457295509"}} Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'cc302d20-3154-4f18-976e-32479bcbc3e6', 'body': {'security_group': {'name': 'tempest-sg-1105279060', 'description': 'tempest-description-1457295509'}}} Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:14.020362 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] Returning 404 to user: Security group cc302d20-3154-4f18-976e-32479bcbc3e6 does not exist Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-867da4a1-e9bb-43a1-8ab5-a4590bf7660d'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f31df7f5-ff43-4316-ab42-3e6869ab158d tempest-SecurityGroupsNegativeTestJSON-608004916 tempest-SecurityGroupsNegativeTestJSON-608004916-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/cc302d20-3154-4f18-976e-32479bcbc3e6" status: 404 len: 194 microversion: 2.1 time: 0.078742 Oct 04 17:53:14.024948 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 664/1275] 10.222.0.33 () {60 vars in 1290 bytes} [Tue Oct 4 17:53:13 2022] PUT /compute/v2.1/os-security-groups/cc302d20-3154-4f18-976e-32479bcbc3e6 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:14.042378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.048407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.079160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.080471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.081087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.083297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.084137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.084657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.443408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:14.457858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce9c5552-c7af-4ab0-82b2-057990a701fb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1462 microversion: 2.1 time: 0.765808 Oct 04 17:53:14.479718 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 612/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1462 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:14.488433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5f43146-674d-4048-84e3-c984a7ad51bf tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1811 microversion: 2.1 time: 0.461870 Oct 04 17:53:14.489506 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 665/1277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1811 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:14.507270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.507270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.520644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.521544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 43e9e98d-0bac-4176-ab18-b935ccd4d5cb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.538900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.544016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.544951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.547200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.547877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.548723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.551713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.553323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.554206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.554742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.558994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.559665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.626178 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb HTTP/1.1 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '43e9e98d-0bac-4176-ab18-b935ccd4d5cb'} Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:14.631947 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:14.640178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 43e9e98d-0bac-4176-ab18-b935ccd4d5cb could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:14.644693 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d6cf64e8-da4d-452b-8eef-3688f5d78ea4 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb" status: 404 len: 111 microversion: 2.1 time: 0.158552 Oct 04 17:53:14.645993 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 613/1278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/43e9e98d-0bac-4176-ab18-b935ccd4d5cb => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:14.666029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.670593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.687521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.688764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.689423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.690335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.691164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.691765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.303300 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1c154ed1-7c1b-4af6-a3c4-6632b6451903 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1615 microversion: 2.1 time: 0.652381 Oct 04 17:53:15.303898 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 614/1279] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1615 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:15.325839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.329943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.330616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.331328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.332273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.332892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.333481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.375360 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57f20bcc-ffe5-407e-85da-5350d83675d9 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054785 Oct 04 17:53:15.389546 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 615/1280] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:15.396654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b018fc2-2fac-4f28-a86f-483945e9c380 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.436450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b018fc2-2fac-4f28-a86f-483945e9c380 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/bb184c12-004c-408a-806a-a91c0861450f" status: 204 len: 0 microversion: 2.1 time: 0.045519 Oct 04 17:53:15.437779 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 616/1281] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 17:53:15 2022] DELETE /compute/v2.1/os-server-groups/bb184c12-004c-408a-806a-a91c0861450f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:15.445020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:15.445895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.451840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:15.453822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.455108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.455733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.456729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.457368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.457955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.548117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.564046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.572467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:15.574282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.582096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96c90337-3ee1-4675-ad95-6a8ed08e0a7f tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.088129 Oct 04 17:53:15.582931 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 666/1282] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:15.585271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '15a514bb8e3042169f795fd117db8886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06621baf96d541649ee96173cb87f959', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.586324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] flavor_id is None. Assuming migration. {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 17:53:15.586927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 17:53:15.597011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.600659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.624306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.625123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.632472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.633500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.636926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.637480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.725940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:15.904737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-172e227f-f61b-42a5-8834-92b8129184d8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 204 len: 0 microversion: 2.1 time: 0.319349 Oct 04 17:53:15.909954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 667/1283] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:15 2022] DELETE /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:15.920687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f00b225-18f9-43f7-8c04-8430ee96a52c tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.955229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f00b225-18f9-43f7-8c04-8430ee96a52c tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1901294572" status: 202 len: 0 microversion: 2.1 time: 0.043304 Oct 04 17:53:15.955882 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 668/1284] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:53:15 2022] DELETE /compute/v2.1/flavors/1901294572 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:15.960925 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fadf17f8-9cb0-49b4-94e8-822c9c4e8143 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166/action" status: 202 len: 0 microversion: 2.1 time: 0.521543 Oct 04 17:53:15.965704 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 617/1285] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:15 2022] POST /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:15.971654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.971853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3c87f0b-49e1-4e3c-ab50-3bdc11d66b1a tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.972669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.995450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.995838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.996029 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3c87f0b-49e1-4e3c-ab50-3bdc11d66b1a tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.029149 Oct 04 17:53:15.996282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.997004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.003807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.011088 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 618/1286] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.011299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.016917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.017791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.025732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.026508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.027152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.028031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.028645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.029233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.059283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:16.216542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-073dcd28-6566-4b4e-9df5-dcf6821d0e16 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 204 len: 0 microversion: 2.1 time: 0.259281 Oct 04 17:53:16.218489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 669/1287] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:15 2022] DELETE /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:16.228746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2330ca4-82b3-4385-bb8f-679897f84253 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.271144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2330ca4-82b3-4385-bb8f-679897f84253 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1616054151" status: 202 len: 0 microversion: 2.1 time: 0.049882 Oct 04 17:53:16.272298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 670/1288] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 17:53:16 2022] DELETE /compute/v2.1/flavors/1616054151 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:16.279862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.280915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.288235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.288886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.289468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.290432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.291643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.292447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.538506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:16.551533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-11f4f896-694b-48e2-860f-f6e08ded67a7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1471 microversion: 2.1 time: 0.538257 Oct 04 17:53:16.553529 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 619/1289] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.583204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-615d6308-4c37-4667-99f2-e6e4f2ed6b63 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.607820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:16.621568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-feab3067-aa45-490c-bf46-ff81051ae2f9 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 200 len: 1473 microversion: 2.1 time: 0.347657 Oct 04 17:53:16.623150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 671/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 1473 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.630380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.631273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.644338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.646176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.647694 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-615d6308-4c37-4667-99f2-e6e4f2ed6b63 tempest-ServersWithSpecificFlavorTestJSON-1060868678 tempest-ServersWithSpecificFlavorTestJSON-1060868678-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092867 Oct 04 17:53:16.648468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.652771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.653431 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 620/1291] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.654859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.655947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.708557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.710100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.722788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.724067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.725410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.726545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.729962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.730792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.847532 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 HTTP/1.1 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '66cf741e-4631-468a-8c97-56e5677881b8'} Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:16.850148 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5aa7093d-4360-4fd5-babf-5a3752ba2d00 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 404 len: 111 microversion: 2.1 time: 0.160806 Oct 04 17:53:16.856108 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 621/1292] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:16 2022] DELETE /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:16.862953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.863588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 66cf741e-4631-468a-8c97-56e5677881b8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.875691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.876768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.877432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.878707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.879594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.880754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.903325 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 HTTP/1.1 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '66cf741e-4631-468a-8c97-56e5677881b8'} Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.918381 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. Oct 04 17:53:16.922528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.927443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 66cf741e-4631-468a-8c97-56e5677881b8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:16.929734 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d7974f89-d823-434b-b77c-f7dfd9af99a1 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8" status: 404 len: 111 microversion: 2.1 time: 0.071068 Oct 04 17:53:16.933604 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 622/1293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/66cf741e-4631-468a-8c97-56e5677881b8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:16.940537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.941944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.952297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.953727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.954398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.956148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.956940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.958017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.982223 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 HTTP/1.1 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1db13119-c61f-4371-b78b-9957079b8055'} Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:16.985363 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:16.990700 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:16.992249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:16.993128 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2daeeee-9d05-449a-8aca-1fc665bfd3fe tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 404 len: 111 microversion: 2.1 time: 0.057197 Oct 04 17:53:16.996779 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 623/1294] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:16 2022] DELETE /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:53:17.012944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:17.013572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] [instance: 1db13119-c61f-4371-b78b-9957079b8055] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:17.023405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.023904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.024344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.025055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.025509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.025928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.067122 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] HTTP exception thrown: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Request method failure captured: Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 HTTP/1.1 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJAWrP2IXS5r24CsdXiBKHq3e7Lrwj4v6NP-CPIOWjVqi6GuTObi_138vH8-ZrMqF10qhkq4zlQnigLnutVo-CuzHBuUSZY8Si-MSL2ZOHyCwP1jkG26dSCC0biQ8lLSgQ0T3cNx17fSNpq24U0bUYdE7L3ZYwvqJrMrD29dCG9_0k Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/67f8b905a51742a18aea0297cd1f119d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 67f8b905a51742a18aea0297cd1f119d Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419 Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 51f1d73e7fbc42ecafb89f0875d5d70d Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1609044419-project Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1db13119-c61f-4371-b78b-9957079b8055'} Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:17.068851 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. Oct 04 17:53:17.073842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:17.078385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] Returning 404 to user: Instance 1db13119-c61f-4371-b78b-9957079b8055 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:17.079589 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-adc6a9e4-1437-4685-af88-eab1ca6d44a9 tempest-ServersWithSpecificFlavorTestJSON-1609044419 tempest-ServersWithSpecificFlavorTestJSON-1609044419-project] 10.222.0.33 "GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055" status: 404 len: 111 microversion: 2.1 time: 0.081830 Oct 04 17:53:17.082684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 624/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/1db13119-c61f-4371-b78b-9957079b8055 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:17.096446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.140991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.147468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.149673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72cb4016-6a2f-4aa5-9d12-65a0c09c8efa tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.525155 Oct 04 17:53:17.151601 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 672/1296] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:17.577261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:17.577875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:17.591515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.600112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.601468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.602244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.602723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.608000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.090848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "939fd670-719b-4b8a-b28c-5926775eaa0c"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:18.104928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.130302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.130946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.131786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.134459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.135242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.136009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.481952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:18.494362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6371aeaf-4a87-4817-9f08-a90ed5336212 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1471 microversion: 2.1 time: 0.921108 Oct 04 17:53:18.495194 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 673/1297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:17 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1471 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:18.496708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] HTTP exception thrown: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. Oct 04 17:53:18.505533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.506360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.521043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.528188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.528655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.529405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Request method failure captured: Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments/33a2c902-72b3-4d7a-8edf-85701322cc34 HTTP/1.1 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 74 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHKVFkg5it22ENpPnlNQm_jyU3NdCasGrLidzGi_f6GXtSiJVQN6T9pnCUQGnCbaEgoDLbfPBz3bag7Y_ZPRX9E23U1SOcyxsY3UhInL0vqPMZ0fijGTY5vCEx9H5_BgzTea1Yj0tGKSUGR4v_a-t__VTlD5ScG6gcEtCSBoTg9l6yE Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 0b9d5af810b74819ab1dc37413d927e6 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 0b9d5af810b74819ab1dc37413d927e6 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesAdminNegativeTest-199798397-project-admin Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: ad4bb19ac91c4235baf89b469620330a Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesAdminNegativeTest-199798397-project-admin Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: {"volumeAttachment": {"volumeId": "939fd670-719b-4b8a-b28c-5926775eaa0c"}} Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: exception: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': 'a046af5f-6cb0-47e9-809a-06155b0fa81f', 'id': '33a2c902-72b3-4d7a-8edf-85701322cc34', 'body': {'volumeAttachment': {'volumeId': '939fd670-719b-4b8a-b28c-5926775eaa0c'}}} Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. (HTTP 404) (Request-ID: req-f518805d-34a3-47c2-b1d5-b5bb05593df2) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 17:53:18.529696 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. Oct 04 17:53:18.534337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.537211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.537211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.538926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Returning 400 to user: Volume 939fd670-719b-4b8a-b28c-5926775eaa0c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:18.540027 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e030eaf-3703-4303-be40-46b92d46fe08 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments/33a2c902-72b3-4d7a-8edf-85701322cc34" status: 400 len: 107 microversion: 2.1 time: 1.017321 Oct 04 17:53:18.543721 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 625/1298] 10.222.0.33 () {60 vars in 1433 bytes} [Tue Oct 4 17:53:17 2022] PUT /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments/33a2c902-72b3-4d7a-8edf-85701322cc34 => generated 107 bytes in 1021 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:18.550654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.554620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.582821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.583618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.584430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.585349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.585972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.586572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.013983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.022812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab4d8b8c-e8fe-466c-bdc1-e63710cdcd03 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 200 len: 1473 microversion: 2.1 time: 0.526114 Oct 04 17:53:19.025621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 674/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 1473 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:19.153750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.169123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.170721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.177317 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-346c06de-9375-4893-a3fa-026f043a70a9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.630324 Oct 04 17:53:19.190911 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 626/1300] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:19.200197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b52a711f-a8e4-486d-8b2d-a7f96c756146", "device": "/dev/xvdb"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:19.205562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:19.231736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.232289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.232746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.238036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.238036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.238416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.357472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:19.359248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.359749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.360230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.361102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.363017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.363704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.411764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:19.431314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed991d0f-1241-4bb5-9364-9fcd7b86df33 tempest-AZV2TestJSON-475339707 tempest-AZV2TestJSON-475339707-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.386483 Oct 04 17:53:19.438729 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 675/1301] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 17:53:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:19.461818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:19.474043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:19.520912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.522357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.523813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.528964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.530007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.530671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.737614 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-734fbc97-3db1-4364-af1d-72e9dad6df77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553574 Oct 04 17:53:19.741226 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 627/1302] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 17:53:19 2022] POST /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:19.763783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:19.768636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:19.780383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.786857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.787672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.788588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.789926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.797425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.933625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lazy-loading 'services' on Instance uuid a046af5f-6cb0-47e9-809a-06155b0fa81f {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:20.216866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a90b907c-0743-411b-9dc7-bce548883f8c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments/33a2c902-72b3-4d7a-8edf-85701322cc34" status: 202 len: 0 microversion: 2.1 time: 0.773898 Oct 04 17:53:20.233607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 676/1303] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 17:53:19 2022] DELETE /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments/33a2c902-72b3-4d7a-8edf-85701322cc34 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:20.255985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:20.257447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:20.293663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.294801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.298976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.311168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.314474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.315217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.391281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.392192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.393238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.394792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lazy-loading 'fault' on Instance uuid 15198621-aa1c-402a-85f3-95ae075e2d1b {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:20.719389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:20.731294 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dc32b35d-4949-4243-b327-ebe5d988d42f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 200 len: 1308 microversion: 2.1 time: 0.495744 Oct 04 17:53:20.742202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 677/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:20.759000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15198621-aa1c-402a-85f3-95ae075e2d1b", "name": "network-vif-deleted", "tag": "0c39e14a-d57f-4878-92b8-508258ad1564"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:20.792317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:20.795690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.796245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.798257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.813892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1ce7f76d-d3bf-4efc-90ea-43703f3423b2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1471 microversion: 2.1 time: 1.057332 Oct 04 17:53:20.825807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] Creating event network-vif-deleted:0c39e14a-d57f-4878-92b8-508258ad1564 for instance 15198621-aa1c-402a-85f3-95ae075e2d1b on n-h2-831193-17 Oct 04 17:53:20.839300 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 628/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:19 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1471 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:20.852593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0bcc25ba-db7f-4cdb-86aa-8f4bef6cf52a req-e8b81da7-912a-4839-9eb4-467f47aefbf3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100183 Oct 04 17:53:20.853288 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 678/1306] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:20.857442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:20.858481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:20.867784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.868666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.870434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.871372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.872000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.872602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.880014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:20.885004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:20.911089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.911617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.912068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.917806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.918400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.918844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.983232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:21.029178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f24f7ad5-6c10-4395-a039-3fdf087a94b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171807 Oct 04 17:53:21.031197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 679/1307] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:21.048770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96", "name": "network-vif-deleted", "tag": "0a8afbe7-c9be-4a8c-978a-15cf622e982d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:21.073886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.074451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.074900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.105418 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] Creating event network-vif-deleted:0a8afbe7-c9be-4a8c-978a-15cf622e982d for instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 on n-h2-831193-17 Oct 04 17:53:21.126236 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-efc3f3a7-bba3-4937-a65e-533f6f3843e7 req-69fcf0c6-1649-4419-802c-4104daefa4c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092267 Oct 04 17:53:21.130638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 680/1308] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:21.766174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.767617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15198621-aa1c-402a-85f3-95ae075e2d1b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:21.784183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.786303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.787743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.788660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.789816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.790691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.848261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b HTTP/1.1 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '15198621-aa1c-402a-85f3-95ae075e2d1b'} Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:21.850021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 15198621-aa1c-402a-85f3-95ae075e2d1b could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cf25855-1577-435f-a8f2-4b68c1bcd6b2 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b" status: 404 len: 111 microversion: 2.1 time: 0.090048 Oct 04 17:53:21.855849 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 681/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/servers/15198621-aa1c-402a-85f3-95ae075e2d1b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:21.860169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.860797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:21.886480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.886986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.892096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.894053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.895309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.895952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.482781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:22.493144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d25bbc17-36a4-4bfd-b73e-ae0b7383056b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1471 microversion: 2.1 time: 0.638878 Oct 04 17:53:22.494319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 682/1310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1471 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:22.500658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.501871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.510215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.511134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.512064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.512984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.513618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.514324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.532725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 HTTP/1.1 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96'} Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:22.534602 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. Oct 04 17:53:22.539599 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:22.541480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:22.543366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75b5a3a7-7bf3-43b4-a374-4b65fb158e3f tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96" status: 404 len: 111 microversion: 2.1 time: 0.047599 Oct 04 17:53:22.544222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 683/1311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/servers/10915e1c-3a57-4ab7-a5b0-8b6ed81ecb96 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:22.551923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.554970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.562374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.563602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.564213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.565162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.565785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.566375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.587308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:22.601081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:22.608556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:22.613332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7018a189-7f33-4319-82e3-127fe7eb83a8 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.771020 Oct 04 17:53:22.614643 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 629/1312] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:22.623973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d2887d7-2dff-4286-a8ca-d6c0fe0028e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.657353 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c88fc6e-b99f-4322-85f8-00ee83e635b0 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109217 Oct 04 17:53:22.658300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 684/1313] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:22.682543 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d2887d7-2dff-4286-a8ca-d6c0fe0028e8 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d7f3070d-1ab1-4a1b-a749-91436b3a0808" status: 204 len: 0 microversion: 2.1 time: 0.064946 Oct 04 17:53:22.684007 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 630/1314] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 17:53:22 2022] DELETE /compute/v2.1/os-server-groups/d7f3070d-1ab1-4a1b-a749-91436b3a0808 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:22.692464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.693547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.700418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.700914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.701439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.702859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.703423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.703890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.740335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:22.893744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76273da9-7290-4711-b59d-f7851d7fc753 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 204 len: 0 microversion: 2.1 time: 0.205494 Oct 04 17:53:22.894835 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 685/1315] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:22 2022] DELETE /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:53:22.904464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.905375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.912334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.913672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.914272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.915242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.915864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.916998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.321580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.341177 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5dc91f7b-6a72-4170-ba46-1ccd00bc789c tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1472 microversion: 2.1 time: 0.442286 Oct 04 17:53:23.356852 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 631/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.526507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.528454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.538127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.538948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.539837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.541108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.542229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.551290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.646679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.647319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.658413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.662159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.662784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.663734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.664362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.665267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.942479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.958148 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-183e458c-c323-4d24-a9cd-6d1a90b48783 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1471 microversion: 2.1 time: 0.441390 Oct 04 17:53:23.958767 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 686/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1471 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.960520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.968933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.978054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.982060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.984254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.986531 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-050637c6-94d6-4891-a788-04ada75888d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.342063 Oct 04 17:53:24.000546 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 632/1318] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:24.001876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.010490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.011146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.011917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.012392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.012828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.100507 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e1e41b7b-581c-417a-96ce-528654a2cb81 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137421 Oct 04 17:53:24.101494 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 687/1319] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:24.371515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.372304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:24.394789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.400041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.405205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.409724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.419878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.420333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.795290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:24.812380 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3096af2-c7ea-40b9-9feb-ccb986316555 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1472 microversion: 2.1 time: 0.444890 Oct 04 17:53:24.814868 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 633/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:24.988173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.989439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.015719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.016641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.023391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.028433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.032428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.033662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.034939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.036643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.038662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.039974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.042431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.062458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.065898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.075134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.342337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:25.454223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.473811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89cb8197-0acf-43f2-b4cc-44f2c6ff3ea6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.489511 Oct 04 17:53:25.491278 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 688/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:25.507014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.509892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.518786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.519609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.520375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.521299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.522003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.522639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.579225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc882651-84eb-4391-8182-9e288f70a76a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081225 Oct 04 17:53:25.580711 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 689/1322] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:25.782683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.797673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.805915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.807761 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-09f26095-6066-4ee4-b773-0e23805e6bf2 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.795735 Oct 04 17:53:25.810482 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 634/1323] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:53:25.849505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.852559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.861354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.862558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.863306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.864916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.866559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.867395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.125573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3ef557b26f4264a285ba77bceb5a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c329d327a97e476581dc870e8e71a712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:26.136396 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8394c4bf-cac4-4aef-8c23-5924f6e3eae6 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 200 len: 1301 microversion: 2.1 time: 0.303119 Oct 04 17:53:26.145696 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 635/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 1301 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:26.242162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b565ff-d036-43bf-bd95-f99596021e22", "name": "network-vif-deleted", "tag": "36716cdb-dade-4de6-8cf3-29c656891aef"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:26.263126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.263745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.264540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.288422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] Creating event network-vif-deleted:36716cdb-dade-4de6-8cf3-29c656891aef for instance 15b565ff-d036-43bf-bd95-f99596021e22 on n-h1-831193-17 Oct 04 17:53:26.297076 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-776a8380-152e-4741-af7e-d853799353a2 req-86470b3b-1a4a-41d7-a5dc-778622cacf3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.518319 Oct 04 17:53:26.298344 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 690/1325] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:26.506888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.507544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.518262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.520184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.521022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.521768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.522239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.522748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.595648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.599620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.623978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.627771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.628938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.630879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.631983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.632869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.736149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07de0257-1728-4b4c-ade7-b5ded922f193 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147608 Oct 04 17:53:26.742816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 691/1326] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:26.817520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:26.827979 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-403a7432-16e3-4b68-8d93-be07b102cf49 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.325788 Oct 04 17:53:26.831165 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 636/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:26.854802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.855332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.868061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.869732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.870411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.872510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.874046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.874694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.169879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.171247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] [instance: 15b565ff-d036-43bf-bd95-f99596021e22] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:27.197366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.199505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.201243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.204080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.209952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:27.214818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.219725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.226355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:27.239235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:27.249477 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6b0df84-1a15-4d08-80c8-ca51445eeb45 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.400684 Oct 04 17:53:27.263652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:27.268435 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 692/1328] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:27.323238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] HTTP exception thrown: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Request method failure captured: Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 HTTP/1.1 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJaWuFaufzrkulm3SnsKWvr28Ss5UKhERrZa-jy4ASAxRk4mXXqwkATSCtSdS4f4pG6wcYntMD9qBok5PiyeRNUBlTu3epu5c6W2FXmC4XJaGI-2clPOTZr14ShboAbb0oq_ePE87kZhV1_Et-UMLpNr43SQbXzTm5uTiMxhaMDPhs Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c329d327a97e476581dc870e8e71a712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c329d327a97e476581dc870e8e71a712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c329d327a97e476581dc870e8e71a712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c329d327a97e476581dc870e8e71a712 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-564578629 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0b3ef557b26f4264a285ba77bceb5a09 Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersOnMultiNodesTest-564578629-project Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '15b565ff-d036-43bf-bd95-f99596021e22'} Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:27.328213 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. Oct 04 17:53:27.332825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:27.334988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] Returning 404 to user: Instance 15b565ff-d036-43bf-bd95-f99596021e22 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:27.336555 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cf837cd0-6b47-4c2d-b21f-0e36b5d57bf1 tempest-ServersOnMultiNodesTest-564578629 tempest-ServersOnMultiNodesTest-564578629-project] 10.222.0.33 "GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22" status: 404 len: 111 microversion: 2.1 time: 0.170295 Oct 04 17:53:27.340907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 637/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/servers/15b565ff-d036-43bf-bd95-f99596021e22 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:53:27.757029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.760643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:27.789187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.791310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.801368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.802181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.802689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.803172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.856983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.858422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:27.865186 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bac6a0fd-2445-4925-870b-f4c4d10be801 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113615 Oct 04 17:53:27.867357 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 693/1330] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:27.873931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.875704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.876429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.880062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.881138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.883612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.295417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:28.295979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:28.321840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.322355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.323354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.328964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.329495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.329938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.470306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:28.487815 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d281c3c-20c9-4bfd-a479-d2a49fc90382 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.634754 Oct 04 17:53:28.490063 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 638/1331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:28.753556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:28.773025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:28.775116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:28.778130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68d43de3-1f35-4a68-b971-9408e0260229 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.487473 Oct 04 17:53:28.779306 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 694/1332] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:28 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:28.879887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:28.883774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:28.901034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.903970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.905597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.906441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.911726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.912467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.023589 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c94ae33-981e-4da2-a140-3da6ffebe16d tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146321 Oct 04 17:53:29.033909 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 639/1333] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:28 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:29.517915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:29.519195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:29.522451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:29.541155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.542592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.543293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.544302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.545202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.546212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.809776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:29.811610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:29.843628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.844351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:29.844783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.845470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.847007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.847709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.849050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.854739 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b8f475e-7cfa-4db7-b753-3efc6752c2d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.341110 Oct 04 17:53:29.863677 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 695/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:29 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:30.041456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.044679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:30.066568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.067839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.069050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.072312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.074900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.075633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.153264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-460223ac-3607-4ec8-a729-fa9f447f2cc5 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116757 Oct 04 17:53:30.156777 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 696/1335] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:30.890531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.892129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:30.903315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.904633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.909108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.909356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.910122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.910591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.913212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.928176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:30.939893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.941993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.943699 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-27e6e99d-9706-49fc-b187-bc4cbdf5bc29 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.138342 Oct 04 17:53:30.944952 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 640/1336] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:29 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:53:31.247242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:31.259357 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41b7feb1-2d81-4a77-a53d-a4ad989903f6 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.370084 Oct 04 17:53:31.266146 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 697/1337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:31.274666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.280564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:31.288197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.288697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.289330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.290285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.290911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.291541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.335946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de5bca24-84ab-410c-80db-242e62153f35 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067899 Oct 04 17:53:31.349772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 698/1338] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:31 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:31.355476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15790bd5-4678-4040-91de-bbc8d71bf3f8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f634185cc10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW3zZXiyA93cFDeF5k6CzmDVE+ZGrFRAI1UAddfebs/raNoaVDhqtN5ADbtcXuW1X0DCGjhm4j3TOVUv+TqlCSsMBz9/+jbfu5ndOd4Cb5Uizz0A7Eu3t0HxcT6+1yzKA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15790bd5-4678-4040-91de-bbc8d71bf3f8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 257 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW3zZXiyA93cFDeF5k6CzmDVE+ZGrFRAI1UAddfebs/raNoaVDhqtN5ADbtcXuW1X0DCGjhm4j3TOVUv+TqlCSsMBz9/+jbfu5ndOd4Cb5Uizz0A7Eu3t0HxcT6+1yzKA=="}} Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW3zZXiyA93cFDeF5k6CzmDVE+ZGrFRAI1UAddfebs/raNoaVDhqtN5ADbtcXuW1X0DCGjhm4j3TOVUv+TqlCSsMBz9/+jbfu5ndOd4Cb5Uizz0A7Eu3t0HxcT6+1yzKA=='}}} Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 17:53:31.362127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15790bd5-4678-4040-91de-bbc8d71bf3f8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.373199 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-15790bd5-4678-4040-91de-bbc8d71bf3f8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.340353 Oct 04 17:53:31.383457 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 641/1339] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:31.399911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f63418be940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1710308588", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.456802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:31.464808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for user 5d440fbab9a44bbba9ac5bc5c1c1a105 and project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:31.491540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 2167 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1710308588", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:31.511588 n-d-831193-17 devstack@n-api.service[128770]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1710308588', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.514251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.517171 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b0166008-6868-4a8d-b619-381da9d0a512 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.134125 Oct 04 17:53:31.525471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96638a1f-f52c-4d1e-9fd8-510aa2b42f9e tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f634191ed30>, body: {"keypair": {"name": "tempest-keypair-59215817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiM/2YeITWTXrTRX66ZCO4AAfsQTyh1hAbyMxrAiSeNT6chJOa/gDxKfWSGmgi/u26pFwW3GJN+wd+JqfI7+gOFIP5Fkk7fLhJ3rGQJLUpOd1tpTlECTM0k9P71fN5ExA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.527401 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 699/1340] 10.222.0.33 () {60 vars in 1160 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:53:31.555303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-96638a1f-f52c-4d1e-9fd8-510aa2b42f9e tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:31.561243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-96638a1f-f52c-4d1e-9fd8-510aa2b42f9e tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for user 5d440fbab9a44bbba9ac5bc5c1c1a105 and project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:31.597180 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-96638a1f-f52c-4d1e-9fd8-510aa2b42f9e tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.075605 Oct 04 17:53:31.614360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f6341a4faf0>, body: {"keypair": {"name": "tempest-keypair-59215817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj6ecR5hArciqGcm9F4aj4wvNbniuxbPbUODiCAwzstWBH1eygI1PRMQF2iCteETPK+t54xRvIrfeD6ebxMJB75DLZeqzU4zPDcjItgsz7tDI4cuHXjhzzRwNvVUumKgA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.619522 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 642/1341] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:31.637598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:31.643702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for user 5d440fbab9a44bbba9ac5bc5c1c1a105 and project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:31.706764 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] HTTP exception thrown: Key pair 'tempest-keypair-59215817' already exists. Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 271 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: {"keypair": {"name": "tempest-keypair-59215817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj6ecR5hArciqGcm9F4aj4wvNbniuxbPbUODiCAwzstWBH1eygI1PRMQF2iCteETPK+t54xRvIrfeD6ebxMJB75DLZeqzU4zPDcjItgsz7tDI4cuHXjhzzRwNvVUumKgA=="}} Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: exception: Key pair 'tempest-keypair-59215817' already exists. Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-59215817', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj6ecR5hArciqGcm9F4aj4wvNbniuxbPbUODiCAwzstWBH1eygI1PRMQF2iCteETPK+t54xRvIrfeD6ebxMJB75DLZeqzU4zPDcjItgsz7tDI4cuHXjhzzRwNvVUumKgA=='}}} Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5d440fbab9a44bbba9ac5bc5c1c1a105-tempest-keypair-59215817' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 17:53:31.711670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:53:31.715372 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5d440fbab9a44bbba9ac5bc5c1c1a105-tempest-keypair-59215817' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 17, 53, 31, 670887), 'updated_at': None, 'name': 'tempest-keypair-59215817', 'user_id': '5d440fbab9a44bbba9ac5bc5c1c1a105', 'fingerprint': '52:6c:74:e3:5f:74:ae:72:60:74:5f:3e:31:bb:d2:15', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj6ecR5hArciqGcm9F4aj4wvNbniuxbPbUODiCAwzstWBH1eygI1PRMQF2iCteETPK+t54xRvIrfeD6ebxMJB75DLZeqzU4zPDcjItgsz7tDI4cuHXjhzzRwNvVUumKgA==', 'type': 'ssh'}] Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._create() Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-59215817' already exists. Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 17:53:31.722859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-59215817' already exists. Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-59215817' already exists. Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 409 to user: Key pair 'tempest-keypair-59215817' already exists. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.729844 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-deda32c3-6957-41cc-bd22-501a937ab342 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.109447 Oct 04 17:53:31.730821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-12c47595-c3ee-478b-b8be-ac45132e694a tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Calling method '.version_select at 0x7f63418329d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.738661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 700/1342] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:31.797889 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-12c47595-c3ee-478b-b8be-ac45132e694a tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59215817" status: 202 len: 0 microversion: 2.1 time: 0.074944 Oct 04 17:53:31.810146 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 643/1343] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 17:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59215817 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:31.815725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd64ffea-a456-4cd9-845d-2ad3be4910e4 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f6341827820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGto7QVavxKO35/6F7q7yi8zWlZji1KHbHo1UaG7Duggw48XdZKKE+A6it4sjDufgk8TputkWJJFJFf0OUiq/dvi677HZiFgL0yb5SvW5AehyWk+1KZ1cbtRV0hd3hrAPA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd64ffea-a456-4cd9-845d-2ad3be4910e4 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 247 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGto7QVavxKO35/6F7q7yi8zWlZji1KHbHo1UaG7Duggw48XdZKKE+A6it4sjDufgk8TputkWJJFJFf0OUiq/dvi677HZiFgL0yb5SvW5AehyWk+1KZ1cbtRV0hd3hrAPA=="}} Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGto7QVavxKO35/6F7q7yi8zWlZji1KHbHo1UaG7Duggw48XdZKKE+A6it4sjDufgk8TputkWJJFJFf0OUiq/dvi677HZiFgL0yb5SvW5AehyWk+1KZ1cbtRV0hd3hrAPA=='}}} Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:53:31.820351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:53:31.825272 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.826594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd64ffea-a456-4cd9-845d-2ad3be4910e4 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.829232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd64ffea-a456-4cd9-845d-2ad3be4910e4 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018420 Oct 04 17:53:31.837701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 701/1344] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:31.838329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f634191eee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-651703968", "public_key": " "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.859661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:31.866103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for user 5d440fbab9a44bbba9ac5bc5c1c1a105 and project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:31.888959 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 94 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-651703968", "public_key": " "}} Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-651703968', 'public_key': ' '}}} Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.892201 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.896829 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.900044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.901250 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f521faf-6017-430a-88c1-91b790d7b9cc tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067746 Oct 04 17:53:31.917886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0ac46f5-6edd-49d8-87bf-5a728f3971e8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f63418beb80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBog1Aov1X0jC5t5dNteH39r2qAL8cmppyIIAb8GhBQiRrtbWAzMFjkGObjuIVQeCWgz9sg5Czua+RDtiwyIPjm9ktf/cYGfa+uLfJxt9SRY8Pd2SM1Jh5EbTWY3Krq7hw=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.919488 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 644/1345] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0ac46f5-6edd-49d8-87bf-5a728f3971e8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 507 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBog1Aov1X0jC5t5dNteH39r2qAL8cmppyIIAb8GhBQiRrtbWAzMFjkGObjuIVQeCWgz9sg5Czua+RDtiwyIPjm9ktf/cYGfa+uLfJxt9SRY8Pd2SM1Jh5EbTWY3Krq7hw=="}} Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBog1Aov1X0jC5t5dNteH39r2qAL8cmppyIIAb8GhBQiRrtbWAzMFjkGObjuIVQeCWgz9sg5Czua+RDtiwyIPjm9ktf/cYGfa+uLfJxt9SRY8Pd2SM1Jh5EbTWY3Krq7hw=='}}} Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 17:53:31.922561 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 17:53:31.925803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.929474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0ac46f5-6edd-49d8-87bf-5a728f3971e8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:31.930647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0ac46f5-6edd-49d8-87bf-5a728f3971e8 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020693 Oct 04 17:53:31.941391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Action: 'create', calling method: .version_select at 0x7f63417849d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-147878593", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.947154 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 702/1346] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:53:31.960137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:31.970463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Getting quotas for user 5d440fbab9a44bbba9ac5bc5c1c1a105 and project b4992ee20c5248c491aa53c0ebe9bc6c. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:31.992057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.992734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:31.996837 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 117 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-147878593", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-147878593', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 17:53:31.999127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 17:53:32.003390 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.005975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.007169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.007922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.008098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:32.009082 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6528a739-fee1-41b5-988e-f76e36414231 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071781 Oct 04 17:53:32.014134 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 645/1347] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:31 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:53:32.014429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.014429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.014429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.030376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6324e5d7-8676-4b17-b3a2-4a9a9b8edb04 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Calling method '.version_select at 0x7f63419dee50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.055010 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6324e5d7-8676-4b17-b3a2-4a9a9b8edb04 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6324e5d7-8676-4b17-b3a2-4a9a9b8edb04 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Request method failure captured: Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-247494086 HTTP/1.1 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMa494Fmdjt9Yn4SfjvN6IvrhBT4cqdofDtxR1QXbySDOhPzi9wY49w65qPhTeB7UA4QSxhco3W_Quv6PS2b8WKVYgDRfvufMkKDpgjvYPMq_sj_NaOZ65PV92BiWUwyHtKE8hhXjMmUnueVvfJZ15m4-lTLtjFa7lryiWxVSQIL7c Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4992ee20c5248c491aa53c0ebe9bc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b4992ee20c5248c491aa53c0ebe9bc6c Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-605191113 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-605191113-project Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: exception: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'tempest-keypair-non-existent-247494086'} Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.063523 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 Oct 04 17:53:32.067504 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:53:32.072121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6324e5d7-8676-4b17-b3a2-4a9a9b8edb04 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] Returning 404 to user: Keypair tempest-keypair-non-existent-247494086 not found for user 5d440fbab9a44bbba9ac5bc5c1c1a105 {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:32.073434 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6324e5d7-8676-4b17-b3a2-4a9a9b8edb04 tempest-KeyPairsNegativeTestJSON-605191113 tempest-KeyPairsNegativeTestJSON-605191113-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-247494086" status: 404 len: 144 microversion: 2.1 time: 0.047498 Oct 04 17:53:32.078269 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 646/1348] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 17:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-247494086 => generated 144 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:32.290341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.291553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:32.308935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.313686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.327454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.328337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.331012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.332239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.337364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.340867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.347538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.353353 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec72dee9-31e4-47b7-847c-bf53aca89983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.376226 Oct 04 17:53:32.355779 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 703/1349] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:31 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:32.380561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.383571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:32.406204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.409309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.411867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.412841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.413888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.417127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.489493 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ad18a26-4e47-4f5e-8824-65f3b6d80d4a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127765 Oct 04 17:53:32.490051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 704/1350] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:32 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:33.396456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.397424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:33.424072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.427831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.429901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.430702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.431228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.431659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.650165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:33.669537 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d7263519-0110-4955-9807-f62232c181b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 1.377973 Oct 04 17:53:33.671006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 647/1351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:32 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:33.681661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.687479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:33.706877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.707650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.708238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.709117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.710862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.714494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.805501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9429bced-24a7-4b83-842b-500d3f0bf5b3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130412 Oct 04 17:53:33.806172 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 648/1352] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:34.485427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "name": "network-vif-unplugged", "status": "completed", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:34.511855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.512350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.512789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.533029 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] Creating event network-vif-unplugged:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h1-831193-17 Oct 04 17:53:34.552533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4ba30ccf-b06b-495c-95d5-2dedb26694f3 req-443389fb-2e1d-4581-bb49-59541a3d47a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.339897 Oct 04 17:53:34.553465 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 649/1353] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:34.652059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:34.683480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:34.691975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:34.697299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04dc9918-cbcc-4209-85b3-786ac86860b3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.312241 Oct 04 17:53:34.700140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 705/1354] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:34.703022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.703769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.705849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:34.729965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.730544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.731212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.732104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.734224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.734874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.820200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.824515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.842170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.842696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.843175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.843938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.844339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.844768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.952352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2787bb8-7106-4f64-836e-37a9b4e2e30a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138116 Oct 04 17:53:34.957231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 706/1355] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:35.582781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:35.605157 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31517d61-fa31-4249-b759-b28ca1b3b1cb tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.907794 Oct 04 17:53:35.626325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 650/1356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:35.733068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.733733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:35.746106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.749888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.750616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.751634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.753897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.754575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.966077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.968931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:35.994111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.995545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.997227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.005056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.005709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.007917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.115858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40133393-d069-4935-9c16-ed10cb6737e1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153735 Oct 04 17:53:36.117036 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 651/1357] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:35 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:36.528816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:36.540391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:36.545996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:36.550112 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2741f357-c0cf-4d4b-becc-aaca582afa3d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.821641 Oct 04 17:53:36.553153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 707/1358] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:35 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:36.636250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:36.636936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:36.656541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.657459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.660833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.667171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.669119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.670924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.890418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:36.907784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.911385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.913001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.943606 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] Creating event network-changed:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h1-831193-17 Oct 04 17:53:36.957069 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3d050627-5be1-4074-937c-c0bf80e574fd req-fdd68323-8380-45c1-afce-baf13654d7f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070301 Oct 04 17:53:36.958335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 708/1359] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:37.131531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.139835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:37.159829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.160531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.163555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.171220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.176002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.176746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.302686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-647ce9fd-557f-4106-8d97-a60f26b7267a tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167509 Oct 04 17:53:37.304860 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 709/1360] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:53:37 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:53:37.339252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:37.374509 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a9a13cfb-8ac1-4484-8d48-d19ed8f56ec5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.740704 Oct 04 17:53:37.375462 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 652/1361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:36 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:37.579001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.579809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:37.595664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.596362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.596827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.598834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.600523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.601667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.736990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-461039911", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "ab9073e4-316a-4b3b-8a86-29c1425e3a45"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:37.860893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] validate_networks() for [('ab9073e4-316a-4b3b-8a86-29c1425e3a45', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:38.294625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.314203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.316357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.317883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb82173e-5d16-4f50-a265-e07948e5ebec tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.742884 Oct 04 17:53:38.333025 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 710/1362] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:37 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:38.399934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.401713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.414662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.415509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.416121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.417078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.417781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.418439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.766169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.782141 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73f8b51e-454b-4642-ac61-8a681a7ca58f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.383263 Oct 04 17:53:38.782802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 711/1363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:39.352675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:39.353296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:39.367730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.371496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.371912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:39.372665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.385435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.391603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.113503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:40.135281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:40.139441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:40.142747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3913f37f-acdd-44e8-a67f-c895bea5f0ce tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.793412 Oct 04 17:53:40.145265 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 712/1364] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:39 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:53:40.187311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:40.193560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:40.207316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.208305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.208923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.209868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.210499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.211258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.767299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:40.768510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:40.769386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:40.769994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:40.770734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:40.793360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.794147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.797382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.798525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.814114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.820111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.886704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:40.892827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Getting quotas for user 634dc1af05d34e30834cf3f0e0e35815 and project aa0f2a5c031f497983185dcbf3c660c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:40.910048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:40.913178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:41.075075 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc974684-abd8-4203-ad06-8bff77c9ca06 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.344725 Oct 04 17:53:41.077451 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 653/1365] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:53:41.090763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6eb6a3b6-d609-4f79-a2a1-c7959a1837be tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.091797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6eb6a3b6-d609-4f79-a2a1-c7959a1837be tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:41.322851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6eb6a3b6-d609-4f79-a2a1-c7959a1837be tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:41.343415 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6eb6a3b6-d609-4f79-a2a1-c7959a1837be tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1217 microversion: 2.1 time: 0.253104 Oct 04 17:53:41.344986 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 654/1366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:41 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:41.356076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.367817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:41.399534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.400404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.410405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.413428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.425104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.425574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.654718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:42.241603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.258996 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4d0b1b7-e2e0-4309-ab95-595725faa7a5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 2.081813 Oct 04 17:53:42.260361 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 713/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:40 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:42.376935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:42.378133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:42.390229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.394326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:42.401163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.403005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.405469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.406944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.407490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.409007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.410559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07a82804-5d51-4bea-858e-de46df621250 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.063232 Oct 04 17:53:42.411646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.412319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.443423 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 655/1368] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:41 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:42.645652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.656244 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f800bfd9-ae48-4364-8d82-92926f9c4e01 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1269 microversion: 2.1 time: 0.289128 Oct 04 17:53:42.656901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 714/1369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:42 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:43.286970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:43.287754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:43.304054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.314096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.317317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.321073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.323552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.335373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.442124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:43.451510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:43.473652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.474165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.474620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.475404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.475964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.493295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:44.178745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.192266 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8daeacbd-93a4-40e1-bf44-9ecf90f85c22 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.910555 Oct 04 17:53:44.200088 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 656/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:43 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.218881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.221256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:44.238149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:44.238668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:44.239162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:44.246686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:44.247378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:44.248769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:44.255366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.269882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.271981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.273450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17d2e6a4-1c49-475f-9d44-fd521524cb65 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.835631 Oct 04 17:53:44.299733 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 715/1371] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:43 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:44.431191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.448434 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3f58b5f-0258-4c4a-a8ae-f95087a3ddc6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1275 microversion: 2.1 time: 0.242844 Oct 04 17:53:44.448566 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 657/1372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.750298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f487ce76-3380-4efc-b171-a405f80d4159 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Action: 'create', calling method: .version_select at 0x7f6341e4e160>, body: {"keypair": {"name": "tempest-keypair-88530446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIdiKFv7ulBfMceyIK/edpW1fs1xA1c3c+V69yrggRndE9HM/wfYVH3K6YqbIhX08k/NaCtM2CEtf4qffboftQ3XFSl0E37id8octkCJqlepV01MOf+52Tp4LC6poilJA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:44.811458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f487ce76-3380-4efc-b171-a405f80d4159 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for project 283165e2cb5044d5a97f24e500f05c9e. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:44.836404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f487ce76-3380-4efc-b171-a405f80d4159 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for user 5532075507e0480f959d973467f8f834 and project 283165e2cb5044d5a97f24e500f05c9e. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:44.934510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f487ce76-3380-4efc-b171-a405f80d4159 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.582611 Oct 04 17:53:44.941906 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 716/1373] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:45.225353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:45.226779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:45.245982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.246862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.247601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.248637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.249330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.253797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.305950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:45.307968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:45.321547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.326341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.331271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.335660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.336284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.336977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.982391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.033034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.035645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.037092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85b6f20d-ce2f-4d6e-8ef8-8cd3c5d1681d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.735148 Oct 04 17:53:46.037648 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 717/1374] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:45 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:53:46.062435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.087048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:46.094879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:46.108118 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-679d39c9-2793-416e-a4c8-1cb8e0587db7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1476 microversion: 2.1 time: 0.883011 Oct 04 17:53:46.111445 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 658/1375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:45 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1476 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:46.149619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.155330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.157316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.161633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.163361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.167543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.065898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:47.066521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:47.087457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.088792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.089470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.090370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.090994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.091615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.710044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:47.755014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3337a4f-3b1c-46e4-b426-3fea5061b792 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 1.709061 Oct 04 17:53:47.759633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 718/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:46 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:47.947695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:47.994050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:48.045161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:48.050214 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d2784c9-494e-4f3e-9c61-33d19a1b4d1c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.988282 Oct 04 17:53:48.054508 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 659/1377] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:47 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:53:48.096289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:48.100374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:48.122437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.124865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.129480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.130570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.131642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.132584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.370251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:48.370876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:48.382970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.384117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.384570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.385348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.385818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.386254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.451967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:48.802589 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6dd399d-8e86-46ce-8d9e-58afc404c150 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1857 microversion: 2.1 time: 0.744941 Oct 04 17:53:48.804147 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 660/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:48 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1857 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:48.939803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-76762f55-92a9-4a66-a6bd-4b4a9665aaa1 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2101844649", "ram": 512, "vcpus": 1, "disk": 10, "id": 213496138, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:48.980770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-76762f55-92a9-4a66-a6bd-4b4a9665aaa1 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.168978 Oct 04 17:53:48.991765 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 661/1379] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:48 2022] POST /compute/v2.1/flavors => generated 413 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:48.999831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "name": "network-vif-unplugged", "status": "completed", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:49.022052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.022596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.023073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.069100 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Creating event network-vif-unplugged:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h2-831193-17 Oct 04 17:53:49.080407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:53:49.133304 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b2384e3b-595a-4b66-a908-deec03501f0e req-1fc05e1e-27d5-4137-b8ea-5b434da13f51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146449 Oct 04 17:53:49.154855 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 662/1380] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:49.172407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:49.174404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:49.197846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.198286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.198753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.206063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.206570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.207283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.318973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:49.336838 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8ef34ad-e689-456a-9412-2ab2b8411829 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1475 microversion: 2.1 time: 1.572615 Oct 04 17:53:49.338254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 719/1381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:47 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1475 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:49.352428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831193-17", "block_migration": true, "disk_over_commit": false}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:49.357776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:49.370901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.375153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.376098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.378051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.379618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.382254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.442390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lazy-loading 'flavor' on Instance uuid 465a1204-eacd-4237-bba3-2bc47eb35694 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:49.477226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Going to try to live migrate instance to n-h1-831193-17 {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:53:49.854252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:49.865620 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50e01cc9-63fa-4831-8e9e-b482675717ea tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.704797 Oct 04 17:53:49.866625 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 663/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:49 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:49.878012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-358a107d-7263-43e2-89f4-65ccdf7af44e tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:49.963522 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-358a107d-7263-43e2-89f4-65ccdf7af44e tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094197 Oct 04 17:53:49.965649 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 664/1383] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:53:49 2022] POST /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:49.976627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:49.977461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:49.990842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.996226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.997233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.000432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.000926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.001362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.013840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:50.477133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:50.496625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:50.498403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:50.501887 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f49354ed-5c24-49d9-ae81-22b382a7a31c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.533744 Oct 04 17:53:50.502509 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 665/1384] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:49 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:50.840907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6d1c74a4-099a-4fa7-8ace-ac203ef4f6e7 tempest-FlavorsExtraSpecsTestJSON-1139279350 tempest-FlavorsExtraSpecsTestJSON-1139279350-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:50.859142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6d1c74a4-099a-4fa7-8ace-ac203ef4f6e7 tempest-FlavorsExtraSpecsTestJSON-1139279350 tempest-FlavorsExtraSpecsTestJSON-1139279350-project] 10.222.0.33 "GET /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.341954 Oct 04 17:53:50.865862 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 666/1385] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 17:53:50 2022] GET /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:50.867622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:50.872714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:50.873937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:50.912806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.913513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.913849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.917293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.917786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.918241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:51.336165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=20 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:51.981019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:51.995518 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a421f94c-a697-40bd-bfa7-f0cc140bdb9a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1475 microversion: 2.1 time: 1.127773 Oct 04 17:53:51.996709 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 667/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:50 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1475 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:52.013675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b2052624-901b-457d-80f9-b0267fe62afa tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:52.067007 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b2052624-901b-457d-80f9-b0267fe62afa tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066866 Oct 04 17:53:52.077757 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 668/1387] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:53:51 2022] POST /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:52.085504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.086356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:52.105701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.106212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.107455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.108245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.108718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.110791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.682576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:52.695982 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d622312-d7c8-4a37-bc54-a257f7d37f97 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.615443 Oct 04 17:53:52.700097 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 669/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:52.717774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.719494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:52.737096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.739342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.741186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.743556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.745706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.746396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.330291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:53.351085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:53.357660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:53.368405 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bb8ad17e-6bc5-427b-9478-e66c35b41ab1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 0.666671 Oct 04 17:53:53.369446 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 670/1389] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:53.377386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:53.404849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.408121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.408975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.447931 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Creating event network-changed:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h2-831193-17 Oct 04 17:53:53.483099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:53:53.484104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-819811cf-f72b-45d4-889d-c891d17474ec tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/action" status: 202 len: 0 microversion: 2.1 time: 4.143695 Oct 04 17:53:53.484758 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 720/1390] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:49 2022] POST /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/action => generated 0 bytes in 4145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:53.492850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7c72378-8aa4-4691-862e-f94c654537ba tempest-FlavorsExtraSpecsTestJSON-1139279350 tempest-FlavorsExtraSpecsTestJSON-1139279350-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.516497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7c72378-8aa4-4691-862e-f94c654537ba tempest-FlavorsExtraSpecsTestJSON-1139279350 tempest-FlavorsExtraSpecsTestJSON-1139279350-project] 10.222.0.33 "GET /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.027447 Oct 04 17:53:53.521995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 721/1391] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes => generated 22 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:53.528324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a2e146-29e0-442f-badc-16165fc65420", "tag": "ccce6473-ce07-4747-97a4-0fc02b837452"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:53.532428 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f3917298-8132-4ca7-b156-1e3d85f1350d req-9eb7b8fd-5341-420d-9025-2f46cf26e8e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158181 Oct 04 17:53:53.534565 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 671/1392] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:53.553100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.555142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:53.575666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.578787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.580467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.582916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.583875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.584241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.584646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.585045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.587905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.616406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] Creating event network-changed:ccce6473-ce07-4747-97a4-0fc02b837452 for instance 82a2e146-29e0-442f-badc-16165fc65420 on n-h2-831193-17 Oct 04 17:53:53.623990 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4ae068ac-1702-481f-a989-49f9d83ca33e req-74e641d1-2efa-4b33-9335-f94eabfcca7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100008 Oct 04 17:53:53.626153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 722/1393] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:53.646028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.647210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:53.664447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.665264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.665866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.667532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.668204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.668787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.206625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:54.220272 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c396285-1724-43e8-831b-a283eabd7acf tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.588424 Oct 04 17:53:54.220880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 723/1394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:54.230226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-915ba924-fe1e-4404-ad54-3b37f78e3cb8 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:54.265682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-915ba924-fe1e-4404-ad54-3b37f78e3cb8 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043638 Oct 04 17:53:54.266621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 724/1395] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 17:53:54 2022] POST /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:54.271622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.272254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.278548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.279338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.279991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.281174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.281834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.282456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.559956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:54.571082 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-71024d68-8df7-4c36-add3-c12881c28210 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.303285 Oct 04 17:53:54.588664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 725/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:54.594258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-40815711", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "9e5bf58b-6be6-40be-b8b6-f6dca55c8dfc"}, {"uuid": "377c4e75-b62b-45c7-8538-1e9609cfee25"}, {"uuid": "9e5bf58b-6be6-40be-b8b6-f6dca55c8dfc"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:54.677274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] validate_networks() for [('9e5bf58b-6be6-40be-b8b6-f6dca55c8dfc', None, None, None, None, None), ('377c4e75-b62b-45c7-8538-1e9609cfee25', None, None, None, None, None), ('9e5bf58b-6be6-40be-b8b6-f6dca55c8dfc', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:54.789006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:54.804705 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8ec09ae-1cb0-42cb-a654-c20c43025355 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1475 microversion: 2.1 time: 1.264879 Oct 04 17:53:54.805304 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 672/1397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1475 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:54.823724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8932b360-4b36-4195-9479-ff656c8185e3 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.845675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8932b360-4b36-4195-9479-ff656c8185e3 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036604 Oct 04 17:53:54.846838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 673/1398] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:54.860771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.861703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.877248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:54.886849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.887300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.887753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.890116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.891318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.892058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.306238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:56.307512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:56.307915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:56.308477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:56.309184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:56.323555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.324549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.325216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.326702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.327454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.328121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.366104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Getting quotas for project f79ad7bb006342c5a55112a4d04d4ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:56.366711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:56.372392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Getting quotas for user 860db374eab0453d96c6a14e71134b48 and project f79ad7bb006342c5a55112a4d04d4ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:56.380676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:56.382434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:56.383787 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ad1cb21-8974-4312-af73-c3912af390df tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1812 microversion: 2.25 time: 1.535786 Oct 04 17:53:56.384428 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 674/1399] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1812 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:56.387980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:56.390319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1610247445", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9b024a94-a780-4313-9be3-065fd8d420ed"}], "security_groups": [{"name": "tempest-securitygroup--375728319"}], "key_name": "tempest-keypair-88530446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:56.390485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:56.453192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7a77614-f69e-4184-8174-5fdbcbd98953 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863043 Oct 04 17:53:56.454469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 726/1400] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:56.459714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f4cf739-5099-4c2e-968c-bf05707ea9a5 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:56.499872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f4cf739-5099-4c2e-968c-bf05707ea9a5 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043984 Oct 04 17:53:56.505164 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 727/1401] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 17:53:56 2022] PUT /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes => generated 22 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:56.510859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:56.512702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:56.521444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.522726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.523264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.524023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.524503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.526542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.699353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] validate_networks() for [('9b024a94-a780-4313-9be3-065fd8d420ed', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:56.915641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:56.932057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83d9ba36-6171-4ae9-9ec2-360b2c3e8d76 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.425442 Oct 04 17:53:56.952381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 728/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:56 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:56.958995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:56.959921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:57.000737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.001294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.001754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.002503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.003085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.003421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.577516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:57.592244 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ca04fe7-c377-45fc-a3d3-cb095b3236b7 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.638310 Oct 04 17:53:57.593094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 729/1403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:56 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:57.612094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:57.620958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:57.637268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.640330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.640993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.641934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.642587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.643254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.019696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:58.038675 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c9db1ba-901b-474e-a57a-d78f4b72c5d2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1470 microversion: 2.1 time: 0.444170 Oct 04 17:53:58.039299 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 730/1404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:57 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:58.045733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.060041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.066796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.067676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.068292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.069186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.071651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.072295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.202760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:58.218191 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-241cb4a2-764b-48d2-85d7-d470fcf7ecd9 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1207 microversion: 2.1 time: 0.171146 Oct 04 17:53:58.219633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 731/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1207 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:58.224542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-102e7900-b71e-4163-b943-66d51501262a tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.242786 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-102e7900-b71e-4163-b943-66d51501262a tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021840 Oct 04 17:53:58.243420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 732/1406] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/flavors/213496138/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:53:58.258987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for project 283165e2cb5044d5a97f24e500f05c9e. Resources: dict_keys(['metadata_items']) {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:58.272031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for user 5532075507e0480f959d973467f8f834 and project 283165e2cb5044d5a97f24e500f05c9e. Resources: dict_keys(['metadata_items']) {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:58.322513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:58.329706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:58.330353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:58.330876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:58.331432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:58.354938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33364344-73ec-4f8d-b772-cdeb0a208e30 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f634193ac10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-601801322", "description": "tempest-description-561749139"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:58.386513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.387401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.388144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.390069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.392029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.393765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.434114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:58.458650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for project 283165e2cb5044d5a97f24e500f05c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:58.483173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Getting quotas for user 5532075507e0480f959d973467f8f834 and project 283165e2cb5044d5a97f24e500f05c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:58.521062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:58.523889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:58.633526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-175aa704-fb72-44a2-a62d-0587fff52f93 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.247700 Oct 04 17:53:58.634361 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 675/1407] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:58.640177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.646816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.663853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.664700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.665396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.675287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.678368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.679100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.679637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33364344-73ec-4f8d-b772-cdeb0a208e30 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.434919 Oct 04 17:53:58.680275 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 733/1408] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:53:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:58.693850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.694761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.709946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.710539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.710878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.711634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.712094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.712522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.006176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.021047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.023261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.024804 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-436a634c-42a2-43b0-a458-c4805864d1b1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1802 microversion: 2.25 time: 0.388574 Oct 04 17:53:59.027723 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 676/1409] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1802 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:59.034089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:59.034828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.051814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.052664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.054713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.058445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.058969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.059443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.063086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.075056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb15541f-42d9-4aa7-bd33-f8d3faa06b12 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.384989 Oct 04 17:53:59.077332 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 734/1410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:59.095207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67201434-668c-4098-b18b-fc6a89cfd198 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.208997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67201434-668c-4098-b18b-fc6a89cfd198 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.130523 Oct 04 17:53:59.215264 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 735/1411] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 17:53:59 2022] DELETE /compute/v2.1/flavors/213496138/os-extra_specs/hw:numa_nodes => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:53:59.230100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.240117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.270452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.271275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.271731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.275179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.276077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.277021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.492461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-14f8df9b-8c9c-45ca-8004-aef455125978 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "POST /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166/action" status: 202 len: 0 microversion: 2.1 time: 0.463043 Oct 04 17:53:59.496783 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 677/1412] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:59 2022] POST /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:59.506749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a34473ca-c9f1-4740-bbf0-be921d4a9496 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.512536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a34473ca-c9f1-4740-bbf0-be921d4a9496 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.670856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.685627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-deb1b973-2886-48fe-9204-5f7aab991168 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.468615 Oct 04 17:53:59.688630 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 736/1413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:59.693875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bd81b22-d249-49b2-90e0-29da6c524774 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f6341827820>, body: {"security_group_rule": {"parent_group_id": "c730c36d-3e7b-4f1e-a0c7-b797ecb68147", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:59.785049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a34473ca-c9f1-4740-bbf0-be921d4a9496 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.798803 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a34473ca-c9f1-4740-bbf0-be921d4a9496 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1276 microversion: 2.1 time: 0.300239 Oct 04 17:53:59.800102 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 678/1414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:59.810817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-836fd4d2-f104-4cb1-8ad9-18b5a459596b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '.version_select at 0x7f63417ab310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.836788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-836fd4d2-f104-4cb1-8ad9-18b5a459596b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.837558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-836fd4d2-f104-4cb1-8ad9-18b5a459596b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.838229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-836fd4d2-f104-4cb1-8ad9-18b5a459596b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.888221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-836fd4d2-f104-4cb1-8ad9-18b5a459596b tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 4514 microversion: 2.25 time: 0.086632 Oct 04 17:53:59.888913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 679/1415] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/os-migrations => generated 4514 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:59.894497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b3e5669-9786-4f86-9f72-b05a6b20d2bb tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.960469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b3e5669-9786-4f86-9f72-b05a6b20d2bb tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/213496138/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.069550 Oct 04 17:53:59.961123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 680/1416] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 17:53:59 2022] DELETE /compute/v2.1/flavors/213496138/os-extra_specs/hw:cpu_policy => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:53:59.978125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.979328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.988636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.989400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.989998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.990905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.991531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.992110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.119767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0bd81b22-d249-49b2-90e0-29da6c524774 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.429468 Oct 04 17:54:00.122012 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 737/1417] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:53:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:00.137842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.142969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.166112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.171773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.174181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.177795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.179585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.180806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.234566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.252332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-92968ed2-5eb8-4628-8ef9-55bacfd87902 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1269 microversion: 2.1 time: 0.285691 Oct 04 17:54:00.261810 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 681/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1269 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.288981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.299161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.317449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.317959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.318398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.319159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.319628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.320058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.587464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.604125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6aca7c35-4c89-427e-90d4-80d879aece03 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.477084 Oct 04 17:54:00.604775 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 738/1419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.640462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa456441-601b-4962-a310-01fadaf7b6d5 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.651408 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa456441-601b-4962-a310-01fadaf7b6d5 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/213496138/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021705 Oct 04 17:54:00.660136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 739/1420] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/flavors/213496138/os-extra_specs => generated 19 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:54:00.667091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.668330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.678279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.679372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.681068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.682856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.683587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.684183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.962313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.973944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-773ebae5-7ff5-467e-8c3a-e7ed74662f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.312348 Oct 04 17:54:00.974699 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 740/1421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.997119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62044961-94fc-4260-af8f-6bcc4703d463 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f6341c543a0>, body: {"security_group_rule": {"parent_group_id": "c730c36d-3e7b-4f1e-a0c7-b797ecb68147", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:01.080526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-62044961-94fc-4260-af8f-6bcc4703d463 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62044961-94fc-4260-af8f-6bcc4703d463 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 138 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "c730c36d-3e7b-4f1e-a0c7-b797ecb68147", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: exception: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c730c36d-3e7b-4f1e-a0c7-b797ecb68147', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:01.082271 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62044961-94fc-4260-af8f-6bcc4703d463 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: This rule already exists in group c730c36d-3e7b-4f1e-a0c7-b797ecb68147 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62044961-94fc-4260-af8f-6bcc4703d463 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.110121 Oct 04 17:54:01.091557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 741/1422] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:00 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:54:01.095588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30c51fed-689c-435b-b7a1-48b47b198694 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.128734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:01.135612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30c51fed-689c-435b-b7a1-48b47b198694 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/213496138" status: 202 len: 0 microversion: 2.1 time: 0.045832 Oct 04 17:54:01.136585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 742/1423] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 17:54:01 2022] DELETE /compute/v2.1/flavors/213496138 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:01.142137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.142748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.158764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.171130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.171787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.176768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.177436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.177957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.225180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:01.256818 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1718ff7d-2fdb-4c2d-b77b-b5935833ec87 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 2423 microversion: 2.25 time: 0.993114 Oct 04 17:54:01.260419 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 682/1424] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 2423 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:01.282331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.285330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.294259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.295181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.295856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.296811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.297512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.298719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.401514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.410981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd695c66-0f6e-4342-a4bc-c27a2be7e850 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.273020 Oct 04 17:54:01.424442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 743/1425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.434395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-637e8dc8-a18c-457b-b31a-caf49c6e6078 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f6341a66280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.514375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.538319 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3586b5f4-0f48-43c1-95bb-2506444a6a7b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1334 microversion: 2.1 time: 0.275061 Oct 04 17:54:01.565874 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 683/1426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.571100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-063ebbc6-b63c-46af-9ee1-6d49aaae67e8 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.623930 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-063ebbc6-b63c-46af-9ee1-6d49aaae67e8 tempest-FlavorsExtraSpecsTestJSON-15671589 tempest-FlavorsExtraSpecsTestJSON-15671589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056690 Oct 04 17:54:01.624644 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 684/1427] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.639296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.641651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.650408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.651586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.652032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.652764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.653300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.653747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.725974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-637e8dc8-a18c-457b-b31a-caf49c6e6078 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/e2f4e966-a8cf-4804-b84d-8d277577ecfd" status: 202 len: 0 microversion: 2.1 time: 0.300195 Oct 04 17:54:01.731480 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 744/1428] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 17:54:01 2022] DELETE /compute/v2.1/os-security-group-rules/e2f4e966-a8cf-4804-b84d-8d277577ecfd => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:01.741358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.742186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.754590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.755651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.756608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.758210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.759377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.761267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.797696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.812539 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-052fb575-c77c-423c-be9a-260cb5ae132c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1269 microversion: 2.1 time: 0.181701 Oct 04 17:54:01.813927 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 685/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.824116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.825238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.832709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.833901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.834515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.835761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.836384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.843152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.019759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:02.063688 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86960968-142d-4412-86b1-63070542ede5 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 2423 microversion: 2.25 time: 0.330543 Oct 04 17:54:02.067999 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 745/1430] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 2423 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:02.079942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c8ff5e3-7a77-427d-ba00-ee42b4974c9d tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63417f90d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1708794010", "description": "tempest-description-1281947687"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:02.449697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:02.464083 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-884b7537-c67f-4a88-8ddf-5daebcb4c4c2 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.648666 Oct 04 17:54:02.465864 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 686/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:02.491761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:02.499295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:02.502629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c8ff5e3-7a77-427d-ba00-ee42b4974c9d tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.433189 Oct 04 17:54:02.511498 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 746/1432] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:02 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:02.511498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:02.511498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:02.533604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.534184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.534561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.535329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.535793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.536224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.552359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.557109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.560268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:02.561461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.563482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.565970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.566622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.605251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:02.778543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lazy-loading 'services' on Instance uuid 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:02.996951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a754fc9-8ef6-4e54-8f72-454fda204bc7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments/963142d6-1264-44b9-9068-93aa0b8cd298" status: 202 len: 0 microversion: 2.25 time: 0.491982 Oct 04 17:54:02.997794 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 747/1433] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 17:54:02 2022] DELETE /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments/963142d6-1264-44b9-9068-93aa0b8cd298 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:03.014425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:03.017743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:03.035462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.035974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.035974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.038162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.038655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.041922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.350759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:03.363443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e1c51c7-a722-4ce2-a4e1-fb81316c8cc1 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.359401 Oct 04 17:54:03.365752 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 748/1434] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:02 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:03.374025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ca323c6-3545-4a9f-82ca-e670e397f819 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63420214c0>, body: {"security_group_rule": {"parent_group_id": "a746cfc8-e8d9-4e30-aa6f-eaac2c41b26d", "ip_protocol": "tcp", "from_port": 1583915882, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:03.587386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:03.604819 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2d3855e-5c68-430e-8c3f-2b5de41b3e77 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 1.132393 Oct 04 17:54:03.606812 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 687/1435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:02 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:03.615744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:03.617018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:03.649441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.650385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.651297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.653250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.654258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.655014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.831779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:03.843249 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83ba2dd1-c2e0-4029-9fcd-402179fab4f5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1334 microversion: 2.1 time: 0.233673 Oct 04 17:54:03.844176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 688/1436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:03 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1334 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:03.855296 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1ca323c6-3545-4a9f-82ca-e670e397f819 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Invalid port range 1583915882:22. Former value cannot be greater than the later Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ca323c6-3545-4a9f-82ca-e670e397f819 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 146 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "a746cfc8-e8d9-4e30-aa6f-eaac2c41b26d", "ip_protocol": "tcp", "from_port": 1583915882, "to_port": 22}} Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid port range 1583915882:22. Former value cannot be greater than the later Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a746cfc8-e8d9-4e30-aa6f-eaac2c41b26d', 'ip_protocol': 'tcp', 'from_port': 1583915882, 'to_port': 22}}} Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1583915882:22. Former value cannot be greater than the later Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1583915882:22. Former value cannot be greater than the later Oct 04 17:54:03.857720 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1583915882:22. Former value cannot be greater than the later Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ca323c6-3545-4a9f-82ca-e670e397f819 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: Invalid port range 1583915882:22. Former value cannot be greater than the later {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:03.864431 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ca323c6-3545-4a9f-82ca-e670e397f819 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.496340 Oct 04 17:54:03.866375 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 749/1437] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:03 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:54:03.881919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:03.883072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:03.892958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.893761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.894390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.895374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.896293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.897220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.147691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:04.148974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a2e146-29e0-442f-badc-16165fc65420", "name": "network-vif-plugged", "status": "completed", "tag": "ccce6473-ce07-4747-97a4-0fc02b837452"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:04.160236 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cb642eb-200d-4273-a44a-36f85df25468 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1311 microversion: 2.1 time: 0.292471 Oct 04 17:54:04.172347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 750/1438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:03 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1311 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:04.184898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.186661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.187196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.188572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.191423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.201730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.203097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.204002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.205059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.205626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.206191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.233788 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] Creating event network-vif-plugged:ccce6473-ce07-4747-97a4-0fc02b837452 for instance 82a2e146-29e0-442f-badc-16165fc65420 on n-h2-831193-17 Oct 04 17:54:04.244249 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ef3e7387-d761-4615-844c-031b1e42c9f6 req-33600213-6d65-4bad-b4cf-3560e43e469b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388245 Oct 04 17:54:04.246204 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 689/1439] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:04.252979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.264159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.274416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.274965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.276284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9fb03e11-1f13-40bf-b222-d3a54a57f7d4 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093791 Oct 04 17:54:04.276697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.277470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.277935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.278367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.284724 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 751/1440] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:04.290592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fd41041-5fa8-4ab8-b776-1a19b624da19 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63423b99d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1778352347", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:04.297040 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7fd41041-5fa8-4ab8-b776-1a19b624da19 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Security group id should be uuid Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fd41041-5fa8-4ab8-b776-1a19b624da19 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 131 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1778352347", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group id should be uuid Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1778352347', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:04.299246 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:04.303773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 17:54:04.303773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.308952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fd41041-5fa8-4ab8-b776-1a19b624da19 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: Security group id should be uuid {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:04.312004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7fd41041-5fa8-4ab8-b776-1a19b624da19 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.025744 Oct 04 17:54:04.313282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 752/1441] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:04 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:54:04.326770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3352d18d-e729-4c6f-8a41-c3839312c535 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f6341c418b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-210940784", "description": "tempest-description-1652925337"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:04.689165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3352d18d-e729-4c6f-8a41-c3839312c535 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.369793 Oct 04 17:54:04.690113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 753/1442] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:54:04.696022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.696854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.715448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.716508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.717720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.721375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.722099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.722705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.030115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:05.052330 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-786bbb17-5923-4aa3-861b-b06c9ee02696 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.804447 Oct 04 17:54:05.072148 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 690/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:05.082998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.084088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.107398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.110540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.112661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.113715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.115696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.117347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.117513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:05.134383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-150a6946-0d9a-4545-a6db-c0ee1e7dd15b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.438227 Oct 04 17:54:05.135645 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 754/1444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:05.147836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c149f1f4-731b-4612-bf2d-b72283c82db5 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63418beb80>, body: {"security_group_rule": {"parent_group_id": "da5d2537-01bf-4d42-96db-7fe51d51e8c2", "ip_protocol": "tempest-999-1496704063", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:05.280485 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c149f1f4-731b-4612-bf2d-b72283c82db5 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Invalid IP protocol tempest-999-1496704063. Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c149f1f4-731b-4612-bf2d-b72283c82db5 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 157 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "da5d2537-01bf-4d42-96db-7fe51d51e8c2", "ip_protocol": "tempest-999-1496704063", "from_port": 22, "to_port": 22}} Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid IP protocol tempest-999-1496704063. Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'da5d2537-01bf-4d42-96db-7fe51d51e8c2', 'ip_protocol': 'tempest-999-1496704063', 'from_port': 22, 'to_port': 22}}} Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1496704063. Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1496704063. Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:05.282904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1496704063. Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c149f1f4-731b-4612-bf2d-b72283c82db5 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: Invalid IP protocol tempest-999-1496704063. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c149f1f4-731b-4612-bf2d-b72283c82db5 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.148001 Oct 04 17:54:05.292454 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 755/1445] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:05 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:54:05.318014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.324712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.340557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.341326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.343107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.345665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.349506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.354597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.528637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:05.540898 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e4fd8c2-e617-4dc7-b982-32ba7f2d0c14 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.466749 Oct 04 17:54:05.542059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 691/1446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:05.564776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.566409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.593301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.594231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.595369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.596740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.597467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.598946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.665782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:05.673918 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9a6c0dd-a464-4e9c-a1ca-dcc01fd1ca53 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.382771 Oct 04 17:54:05.680135 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 756/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:05.687140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.689806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.710579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.711167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.711632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.712498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.715417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.716085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.782172 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a33150b-f3eb-43dd-8fb5-0aecd0343983 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100470 Oct 04 17:54:05.784411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 757/1448] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:05.792856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37731686-9872-4e7a-9112-ae9345d0415f tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f6341c41f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-362230691", "description": "tempest-description-1497610016"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:06.203534 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37731686-9872-4e7a-9112-ae9345d0415f tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.417268 Oct 04 17:54:06.205095 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 758/1449] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:06.222073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.223540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.227422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.230665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b2fb5fb-e0ed-4e2f-bab5-7a1300036d79 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1332 microversion: 2.1 time: 0.687262 Oct 04 17:54:06.234933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.235473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.236581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.236698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.237407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.237844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.250880 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 692/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1332 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:06.255854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.256483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.287831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.288233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.288671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.289421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.289880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.290536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.355244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:06.381211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:06.460909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.471605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99970a33-db31-4c9e-966a-e2fb66fb73be tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.264971 Oct 04 17:54:06.473294 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 759/1451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:06.479638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4aca3928-8e7f-4f1b-9b1c-35cf61122343 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f6341ee81f0>, body: {"security_group_rule": {"parent_group_id": "f6f22c49-20c9-48cf-9a63-89f207e31db9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:06.554197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4aca3928-8e7f-4f1b-9b1c-35cf61122343 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4aca3928-8e7f-4f1b-9b1c-35cf61122343 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 138 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "f6f22c49-20c9-48cf-9a63-89f207e31db9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f6f22c49-20c9-48cf-9a63-89f207e31db9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:54:06.555784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4aca3928-8e7f-4f1b-9b1c-35cf61122343 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4aca3928-8e7f-4f1b-9b1c-35cf61122343 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.082783 Oct 04 17:54:06.560628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 760/1452] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:06 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:54:06.570094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "name": "network-vif-plugged", "status": "completed", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:06.585384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.586032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.587391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.615344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Creating event network-vif-plugged:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:54:06.624638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:54:06.639798 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2ad8418d-553f-4b02-ad0c-2c89580e0736 req-caa2394e-2cb3-4dce-ac7d-71c34ee2b123 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074614 Oct 04 17:54:06.646836 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 761/1453] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:06.649175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.654083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.655176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.659964 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7c1716dc-c8b1-4620-a6b5-1abda5ce15ce tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1317 microversion: 2.1 time: 0.407743 Oct 04 17:54:06.663155 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 693/1454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:06.663636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.664343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.665143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.666725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.667231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.667670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.672780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-532edb29-7868-49d7-8617-18806458f5cb tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63417ab940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-386641552", "description": "tempest-description-1849342089"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:06.910076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.925124 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c99b2f75-c9a2-4170-bf61-ebae467f66ac tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.276725 Oct 04 17:54:06.936104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 762/1455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:06.943822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.944990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.953748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.954602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.955601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.956587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.957265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.957942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.172876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:07.183697 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27397fd3-5395-49ee-92bd-7fdc441bfa68 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.246126 Oct 04 17:54:07.184279 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 763/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:07.206125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.208479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.217783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.218271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.218971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.220143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.221167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.221881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.261330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b268829-1161-4fc4-ad8c-89a4b836cd9b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058093 Oct 04 17:54:07.265991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 764/1457] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:07.283606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.284616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.307429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.309522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.310496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.311533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.312860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.313714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.515585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:07.525693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41c46a24-7d06-4dde-bc8a-82727a512bb0 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.251944 Oct 04 17:54:07.534621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 765/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:07.551070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.552930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.561412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.562196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.563313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.564285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.564941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.565635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.678919 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-532edb29-7868-49d7-8617-18806458f5cb tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.014605 Oct 04 17:54:07.679912 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 694/1459] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:07.685368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "name": "network-vif-unplugged", "status": "completed", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:07.709865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.719191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.719992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.756265 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Creating event network-vif-unplugged:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:54:07.768609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:54:07.795351 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-aa9ab37b-ffa5-4779-bbab-0e21bbb4cc58 req-b7631c9f-c618-4069-b630-d49c63700eb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107625 Oct 04 17:54:07.796426 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 695/1460] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:07.801809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.803860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.829393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.830238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.830891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.831862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.833121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.833952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.854528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:07.865527 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a9712fe-b0c5-4787-9d19-0700489f1ca7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.327190 Oct 04 17:54:07.866146 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 766/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:07.880692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-616b459b-eb45-4684-86cf-2baa4f4b094b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63419f03a0>, body: {"security_group_rule": {"parent_group_id": "6e84b2af-77c3-45e0-9691-7dd536322f40", "ip_protocol": "tcp", "from_port": 22, "to_port": 1102767429}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:07.937868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-616b459b-eb45-4684-86cf-2baa4f4b094b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-616b459b-eb45-4684-86cf-2baa4f4b094b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 146 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: {"security_group_rule": {"parent_group_id": "6e84b2af-77c3-45e0-9691-7dd536322f40", "ip_protocol": "tcp", "from_port": 22, "to_port": 1102767429}} Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6e84b2af-77c3-45e0-9691-7dd536322f40', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1102767429}}} Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 Oct 04 17:54:07.940686 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-616b459b-eb45-4684-86cf-2baa4f4b094b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 400 to user: Invalid port range 22:1102767429. Valid TCP ports should be between 1-65535 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-616b459b-eb45-4684-86cf-2baa4f4b094b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.074231 Oct 04 17:54:07.951609 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 767/1462] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:07 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:54:08.167062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1987015869", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:08.240845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:08.241470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:08.241840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:08.242336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:08.242817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:08.254073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.254687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.255262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.256095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.256629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.257130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.279158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Getting quotas for project 9e5fd3aea259403b817b1873be55aa81. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:08.284475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Getting quotas for user 131d97155d5044b9859eede1fa7f350f and project 9e5fd3aea259403b817b1873be55aa81. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:08.298644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:08.301566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:08.326007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:08.341502 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca75a926-ec9c-455b-80c6-affeb1f59ca3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1507 microversion: 2.1 time: 0.543253 Oct 04 17:54:08.358314 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 696/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:08.365571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55c38646-562f-47f1-9287-822dc53c425a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.419760 Oct 04 17:54:08.366329 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 768/1464] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:54:08.375603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Action: 'create', calling method: .version_select at 0x7f63416f7c10>, body: {"security_group_rule": {"parent_group_id": "26fc9720-b155-4ba2-8f12-a02fcf795f6a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:08.382658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.383539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:08.403267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.404607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.408313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.410181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.414358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:08.417009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.419143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.486945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG neutronclient.v2_0.client [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist", "detail": ""}} {{(pid=128771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:54:08.487821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.security_group_api [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Neutron security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a not found {{(pid=128771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:54:08.488787 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.488787 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 138 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: {"security_group_rule": {"parent_group_id": "26fc9720-b155-4ba2-8f12-a02fcf795f6a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: exception: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'security_group_rule': {'parent_group_id': '26fc9720-b155-4ba2-8f12-a02fcf795f6a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:54:08.491122 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] Oct 04 17:54:08.497218 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:08.508001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 404 to user: Security group 26fc9720-b155-4ba2-8f12-a02fcf795f6a does not exist Oct 04 17:54:08.508001 n-d-831193-17 devstack@n-api.service[128771]: Neutron server returns request_ids: ['req-43dc0b1c-cd91-4014-9fdd-9573fcf5ad0d'] {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:08.508001 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e9967e2f-e904-42a0-a4fa-bcbfc0436439 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.144415 Oct 04 17:54:08.508001 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 697/1465] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:08 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:08.515204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.516141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:08.524421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.525175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.526041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.527087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.527916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.528581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.725868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:08.749564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5656783e-b439-40ae-b03e-dc365215ed03 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.382126 Oct 04 17:54:08.750953 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 769/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:08.793873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.801004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:08.813871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.814706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.815425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.816433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.817089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.817924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.908207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99397937-66c9-47f5-af96-03511a8be386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130849 Oct 04 17:54:08.923672 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 770/1467] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:08.937096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:08.944974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.083487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.100607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.103153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.114170 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e96d2b5-aa37-4338-8de5-57c8121aeeca tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "PUT /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1359 microversion: 2.75 time: 0.188044 Oct 04 17:54:09.119270 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 771/1468] 10.222.0.33 () {62 vars in 1297 bytes} [Tue Oct 4 17:54:08 2022] PUT /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:09.131373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f6341dcadc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.162687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:54:09.163327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Neutron security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd not found {{(pid=128770) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 17:54:09.163870 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] HTTP exception thrown: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.163870 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Request method failure captured: Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-group-rules/6ec611a3-a135-4ad4-aa95-765d7b622bfd HTTP/1.1 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM0--_Augh8QxyhYiRsj7VP6uq4xqjsT4C_oj2EjXfPg17e64qm1Pv5AgyOCCnzrua1YseQyt-K4UhJvgUTcAhMZMfQWaD0GYxMUJD7l1OLG-idKXnNI2__Z9QhHzniupXld7V5B1lE2puEzM7pGoUkRDZXIaH5aoGIsat2WBXCSvI Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ffc869b8d7244a99f2421f12a67393a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 7ffc869b8d7244a99f2421f12a67393a Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 87d018c7a11347cf971646296ff3930c Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-31503791-project Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6ec611a3-a135-4ad4-aa95-765d7b622bfd'} Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:54:09.165751 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Returning 404 to user: Security group rule 6ec611a3-a135-4ad4-aa95-765d7b622bfd does not exist Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-7916f1ae-a60f-4800-801f-4e12247150e9'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2019a2b-3e4a-4135-bc55-9bbc50cd8bfe tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/6ec611a3-a135-4ad4-aa95-765d7b622bfd" status: 404 len: 199 microversion: 2.1 time: 0.046348 Oct 04 17:54:09.170733 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 772/1469] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 17:54:09 2022] DELETE /compute/v2.1/os-security-group-rules/6ec611a3-a135-4ad4-aa95-765d7b622bfd => generated 199 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:09.173977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.177842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.182432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.182939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.183454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.184200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.184667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.185097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.220615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:09.389022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.398397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e2ee06f6-2197-4689-a6b3-276697aacb11 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.228823 Oct 04 17:54:09.401776 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 773/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:09.413170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.414164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.425989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.426972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.427932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.429034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.429820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.430466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.588778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.599320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-accbc604-8a35-48a0-b91f-88929c079c8a tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.196133 Oct 04 17:54:09.612799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 774/1471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:09.628525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.629513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.637899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.638891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.639618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.640763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.641460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.642122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.791438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:09.805679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.837677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.839801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.846093 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0871db8-4868-4fe4-ae39-b91b754fc7a8 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1411 microversion: 2.75 time: 0.231744 Oct 04 17:54:09.858149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 775/1472] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:09.873858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f51aac4b-6210-46e7-bab5-8662f449f9ed tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f6341a15af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.905678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.920700 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6f79d77-1b7f-48c8-8df3-380434fff20e tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 1.414869 Oct 04 17:54:09.941357 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 698/1473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:09.948457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.949518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.959598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.967820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.968748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.969824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.970520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.971224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.279440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f51aac4b-6210-46e7-bab5-8662f449f9ed tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6e84b2af-77c3-45e0-9691-7dd536322f40" status: 202 len: 0 microversion: 2.1 time: 0.419447 Oct 04 17:54:10.280122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 776/1474] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:09 2022] DELETE /compute/v2.1/os-security-groups/6e84b2af-77c3-45e0-9691-7dd536322f40 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:10.285721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994a2193-4329-42d3-aa61-ba83e2ba994d", "tag": "c8763e48-5ed2-4f63-a6a1-e6b5f698771e"}, {"name": "network-changed", "server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:10.310661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.311583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.312344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.333110 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Creating event network-changed:c8763e48-5ed2-4f63-a6a1-e6b5f698771e for instance 994a2193-4329-42d3-aa61-ba83e2ba994d on n-h1-831193-17 Oct 04 17:54:10.333617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Creating event network-changed:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:54:10.341352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 17:54:10.375712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7527897e-48d7-4e67-9b12-97aeb2a65210 req-504ebb87-efa8-4881-94ca-dff21893ddf4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093968 Oct 04 17:54:10.376876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 777/1475] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:10.385716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.389007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:10.399246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.399874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.400973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.401861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.402407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.402843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.449945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a7d796a-4093-493f-9aaf-58891c7cfa62 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071592 Oct 04 17:54:10.451365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 778/1476] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:10 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:10.456144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e3f23ac-1ba0-43c2-a143-6dbcf05c6ac9 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f6341dca4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.701070 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e3f23ac-1ba0-43c2-a143-6dbcf05c6ac9 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f6f22c49-20c9-48cf-9a63-89f207e31db9" status: 202 len: 0 microversion: 2.1 time: 0.248622 Oct 04 17:54:10.702230 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 779/1477] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:10 2022] DELETE /compute/v2.1/os-security-groups/f6f22c49-20c9-48cf-9a63-89f207e31db9 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:10.707420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.708156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:10.719970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.720871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.721665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.723374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.724110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.724737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.865375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:10.877740 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-623e5785-eb90-4718-9816-cdde3db21b8e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.933991 Oct 04 17:54:10.879346 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 699/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:10.891682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.893946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:10.908453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.915596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.916847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.919163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.924547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.926881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.948895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:10.958441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bcef7417-19ba-47d5-bbd3-ce344be09b4e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.255485 Oct 04 17:54:10.959569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 780/1479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:10 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:10.964650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac5ecb2e-4537-4a6e-a900-a5159504637b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f6341e4e040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.209639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac5ecb2e-4537-4a6e-a900-a5159504637b tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/da5d2537-01bf-4d42-96db-7fe51d51e8c2" status: 202 len: 0 microversion: 2.1 time: 0.248812 Oct 04 17:54:11.210513 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 781/1480] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:10 2022] DELETE /compute/v2.1/os-security-groups/da5d2537-01bf-4d42-96db-7fe51d51e8c2 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:11.218408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.219497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.229821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.230331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.230782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.231554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.232027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.232904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.319278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.328531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.330365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.336322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f08fe97-5f8f-49e8-bcc1-3af7356a6562 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1417 microversion: 2.75 time: 0.124287 Oct 04 17:54:11.337000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 782/1481] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1417 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:11.341950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.342821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.349541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.350306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.350999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.351946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.352594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.353206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.383061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.404113 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5dd43b54-b281-40cc-a900-b3c28830c814 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.512351 Oct 04 17:54:11.404802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 700/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:10 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:11.418040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6d4613-7180-48ce-afe6-3cc92ecd6318"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:11.422700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.429173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.429666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.430097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.430808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.431287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.432279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.493923 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] HTTP exception thrown: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Request method failure captured: Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420/os-volume_attachments/56b4a3fc-1d65-4453-a0c0-a76336753ce9 HTTP/1.1 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 74 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHKVFkg5it22ENpPnlNQm_jyU3NdCasGrLidzGi_f6GXtSiJVQN6T9pnCUQGnCbaEgoDLbfPBz3bag7Y_ZPRX9E23U1SOcyxsY3UhInL0vqPMZ0fijGTY5vCEx9H5_BgzTea1Yj0tGKSUGR4v_a-t__VTlD5ScG6gcEtCSBoTg9l6yE Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 0b9d5af810b74819ab1dc37413d927e6 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b9d5af810b74819ab1dc37413d927e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 0b9d5af810b74819ab1dc37413d927e6 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-199798397 Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesAdminNegativeTest-199798397-project-admin Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: ad4bb19ac91c4235baf89b469620330a Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesAdminNegativeTest-199798397-project-admin Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: {"volumeAttachment": {"volumeId": "6c6d4613-7180-48ce-afe6-3cc92ecd6318"}} Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: exception: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '82a2e146-29e0-442f-badc-16165fc65420', 'id': '56b4a3fc-1d65-4453-a0c0-a76336753ce9', 'body': {'volumeAttachment': {'volumeId': '6c6d4613-7180-48ce-afe6-3cc92ecd6318'}}} Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. (HTTP 404) (Request-ID: req-ab32ad1b-3d94-4152-b282-8af588225ad8) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 17:54:11.497671 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. Oct 04 17:54:11.501770 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:11.510453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] Returning 404 to user: Volume 56b4a3fc-1d65-4453-a0c0-a76336753ce9 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:11.511626 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0b4472b-e884-425a-b9f2-4f6c47feee36 tempest-VolumesAdminNegativeTest-199798397 tempest-VolumesAdminNegativeTest-199798397-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420/os-volume_attachments/56b4a3fc-1d65-4453-a0c0-a76336753ce9" status: 404 len: 109 microversion: 2.1 time: 0.103414 Oct 04 17:54:11.512452 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 701/1483] 10.222.0.33 () {60 vars in 1433 bytes} [Tue Oct 4 17:54:11 2022] PUT /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420/os-volume_attachments/56b4a3fc-1d65-4453-a0c0-a76336753ce9 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:11.526437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d73c541e-7b89-49a4-bb27-d8b66cd4e419 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f63417e7a60>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.539150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.549393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76674edb-9efc-4209-8e0e-3d8434cd1ec5 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.211123 Oct 04 17:54:11.550256 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 783/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:11.556693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.559440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.569474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.570816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.572197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.573225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.573764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.574293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.638304 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f141b599-1776-4a60-aa56-2134db6d2061 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.086456 Oct 04 17:54:11.643171 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 784/1485] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:11.910610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.911217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.918438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.918932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.919561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.920289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.921035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.921191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.094994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.107165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b39c6284-5d3d-4158-90d9-9ba8927b628e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.201692 Oct 04 17:54:12.108418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 785/1486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:12.130596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.131550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.140852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.141403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.141985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.142859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.144198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.146173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.178065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d73c541e-7b89-49a4-bb27-d8b66cd4e419 tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a746cfc8-e8d9-4e30-aa6f-eaac2c41b26d" status: 202 len: 0 microversion: 2.1 time: 0.658937 Oct 04 17:54:12.178645 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 702/1487] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:11 2022] DELETE /compute/v2.1/os-security-groups/a746cfc8-e8d9-4e30-aa6f-eaac2c41b26d => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:12.186854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1a839a0-d128-42c6-93ef-f80572ad718a tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] Calling method '.version_select at 0x7f634173ee50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.313208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.321709 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aed31b2f-f8fc-4c82-9aef-5a2d12fd4cd2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.211267 Oct 04 17:54:12.323353 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 786/1488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:12.371168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.371953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.386114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.386619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.387144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.388330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.388820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.389201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.473218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.483258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.485870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.492587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49e05b40-9213-4255-84d8-0418deaef783 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1417 microversion: 2.75 time: 0.127236 Oct 04 17:54:12.493104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 787/1489] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1417 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:12.499924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.500802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.505077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:12.515995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.516585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.517118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.517910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.519066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.519066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.695214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.706840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0791bcb-4f3e-4092-befa-297bdbb1a952 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.212310 Oct 04 17:54:12.719060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 788/1490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:12.719060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "tag": "d0fc32da-3822-40b7-af07-fe88112cdb28"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:12.729579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.730068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.730503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.750953 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] Creating event network-changed:d0fc32da-3822-40b7-af07-fe88112cdb28 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:12.754329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-01335aae-751a-441c-a8c0-c3a1911f15bd req-381cb70a-b2ea-4e2f-9d48-be00446999b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044867 Oct 04 17:54:12.755984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 789/1491] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:12.762590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.763402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.770306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.771142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.771321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.771980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.772433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.772864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.955526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.964449 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31bc397c-4efa-44b4-99bb-befbc9993f62 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.206872 Oct 04 17:54:12.965245 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 790/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:12.970329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.972616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.978955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.979482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.980076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.980782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.981283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.981710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.041085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f3bad92-1a04-4e79-ab5c-ea1f423c1204 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.074751 Oct 04 17:54:13.047278 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1a839a0-d128-42c6-93ef-f80572ad718a tempest-SecurityGroupRulesNegativeTestJSON-31503791 tempest-SecurityGroupRulesNegativeTestJSON-31503791-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c730c36d-3e7b-4f1e-a0c7-b797ecb68147" status: 202 len: 0 microversion: 2.1 time: 0.858768 Oct 04 17:54:13.047633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 791/1493] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:13.047729 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 703/1494] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:12 2022] DELETE /compute/v2.1/os-security-groups/c730c36d-3e7b-4f1e-a0c7-b797ecb68147 => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:54:13.137861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:13.138590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.170488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.171001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.171472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.172207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.172663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.180164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.350420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:13.352098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.364141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.364638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.367282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.370393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.371060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.371657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.509804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.525925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-286b18e5-ff2d-4f77-8e43-88fb6b8f266a tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.396038 Oct 04 17:54:13.527083 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 792/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:13 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:13.532224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:13.533871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.541670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.542539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.543534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.544578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.545244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.545893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.630478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.634571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.643462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:13.657274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.657933 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-847ccffe-2234-401a-b7ea-7259885249a1 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.308594 Oct 04 17:54:13.658628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 704/1496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:13 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:13.660466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.678354 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b28dd445-5caf-4bb4-a328-4c1a79e30201 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1438 microversion: 2.75 time: 0.149217 Oct 04 17:54:13.680555 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 793/1497] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:13 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:13.729714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:13.735441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.741850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:13.743274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.755338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.761344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.762440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.763839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.764536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.765048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.784811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.791493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.795972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.797299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.798574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.799467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.970711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:13.971175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:13.971770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:13.972156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:13.972943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:14.080815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:14.095235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.095745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.098525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.101849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.102651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.103352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.140176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.162154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce05c4f0-d4da-4ee8-8e11-8a89d5ad9272 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1469 microversion: 2.1 time: 0.426265 Oct 04 17:54:14.163934 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 794/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:13 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:14.188851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:14.205209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:14.237582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.238907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.239425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.240175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.257345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.258823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.877363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.919297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.921338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.927016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.937238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f0ea5ca-8d31-4700-a304-4bb1df75bc8b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.762928 Oct 04 17:54:14.943543 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 795/1499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:14 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:14.943721 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e79ef634-9958-4bc2-9c4e-c3e9c5ba80cb tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "POST /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca/action" status: 202 len: 1495 microversion: 2.75 time: 1.215820 Oct 04 17:54:14.955555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:14.956133 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 705/1500] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:54:13 2022] POST /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca/action => generated 1495 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 17:54:14.956690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:14.971314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.972737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.974501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.975901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.979809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.980865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.985751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:14.986362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:14.996260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.996766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.997213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.997938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.004975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.005694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.732260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:15.740798 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae506ed8-dde4-464f-86c4-cf0beb5cfd74 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.783450 Oct 04 17:54:15.747913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 706/1501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:14 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:15.753512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:15.764186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "tag": "797f072c-f43c-4a75-a64a-73aa96bc81c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:15.769388 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-815c519f-7bd4-4c17-a556-297ff36008b0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.824370 Oct 04 17:54:15.769983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 796/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:14 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:15.774918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:15.779802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:15.786146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.786634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.790779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.793235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.803874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.804585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.805489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.806106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.807304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.818141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:15.821186 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] Creating event network-changed:797f072c-f43c-4a75-a64a-73aa96bc81c0 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:15.842400 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-59cb7206-d4c3-4612-950b-a3ffb092e9a4 req-7561acb4-577d-4c85-b699-b8f29ce40785 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092794 Oct 04 17:54:15.843684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 707/1503] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:15.850788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:15.851794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:15.875348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:15.877162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.877673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.878227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.878821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.879313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.879746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.031161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ef4b272-c01f-46c0-a0f6-be3dd34feb82 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 204 len: 0 microversion: 2.1 time: 0.259599 Oct 04 17:54:16.035089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 797/1504] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:15 2022] DELETE /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:16.050299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:16.053386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:16.069709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.070499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.071115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.071984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.072649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.073236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.275962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.294951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.300060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.310049 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-181a2b23-3c9d-4b27-b331-b5fe3d18fdc4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.464917 Oct 04 17:54:16.310903 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 708/1505] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:15 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:16.339557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:16.340738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:16.347913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.348858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.349499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.350401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.351406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.354832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.573818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.585998 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a166f475-b37d-44b0-85e5-14e8df223127 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1462 microversion: 2.1 time: 0.549487 Oct 04 17:54:16.595098 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 798/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:16 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1462 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:16.601038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:16.604949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:16.617707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.624060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.628797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.631877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.633028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.635811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.356106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:17.365770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e47237e1-481a-4c7f-895e-9b7395d2fbdc tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1513 microversion: 2.1 time: 0.769195 Oct 04 17:54:17.372833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:17.387100 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 799/1507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:16 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1513 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:17.403069 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30dba32a-bac1-452a-9d39-40d16e524e3b tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 1.063925 Oct 04 17:54:17.407443 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 709/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:16 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:17.429314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994a2193-4329-42d3-aa61-ba83e2ba994d", "name": "network-vif-plugged", "status": "completed", "tag": "c8763e48-5ed2-4f63-a6a1-e6b5f698771e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:17.474185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.474993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.475535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.490464 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] Creating event network-vif-plugged:c8763e48-5ed2-4f63-a6a1-e6b5f698771e for instance 994a2193-4329-42d3-aa61-ba83e2ba994d on n-h1-831193-17 Oct 04 17:54:17.496348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4e756f83-b064-4da7-bcf1-4b97a3495662 req-fd8eff27-b959-4ffb-ad0e-7eaae36b0f1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111233 Oct 04 17:54:17.502517 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 800/1509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:17.511746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:17.512657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:17.520438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.521485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.522176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.523172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.524261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.524930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.705200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:17.705900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:17.720172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.720730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.721196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.727352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.729101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.731773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.956121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:17.968023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abfb5365-5ab7-4926-8ed0-bc150f4be536 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.463053 Oct 04 17:54:17.969190 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 801/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:17 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:17.974630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:17.975403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:17.985012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.985625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.986144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:17.987167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:17.987658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:17.988273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.254054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:18.269827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:18.296192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6b9c6351-54f8-4de1-ac00-f53c14df762b tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.325312 Oct 04 17:54:18.297127 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 802/1511] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:17 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:18.311674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:18.312479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.324951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.325463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.325913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.326662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.327173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.327758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.493552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:18.506507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:18.513821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:18.528072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de6abe3c-df43-428a-90cf-bad836c30e11 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.229485 Oct 04 17:54:18.529469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 803/1512] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:18 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:18.541603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "tag": "c56b884c-47ed-496f-b619-b3d4e18388c8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:18.578346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.578830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.579551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.595476 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] Creating event network-changed:c56b884c-47ed-496f-b619-b3d4e18388c8 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:18.610265 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c8563588-d616-4d65-9047-88c213a766d6 req-54ba8b24-4992-40e7-8daf-0affba92de24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076178 Oct 04 17:54:18.610954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 804/1513] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:18.618425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "name": "network-vif-unplugged", "status": "completed", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:18.636658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.637543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.637992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.661732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] Creating event network-vif-unplugged:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h2-831193-17 Oct 04 17:54:18.672367 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-dc9e3ae6-d5c7-4cc8-8e1b-7fd1a9fe596a req-99dc3f44-40fe-4e42-9094-3372e5c8ba07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057255 Oct 04 17:54:18.673206 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 805/1514] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:18.684027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:18.685675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.693279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.694029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.694489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.701316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.702911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.704843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.052876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:19.055975 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a8c39fa-57db-474b-b722-5065a3d8ef81 tempest-MigrationsAdminTest-2057907966 tempest-MigrationsAdminTest-2057907966-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1615 microversion: 2.1 time: 1.646909 Oct 04 17:54:19.056733 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 710/1515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:17 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1615 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:19.061275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:19.061894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:19.067999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.068495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.068942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.069660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.070117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.070551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.091603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef1fc2ea-12b3-48cd-b9a7-9b670b094eed tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.416167 Oct 04 17:54:19.105370 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 806/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:18 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:19.119925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:19.121413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:19.123569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:19.131780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.132442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.133221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.133892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.134379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.135073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.403873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:19.412632 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68ae1591-8750-4d04-9130-80350d09077a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.306025 Oct 04 17:54:19.413231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 807/1517] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:19 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:19.419082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:19.419740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:19.427949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.428651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.429103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.429896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.430402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.430843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.470435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:19.616665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f6eba5b-34d2-448a-bce6-0d9b252c93f8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 204 len: 0 microversion: 2.1 time: 0.201371 Oct 04 17:54:19.617535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:19.621032 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 808/1518] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:19 2022] DELETE /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:19.644533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:19.645404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:19.650209 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f725cf71-f09a-48d4-9c35-641559dd5da6 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1513 microversion: 2.1 time: 0.590991 Oct 04 17:54:19.674293 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 711/1519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:19 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1513 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:19.677388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.681550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.682039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.691010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.694099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.694419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.701897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:19.705477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:19.723671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.724454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.725710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.726886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:19.727897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:19.729182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:19.792377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:19.987585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.005301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.007297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.016627 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d164aaf-9e7a-4f1f-8dac-579cb1358f4d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.344790 Oct 04 17:54:20.017743 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 712/1520] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:19 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:20.023207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.024515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:20.024515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:20.032665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.033644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.034318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.035446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.035981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-82171e12-8b1f-48db-90d4-bc3ceb4a0ead tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.407567 Oct 04 17:54:20.036405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.039092 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 809/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:19 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:20.039709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.129281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:20.130072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:20.137844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.138569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.139120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.139915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.140380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.140811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.334818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.352123 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b63ddd42-032e-4612-8256-c2a218b404f1 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1401 microversion: 2.1 time: 0.226200 Oct 04 17:54:20.353170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 810/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:20 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1401 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:20.375213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.396526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d56c036-38f7-451c-ab54-6c0651db5580 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1468 microversion: 2.1 time: 0.367103 Oct 04 17:54:20.397300 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 713/1523] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:20 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:20.442175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:20.442175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:20.456293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.456846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.457287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.458312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.458950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.459484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.672904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.684245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:20.684463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-71214eab-80ea-4430-80bc-d650c70283fa tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.249145 Oct 04 17:54:20.685316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 811/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:20 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:20.685783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:20.693761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.694351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.694804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.695565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.696012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.696435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.739876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:20.743435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.744472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.744955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.745797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lazy-loading 'fault' on Instance uuid 82a2e146-29e0-442f-badc-16165fc65420 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:20.783324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}, {"server_uuid": "82a2e146-29e0-442f-badc-16165fc65420", "name": "network-vif-deleted", "tag": "ccce6473-ce07-4747-97a4-0fc02b837452"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:20.798497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.798828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.799294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.820706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Creating event network-changed:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h2-831193-17 Oct 04 17:54:20.820706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] Creating event network-vif-deleted:ccce6473-ce07-4747-97a4-0fc02b837452 for instance 82a2e146-29e0-442f-badc-16165fc65420 on n-h2-831193-17 Oct 04 17:54:20.821431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:20.841751 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-91aa14d5-14c0-490e-b533-d3080db48930 req-6604bd39-18a1-4191-8bf6-a962a0f2c35d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063177 Oct 04 17:54:20.843512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 812/1525] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:54:20.849789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6125c610-183e-49dc-88ce-3b900aa19953 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 200 len: 1307 microversion: 2.1 time: 0.171559 Oct 04 17:54:20.869754 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 714/1526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:20 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:21.049597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:21.050314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:21.061095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:21.061666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.062171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.062521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:21.062642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.065472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.065964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.066406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.072779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.074347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.074959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.075944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.076417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.078469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.194934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.209988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.212330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.221551 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41ad1349-39df-429c-98be-f1d3101cbd95 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.177872 Oct 04 17:54:21.223226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 813/1527] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:21 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:21.375996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:21.383174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:21.391281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.392732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.393359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.396684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.397399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.398125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.435261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.458990 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c90aa45f-57b2-4673-bb0c-e811ec649687 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.402370 Oct 04 17:54:21.464475 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 715/1528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:21 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:21.472561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:21.473574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:21.483667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.484616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.485487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.486766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.488006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.489179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.969121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.977266 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b797cd58-0ef4-45ac-adf7-d50e965383de tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1589 microversion: 2.1 time: 0.605136 Oct 04 17:54:21.987805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 814/1529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:21 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1589 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:21.993245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.002874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.020883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.021397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.021849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.022579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.027121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.028133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.058708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.068691 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-43f544f3-23a7-4628-b8be-0548b899fbc8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1468 microversion: 2.1 time: 0.602664 Oct 04 17:54:22.087824 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 716/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:21 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1468 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:22.095289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.095926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: 82a2e146-29e0-442f-badc-16165fc65420] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.111483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.112000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.112454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.113181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.113657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.114094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.153240 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] HTTP exception thrown: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Request method failure captured: Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 HTTP/1.1 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJ-fMgehQwggaTSADmtyTgJt_EZfZpzat0izTlTpIn0K3f0vIkZpnivYIbFwpaS6QSAzxWK_1B5cbzDi8rtVg0jCrj5y-aM2j2OaT9LNpgHgmVdyLzt2hOYNtU2ZZZvjcXL2HfuvK9U0wGrSsEzOqbujq65raT-t6EdwBQWI4k2NTM Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: aa0f2a5c031f497983185dcbf3c660c7 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: aa0f2a5c031f497983185dcbf3c660c7 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesAdminNegativeTest-441142830-project Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 634dc1af05d34e30834cf3f0e0e35815 Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesAdminNegativeTest-441142830-project Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '82a2e146-29e0-442f-badc-16165fc65420'} Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:22.156401 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. Oct 04 17:54:22.161766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:22.173906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Returning 404 to user: Instance 82a2e146-29e0-442f-badc-16165fc65420 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:22.174980 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78f51881-a0b4-460b-8bde-52fa761e946b tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420" status: 404 len: 111 microversion: 2.1 time: 0.086090 Oct 04 17:54:22.176274 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 717/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/82a2e146-29e0-442f-badc-16165fc65420 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:22.182657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.183559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.191350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.192090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.192704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.193783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.194466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.195135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.383875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.394883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39d8d5f8-2ad0-4c7f-8dab-ac4407d92e40 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.412652 Oct 04 17:54:22.398700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 815/1532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:21 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:22.412121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.413195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.421740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.422573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.423218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.425060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.425845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.426453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.477763 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c55ebe0d-1921-410d-9b05-06bc1ea4652d tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.300107 Oct 04 17:54:22.480692 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 718/1533] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d/os-interface => generated 285 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:22.498011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.498852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.510818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.516127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.520024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.521028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.526393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.527111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.748112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.761450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.769941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.786814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc1f6298-185e-45f9-840f-7f341c516ad6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.385381 Oct 04 17:54:22.807075 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 816/1534] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:22.896212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0318a-9c69-4866-b576-47ceaa5c6166", "name": "network-vif-deleted", "tag": "60511808-42a1-4a6c-b8e4-b3f310c1161a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:22.928597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.933442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.940587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.972192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] Creating event network-vif-deleted:60511808-42a1-4a6c-b8e4-b3f310c1161a for instance 37e0318a-9c69-4866-b576-47ceaa5c6166 on n-h1-831193-17 Oct 04 17:54:22.993558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-314be40b-6c5b-46af-b5ca-37fc009d36fd req-fb6ac055-65e7-4cb5-9f63-265f40ef67e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101698 Oct 04 17:54:22.995589 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 817/1535] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:54:23.103066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:23.104717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:23.118553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.119520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.121785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.129233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.130267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.131389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.324194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:23.333663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ce7cf7b-eea8-4649-9654-4c8c3b693bdd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.841445 Oct 04 17:54:23.339802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 719/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:23.413660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:23.424044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:23.425006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:23.438522 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-218e1445-59f3-457a-9784-716995324a1d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 200 len: 1426 microversion: 2.1 time: 0.336804 Oct 04 17:54:23.441226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.441798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.442110 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 818/1537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:23 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 1426 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:23.442384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.444493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.446110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.446926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.834875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:23.836033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:23.845963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.846864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.847589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.848596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:23.849309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:23.850195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.976020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:23.986252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:23.987976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:24.000788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-81a887a2-0844-4557-8990-266e489949d5 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.178338 Oct 04 17:54:24.002909 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 819/1538] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:23 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:24.317288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:24.355224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-56f668de-c045-4ca4-b9c7-6f05a52ab070 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.928868 Oct 04 17:54:24.355882 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 720/1539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:23 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:24.377965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.379083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.393216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.393715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.394162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.394885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.395371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.395798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.467882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.468680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 37e0318a-9c69-4866-b576-47ceaa5c6166] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.493744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.496057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.500166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.501179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.502888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.505467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.547844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] HTTP exception thrown: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Request method failure captured: Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 HTTP/1.1 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHH8EvpTJiX9eV_b5gftSn3jvDM2KN0mWYxon2iZ0_3JFow-eeNQ6Sb6uNdpNp0AxitndF0jwl8T_BCxzHc6vazlXJ7qtedky83fuvBTH2pGp-N06tggkNV3Gbz5ByN3S9ZTAYeQFc_Zl58QSTlVoVeZe3D_edmU4U2OEaZGAVAY-wo Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0d0d5ddca82c4d8c83e182837bec0c27 Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '37e0318a-9c69-4866-b576-47ceaa5c6166'} Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:24.551857 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. Oct 04 17:54:24.556915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:24.558772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Returning 404 to user: Instance 37e0318a-9c69-4866-b576-47ceaa5c6166 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:24.561669 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-713a11b0-25d6-4fac-9594-fd39220540b4 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166" status: 404 len: 111 microversion: 2.1 time: 0.100062 Oct 04 17:54:24.565523 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 721/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:24 2022] GET /compute/v2.1/servers/37e0318a-9c69-4866-b576-47ceaa5c6166 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:54:24.590078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.594711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.639982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.642355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.643053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.643893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.644375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.644811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.690920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:24.716899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:24.726187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-178e7364-c18f-4d5b-b34b-fb951f5fbb02 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.353421 Oct 04 17:54:24.737091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 820/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:24 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:24.841315 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c28d1db0-3ac1-405d-850b-1b4dc6d1c78d tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "DELETE /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 204 len: 0 microversion: 2.1 time: 0.264504 Oct 04 17:54:24.845537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 722/1542] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:24 2022] DELETE /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:54:24.851297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.852013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.869243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.870196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.870948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.872056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.872771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.873278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.034314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:25.035069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:25.050709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.051278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.051724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.056226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.056226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.056226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.077463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.087473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e15c6dc-71ef-43fe-a6af-7af5ae50c982 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1535 microversion: 2.1 time: 0.240297 Oct 04 17:54:25.088737 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 821/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:24 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1535 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:25.265128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.275331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.276795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.296995 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9760883d-3a29-4a68-a590-a47cbf36f493 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.267049 Oct 04 17:54:25.298802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 723/1544] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:25 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:25.378887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:25.379872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:25.404038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.406184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.406656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.409972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.410504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.410953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.730562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:25.731382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:25.747821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.748370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.748825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.754927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:25.756815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:25.757272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.782340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:25.948372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.964026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-642151e3-72fe-44b7-8e1d-4c79c240d459 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.589005 Oct 04 17:54:25.971068 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 822/1545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:25 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:25.999198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:26.000297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:26.022351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.022876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.024915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.025772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.027824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.029578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.457615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:26.470356 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-857f7934-7905-43de-800b-058e4f1fb939 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1589 microversion: 2.1 time: 0.743523 Oct 04 17:54:26.475380 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 724/1546] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:25 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1589 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:26.487380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994a2193-4329-42d3-aa61-ba83e2ba994d", "tag": "c8763e48-5ed2-4f63-a6a1-e6b5f698771e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:26.533100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.534097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.534729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.564485 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] Creating event network-changed:c8763e48-5ed2-4f63-a6a1-e6b5f698771e for instance 994a2193-4329-42d3-aa61-ba83e2ba994d on n-h1-831193-17 Oct 04 17:54:26.571989 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2ca6a480-ce22-4870-ac80-ae369e3456ed req-5db0d863-5f3f-4d26-b0cb-f32d8ee1b9f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095011 Oct 04 17:54:26.576081 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 725/1547] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:26.593267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:26.597456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:26.613780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.616897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.617744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.621599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.625836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.628075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.222401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:27.235987 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b150ed8-f177-4ff5-b708-89c3427214cc tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1535 microversion: 2.1 time: 0.655111 Oct 04 17:54:27.252099 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 726/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:26 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1535 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:27.265397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:27.266044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:27.283621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.284406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.285111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.287492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.289893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.290548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.326396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:27.336004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d31cbfb-be87-4c3a-aab4-5d120f4d95c8 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 1.360128 Oct 04 17:54:27.336591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 823/1549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:25 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:27.348334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:27.349155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:27.358433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.363132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.364605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.365551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.366205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.370190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.429583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:27.441350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:27.447338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:27.465491 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55459c07-66e9-401a-bb63-294a5d99d868 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.205601 Oct 04 17:54:27.468732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 727/1550] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:27 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:28.129064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:28.129915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:28.156566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.160462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.162354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.164365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.168528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.170942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.298718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:28.483356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:28.501421 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52deb252-b57c-453e-b0b2-0038db600881 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 1.156724 Oct 04 17:54:28.503641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 824/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:27 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:28.517654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:28.519626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:28.554378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.559396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.563258 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a1b1137-42c8-4491-aaac-025b2574737c tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 204 len: 0 microversion: 2.1 time: 0.438313 Oct 04 17:54:28.563815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.565474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.566154 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 728/1552] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:28 2022] DELETE /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:28.568482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.569140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.573181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:28.573891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:28.590152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.590788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.591214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.591944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.592414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.592839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.632012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.633204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.634130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.634923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lazy-loading 'fault' on Instance uuid 520a7b7c-9b29-442c-935c-fac291d15414 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:28.799678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:28.816072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-faed72cd-9cfb-47e0-9b3f-12b2bd156888 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1369 microversion: 2.1 time: 0.305889 Oct 04 17:54:28.832691 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 825/1553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:28 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:28.850875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a7b7c-9b29-442c-935c-fac291d15414", "name": "network-vif-deleted", "tag": "6a6155f5-e496-4625-96b0-9a97658b6e0a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:28.870987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:28.875651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.876365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.877154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.920939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:28.932397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae5df3df-70b2-4cc9-8ccb-f564158b3d5c tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.364835 Oct 04 17:54:28.937890 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 729/1554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:28 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:28.952057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] Creating event network-vif-deleted:6a6155f5-e496-4625-96b0-9a97658b6e0a for instance 520a7b7c-9b29-442c-935c-fac291d15414 on n-h1-831193-17 Oct 04 17:54:28.961010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:28.962483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:28.970834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.971673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.972309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.973222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.973854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.974453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.975269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c37198b3-f096-4e4f-b311-e388961cec4e req-91b62a68-c412-4ce3-95f1-3a083b7cab3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140243 Oct 04 17:54:28.981791 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 826/1555] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:29.013471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:29.015216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:29.030160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.030673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.031157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.031891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.033187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.033639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.112479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:29.113365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:29.124217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:29.127190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:29.146107 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-77cc7da8-f334-4360-9b3f-5e3cd8b6f29c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.193599 Oct 04 17:54:29.149265 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 730/1556] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:28 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:29.335016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:29.349048 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88f66ee6-84a1-46ea-8961-d8ee3ac42170 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1682 microversion: 2.1 time: 0.365042 Oct 04 17:54:29.349923 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 827/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:28 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1682 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:29.530278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:29.531704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:29.542540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.547944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.548800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.550009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.550759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.551508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.843727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:29.845022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:29.864860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.865376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.865823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.866540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.867479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.868076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.000459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.002378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.003009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.003811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lazy-loading 'fault' on Instance uuid 520a7b7c-9b29-442c-935c-fac291d15414 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:30.005495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.017473 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-984a9a99-e57b-4365-8f8a-584eb21766e6 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.491266 Oct 04 17:54:30.031428 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 731/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:29 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:30.036402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:30.037300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:30.044876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.045619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.046261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.047238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.047862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.048468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.166587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.177095 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f920694-2ad9-4ede-aa6b-6cadfbd541e8 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 200 len: 1369 microversion: 2.1 time: 0.337256 Oct 04 17:54:30.194342 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 828/1559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:29 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:30.200355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:30.201274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:30.209695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.210419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.211302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.212618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.213587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.214421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.342487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.358833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.360700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.376227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b208ac55-c3cb-410e-a9a8-f7bd3bf314c6 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.180428 Oct 04 17:54:30.387064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 829/1560] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:30 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:30.397546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:30.402230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:30.425643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.426153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.426602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.431855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.432774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.433635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.834104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.844533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-14cc48c0-1dd8-4098-8383-28c4232a5238 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.811905 Oct 04 17:54:30.849727 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 732/1561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:30 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:30.878750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.894839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6490b760-ec53-4489-badb-ec3fb4ef3073 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1682 microversion: 2.1 time: 0.506788 Oct 04 17:54:30.895637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 830/1562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:30 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1682 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:31.041572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.042379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:31.052506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.055229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.055844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.058865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.059969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.060421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.201329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.201955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 520a7b7c-9b29-442c-935c-fac291d15414] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:31.220609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.221224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.221678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.222458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.222982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.223760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.266025 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] HTTP exception thrown: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Request method failure captured: Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 HTTP/1.1 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH8EvpTJiX9eV_b5gftSn3jvDM2KN0mWYxon2iZ0_3JFow-eeNQ6Sb6uNdpNp0AxitndF0jwl8T_BCxzHc6vazlXJ7qtedky83fuvBTH2pGp-N06tggkNV3Gbz5ByN3S9ZTAYeQFc_Zl58QSTlVoVeZe3D_edmU4U2OEaZGAVAY-wo Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0d0d5ddca82c4d8c83e182837bec0c27 Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '520a7b7c-9b29-442c-935c-fac291d15414'} Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:31.273266 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. Oct 04 17:54:31.280091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:31.283955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Returning 404 to user: Instance 520a7b7c-9b29-442c-935c-fac291d15414 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:31.285263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-455c14cc-42dc-4257-a700-36fe1974acb5 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414" status: 404 len: 111 microversion: 2.1 time: 0.088095 Oct 04 17:54:31.286899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 831/1563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:31 2022] GET /compute/v2.1/servers/520a7b7c-9b29-442c-935c-fac291d15414 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:31.296148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5464a228-799c-49d7-85e3-d5342767d47f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '.version_select at 0x7f63416ceca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.346514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5464a228-799c-49d7-85e3-d5342767d47f tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715076753" status: 202 len: 0 microversion: 2.1 time: 0.055451 Oct 04 17:54:31.351161 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 832/1564] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 17:54:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715076753 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:54:31.410422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.411351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:31.422176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.423198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.428164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.429335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.430049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.430773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.853145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:31.876861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:31.888745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:31.904225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:31.923224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-99c386e8-8f19-4022-8ae3-4bfba90e6171 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.883252 Oct 04 17:54:31.937327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-792bfb9e-40b3-4365-bf66-7f6bd920b191 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.531151 Oct 04 17:54:31.938597 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 833/1565] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:31 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:31.945056 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 733/1566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:31 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:31.961901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.963735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:31.969389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:31.971528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:31.971900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.977640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.984453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.984845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.985329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.985771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.994409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:31.996578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:31.998959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:31.999868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:32.000436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:32.002597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:32.293113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:32.305757 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b707f01b-bf52-45a5-9a29-f8d8c95bebfd tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1615 microversion: 2.1 time: 0.347759 Oct 04 17:54:32.307825 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 734/1567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:31 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1615 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:32.338626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-plugged", "status": "completed", "tag": "797f072c-f43c-4a75-a64a-73aa96bc81c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:32.385580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:32.385580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:32.386086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:32.429570 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] Creating event network-vif-plugged:797f072c-f43c-4a75-a64a-73aa96bc81c0 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:32.442736 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e3c434dd-af68-4b58-a97d-67ae3f27b049 req-0ad14246-fd3c-4d0b-923f-0f37af1fa6f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121280 Oct 04 17:54:32.444268 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 735/1568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:32.673320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:32.688140 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a41963b9-cd39-4bb2-a86b-ff08a5d18f52 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.748113 Oct 04 17:54:32.710299 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 834/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:31 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:32.980235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:32.983235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:32.987860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:32.999194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:33.017623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.018107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.018757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.019871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.020532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.022494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.023449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.023861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.026787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.030406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.033462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.039990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.266489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:33.280717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:33.282650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:33.306352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-856eb46e-531a-4fc5-80f5-37748d64f9c7 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.340508 Oct 04 17:54:33.328371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 835/1570] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:32 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:33.328371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a046af5f-6cb0-47e9-809a-06155b0fa81f", "name": "network-vif-deleted", "tag": "323e8924-c463-460c-b397-a3273113074b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:33.374942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.378257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.386356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.432573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] Creating event network-vif-deleted:323e8924-c463-460c-b397-a3273113074b for instance a046af5f-6cb0-47e9-809a-06155b0fa81f on n-h1-831193-17 Oct 04 17:54:33.449393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-02475ade-fffd-43c4-a68b-bd6d659dc4bf req-cf7bef95-2eee-4d62-bc93-51d437a8a1d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126496 Oct 04 17:54:33.458488 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 836/1571] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:33.474493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:33.475372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:33.513110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.514614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.515985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.523217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.524588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.526141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.611090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.621588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.622603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.623532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lazy-loading 'fault' on Instance uuid a046af5f-6cb0-47e9-809a-06155b0fa81f {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:33.732866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634dc1af05d34e30834cf3f0e0e35815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0f2a5c031f497983185dcbf3c660c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:33.756573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27eefeb8-f8df-4840-b8a9-2882c6b07b19 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 200 len: 1332 microversion: 2.1 time: 0.294769 Oct 04 17:54:33.761307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 837/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:33 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 1332 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:33.777514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:33.778131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:33.793985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.798063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.798063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.798420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.799152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.800362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.982665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:33.994447 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d6cf358f-1162-4045-aaeb-dc4e64384168 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 1.034927 Oct 04 17:54:34.015246 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 736/1573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:32 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:34.359185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.371889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:34.414746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:34.426608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.428623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.429832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.434369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.437453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.437769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.467254 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eeb7d55d-ae5b-4d2b-8413-15319edeec5d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.702299 Oct 04 17:54:34.468256 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 838/1574] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:33 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:34.482394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.485581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:34.520526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.523356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.526516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.534345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.535773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.536380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.626204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:34.715151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:34.735558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:34.740459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:34.766878 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4941c470-70a5-41cc-b612-d4dcabd9a844 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.414423 Oct 04 17:54:34.789144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-936cd4c2-e762-45d1-8b3e-c162f898ba94 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "DELETE /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 204 len: 0 microversion: 2.1 time: 0.317579 Oct 04 17:54:34.790094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 839/1575] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:34 2022] DELETE /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:34.793589 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 737/1576] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:34 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:34.800762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-plugged", "status": "completed", "tag": "d0fc32da-3822-40b7-af07-fe88112cdb28"}, {"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-plugged", "status": "completed", "tag": "c56b884c-47ed-496f-b619-b3d4e18388c8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:34.806449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.808182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] [instance: a046af5f-6cb0-47e9-809a-06155b0fa81f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:34.815156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.815653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.816790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.826178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.826992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.827727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.828698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.830903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.832387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.844002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Creating event network-vif-plugged:d0fc32da-3822-40b7-af07-fe88112cdb28 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:34.844511 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] Creating event network-vif-plugged:c56b884c-47ed-496f-b619-b3d4e18388c8 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:34.864496 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-65b03cdc-0204-4f60-afe7-52a4db424554 req-a6b03341-1aa7-4671-8d13-baed66319d69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067404 Oct 04 17:54:34.867090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 840/1577] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:34.870717 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] HTTP exception thrown: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Request method failure captured: Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f HTTP/1.1 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHJ-fMgehQwggaTSADmtyTgJt_EZfZpzat0izTlTpIn0K3f0vIkZpnivYIbFwpaS6QSAzxWK_1B5cbzDi8rtVg0jCrj5y-aM2j2OaT9LNpgHgmVdyLzt2hOYNtU2ZZZvjcXL2HfuvK9U0wGrSsEzOqbujq65raT-t6EdwBQWI4k2NTM Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: aa0f2a5c031f497983185dcbf3c660c7 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa0f2a5c031f497983185dcbf3c660c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: aa0f2a5c031f497983185dcbf3c660c7 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-441142830 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesAdminNegativeTest-441142830-project Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 634dc1af05d34e30834cf3f0e0e35815 Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesAdminNegativeTest-441142830-project Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a046af5f-6cb0-47e9-809a-06155b0fa81f'} Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:34.873302 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. Oct 04 17:54:34.878566 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:34.879885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Returning 404 to user: Instance a046af5f-6cb0-47e9-809a-06155b0fa81f could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:34.881516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.881657 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f66be633-3c21-4f77-ad3c-9f00a48bebb3 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f" status: 404 len: 111 microversion: 2.1 time: 0.086845 Oct 04 17:54:34.882504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:34.884145 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 738/1578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:34 2022] GET /compute/v2.1/servers/a046af5f-6cb0-47e9-809a-06155b0fa81f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:34.890606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.892532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.893160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.897226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a791ca19-7c89-4f14-af5c-1c792c7f0c57 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] Calling method '.version_select at 0x7f634185cee0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.898119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.898893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.899624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.936389 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a791ca19-7c89-4f14-af5c-1c792c7f0c57 tempest-VolumesAdminNegativeTest-441142830 tempest-VolumesAdminNegativeTest-441142830-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431597605" status: 202 len: 0 microversion: 2.1 time: 0.047177 Oct 04 17:54:34.939081 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 739/1579] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 17:54:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431597605 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:35.027647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:35.029605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:35.048701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.049773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.050597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.052962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.053773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.058876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.270174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:35.281567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08527cd6-3a70-4eb0-a9b0-abde01be5652 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1469 microversion: 2.1 time: 0.413207 Oct 04 17:54:35.282755 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 841/1580] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:34 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:35.455695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:35.468390 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a5af6911-c124-4d54-8b52-43aba4a631ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.449692 Oct 04 17:54:35.471104 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 740/1581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:35 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:35.505430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:35.506118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:35.515852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.520009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.527782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.530029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.530684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.533543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.808308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:35.809031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:35.819177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.823850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.824347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.825186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.825758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.826264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.060272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.073235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50a2eebb-5eeb-4dbf-9ef5-22fdbb2e12fd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1714 microversion: 2.1 time: 0.572325 Oct 04 17:54:36.074686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 842/1582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:35 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1714 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:36.160089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.174900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.178359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.201093 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2d9a4b95-e9a7-4782-ae91-a98f3891d2f9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.396736 Oct 04 17:54:36.214945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 741/1583] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:35 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:36.308404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:36.309151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:36.340660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.341486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.342525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.343832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.344812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.345473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.500369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:36.501990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:36.517879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.518617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.519194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.520475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.524599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.526775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.538030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:36.917209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.937704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51964eeb-f681-458d-b24b-bf39c3681afd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1469 microversion: 2.1 time: 0.633898 Oct 04 17:54:36.943677 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 843/1584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:36 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1469 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:36.948361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.956735 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bbff8de6-ec56-40f6-8c78-10ee23ce3d37 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1353 microversion: 2.1 time: 0.461751 Oct 04 17:54:36.965073 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 742/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:36 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1353 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:37.098312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.099211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:37.115885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.116879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.122168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.123079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.123664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.126742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.232686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.233295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:37.242119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.247567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.248228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.249131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.257475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.258549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.410153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:37.420692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:37.424495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:37.439679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c5ebfbd7-2e72-458d-9f84-2b7b542278b2 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.210597 Oct 04 17:54:37.440997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 743/1586] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:37.504756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:37.510580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:37.528328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9155cb35-70b3-4763-a453-273aa1395ae3 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1704 microversion: 2.1 time: 0.434241 Oct 04 17:54:37.531240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 844/1587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1704 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:37.551925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9f2a278b-d61c-4cf9-8891-e78383711a4d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '.version_select at 0x7f6341983dc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.555703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f2a278b-d61c-4cf9-8891-e78383711a4d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.556232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f2a278b-d61c-4cf9-8891-e78383711a4d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.556686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f2a278b-d61c-4cf9-8891-e78383711a4d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.584372 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9f2a278b-d61c-4cf9-8891-e78383711a4d tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3137 microversion: 2.1 time: 0.036064 Oct 04 17:54:37.586738 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 744/1588] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/os-migrations => generated 3137 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:37.612583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.613728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:37.631181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.631897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.638010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.639147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.642337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.642859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.983442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.996134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:38.029603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.033160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.036860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.042173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.043600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.044625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.656321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:38.679109 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5d2947f9-9d6b-4da6-bb27-b05cd3676227 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1427 microversion: 2.1 time: 0.708263 Oct 04 17:54:38.680553 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 745/1589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1427 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:38.706032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:38.709154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:38.780367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.785072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.786238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.795300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.797490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.798525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.961671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e421053-3173-453e-9069-59e71c30be3c tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1857 microversion: 2.1 time: 1.358189 Oct 04 17:54:38.965086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 845/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1857 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:39.013444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.014084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.060333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.061114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.062265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.062996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.069852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.070493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.222860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:39.235567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:39.240525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:39.254995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2bbfcf9f-25a8-47b9-adfa-fd4fa4d28f9d tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.262094 Oct 04 17:54:39.262685 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 846/1591] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:38 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:39.303063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26191c24-da38-413a-a5d0-23de941822aa", "name": "network-vif-deleted", "tag": "83738303-e345-4b1e-bb56-43b6169b2f2d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:39.324219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.324720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.325141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.357080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] Creating event network-vif-deleted:83738303-e345-4b1e-bb56-43b6169b2f2d for instance 26191c24-da38-413a-a5d0-23de941822aa on n-h1-831193-17 Oct 04 17:54:39.363471 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f895989b-8344-435e-b12d-e5ce03657955 req-141af7ed-3712-4f78-8da3-2edc7865ab43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071164 Oct 04 17:54:39.363900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:39.364183 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 847/1592] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:39.369542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.370235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.393220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.393739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.394186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.402684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.403816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.404576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.428101 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee6aab4b-21a5-45f9-874e-9ded667f87ad tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1804 microversion: 2.1 time: 0.746174 Oct 04 17:54:39.430855 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 746/1593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:38 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1804 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:39.474570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.476318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.495544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.496554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.497617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.499222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.500132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.500737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.578428 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01e3cf0d-2c23-4418-959c-3fa4214ae4fb tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c/ips" status: 200 len: 219 microversion: 2.1 time: 0.122695 Oct 04 17:54:39.581906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 747/1594] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 17:54:39 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c/ips => generated 219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:39.600204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.602250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.630145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.631756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.632590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.633905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.635248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.635981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.681280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:39.883746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7f91924-fea5-4910-9a95-97538ce52297 tempest-LiveMigrationTest-1092732654 tempest-LiveMigrationTest-1092732654-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1857 microversion: 2.1 time: 0.509248 Oct 04 17:54:39.885864 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 848/1595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:39 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1857 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:39.893985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.901034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.919542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.920044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.920480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.921177 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-360abeb5-fedc-43ac-a9d1-faec9faa5466 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 204 len: 0 microversion: 2.1 time: 0.326868 Oct 04 17:54:39.921344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.921636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.922061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.923238 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 748/1596] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:39 2022] DELETE /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:54:39.934592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.937543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:39.953823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:39.956480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.957827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.958287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.959202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:39.960146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:39.960913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.044930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.045808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.045808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.046162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lazy-loading 'fault' on Instance uuid 26191c24-da38-413a-a5d0-23de941822aa {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:40.257812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:40.271103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-125e3a56-9b6d-4a15-87c9-ab06b146fbd7 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 200 len: 1303 microversion: 2.1 time: 0.382583 Oct 04 17:54:40.274142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 849/1597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:39 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:40.285378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:40.293223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:40.335699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.336277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.336725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.339160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.339643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.340070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.346004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:40.360733 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-67a2562e-b1e0-4706-9f21-e7b544cf8971 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1810 microversion: 2.1 time: 0.432718 Oct 04 17:54:40.368404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 749/1598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:39 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1810 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:40.385570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:40.388706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:40.411403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.415219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.416534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.417575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.418644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.432939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.563678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lazy-loading 'services' on Instance uuid 465a1204-eacd-4237-bba3-2bc47eb35694 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:40.641553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:40.659772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:40.662388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:40.673687 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-71dc259d-edb9-480c-83a3-3f11e444b225 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1447 microversion: 2.75 time: 0.303407 Oct 04 17:54:40.689536 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 750/1599] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:40 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:40.713515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-489b9f28-9187-4ebd-99a8-7e573eda6a58 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "DELETE /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments/b52a711f-a8e4-486d-8b2d-a7f96c756146" status: 202 len: 0 microversion: 2.1 time: 0.437451 Oct 04 17:54:40.718087 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 850/1600] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 17:54:40 2022] DELETE /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments/b52a711f-a8e4-486d-8b2d-a7f96c756146 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:40.736229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:40.758241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:40.777263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.778015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.778533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.779518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.780080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.780578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.865521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5dff194f-3a7c-420c-bd18-93bb6c041eb2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144902 Oct 04 17:54:40.867240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 851/1601] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:40 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:40.924246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c30098ab-aee0-467b-83e3-e4b48fab482d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Action: 'create', calling method: .version_select at 0x7f6341784280>, body: {"keypair": {"name": "tempest-keypair-783607875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1WpmUSs+TY8JzoVm86HBWCES6cp81/GYHWYMxTQ8Qo7lPkGpwCt58RW7EQKBsnSfylltFGDY6eoMj4aGJxoN2wF9izCg64RwlzikbZ5OTv5DPnCmPwHEKczBLORDrG0A=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:40.987261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c30098ab-aee0-467b-83e3-e4b48fab482d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:41.007448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c30098ab-aee0-467b-83e3-e4b48fab482d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for user a79dac7c0cb441ada4f755ba2bc7aaa0 and project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:41.088977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c30098ab-aee0-467b-83e3-e4b48fab482d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.383006 Oct 04 17:54:41.089615 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 751/1602] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:54:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:41.305742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.308865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: 26191c24-da38-413a-a5d0-23de941822aa] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.324848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.325653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.328646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.329621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.330198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.334209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.364703 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] HTTP exception thrown: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Request method failure captured: Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa HTTP/1.1 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH8EvpTJiX9eV_b5gftSn3jvDM2KN0mWYxon2iZ0_3JFow-eeNQ6Sb6uNdpNp0AxitndF0jwl8T_BCxzHc6vazlXJ7qtedky83fuvBTH2pGp-N06tggkNV3Gbz5ByN3S9ZTAYeQFc_Zl58QSTlVoVeZe3D_edmU4U2OEaZGAVAY-wo Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0d0d5ddca82c4d8c83e182837bec0c27 Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '26191c24-da38-413a-a5d0-23de941822aa'} Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:41.369287 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. Oct 04 17:54:41.376803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:41.380101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Returning 404 to user: Instance 26191c24-da38-413a-a5d0-23de941822aa could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:41.381343 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39f68d47-2f39-44d9-bc72-c734f89fddcd tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa" status: 404 len: 111 microversion: 2.1 time: 0.082078 Oct 04 17:54:41.382571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 852/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/26191c24-da38-413a-a5d0-23de941822aa => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:41.391007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.391601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.409783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.412042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.412957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.413463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.413905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.414623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.415097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.415547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.422054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.423357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.424150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.425116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.425828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.426514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.476013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:41.636927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c60ed1ba-b050-427c-9c79-177ebf303065 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 204 len: 0 microversion: 2.1 time: 0.235340 Oct 04 17:54:41.638804 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 853/1604] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:41 2022] DELETE /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:41.657197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.658827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.670619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.671556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.672186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.673427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.674682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.675188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:41.676540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.687727 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08591bea-e7a3-4ae8-a047-17be54783e4a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1810 microversion: 2.1 time: 0.301600 Oct 04 17:54:41.699843 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 752/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:41.720877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.721841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.739885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.740617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.741265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.742853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.743565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.744918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.890806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:41.906999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:41.908950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:41.917007 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8fe6365b-07d4-467e-a616-2b9f46d21eae tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1453 microversion: 2.75 time: 0.212627 Oct 04 17:54:41.918338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 753/1606] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:41.924355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.928342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.944380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.945286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.948320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.949472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.951665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.952403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.035182 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab90e1a9-0495-4d5f-a071-bd0af580a010 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115409 Oct 04 17:54:42.038232 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 754/1607] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:42.491927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:42.500736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b39192d-beba-4130-a5fc-78becaaea904 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1469 microversion: 2.1 time: 0.857601 Oct 04 17:54:42.508165 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 854/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1469 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:42.715944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:42.716577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:42.739568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.740069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.746324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.747393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.748356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.748561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.950399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:42.951885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:42.966686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.969236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.971419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.974009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.974792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.976323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.239138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.271594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.273787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.286116 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca8a4517-17c2-4995-bb1f-9c2ddbf19be9 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1453 microversion: 2.75 time: 0.340318 Oct 04 17:54:43.309291 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 855/1609] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:42 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1453 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:43.314440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:43.321106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:43.339906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.341254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.342181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.345675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.348456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.349468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.459217 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1413c72-d9b8-43a3-b01f-8f0d6e3d56e0 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148605 Oct 04 17:54:43.459826 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 856/1610] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:43 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:43.527749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:43.528500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:43.535511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.536016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.536464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.537182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.537643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.538078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.960811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.974208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d6aa5c02-705c-40ba-aebd-a0b92cee2a63 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1810 microversion: 2.1 time: 1.262458 Oct 04 17:54:43.976606 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 755/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:42 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1810 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:43.983765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-deleted", "tag": "797f072c-f43c-4a75-a64a-73aa96bc81c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:44.002601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.003637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.005120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.047720 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] Creating event network-vif-deleted:797f072c-f43c-4a75-a64a-73aa96bc81c0 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:44.069886 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e9ed8b04-322e-46f6-9b5f-9fbecec733a1 req-b721f444-848c-4277-9c8e-522f5f1c4599 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088281 Oct 04 17:54:44.072588 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 756/1612] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:44.199784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:44.214361 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ad9caf6-2073-4a51-b827-2c1d1374204b tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1469 microversion: 2.1 time: 0.691142 Oct 04 17:54:44.222584 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 857/1613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:43 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1469 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:44.334705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:44.336136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:44.368299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.371732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.376112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.378145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.385950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.386773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.473723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:44.476417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:44.513160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.514967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.517649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.518760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.521468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.522435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.594041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5bc886d-28cb-43b2-9933-3aeee5de56eb tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123202 Oct 04 17:54:44.614037 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 858/1614] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:44 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:44.725296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:44.736443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:44.744985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:44.764844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2254700e-11a0-49dd-a429-942ced6ad8fe tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1453 microversion: 2.75 time: 0.439847 Oct 04 17:54:44.765985 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 757/1615] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:44 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1453 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:45.015564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:45.016442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:45.030794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:45.032654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:45.037298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.038415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:45.039174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:45.041470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.251797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:45.253140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:45.265405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:45.268447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:45.269122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.272533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:45.273214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:45.273856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.937389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:45.946075 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6311042-19ac-486c-9591-f694dfb4528d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1631 microversion: 2.1 time: 0.940104 Oct 04 17:54:45.955899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 859/1616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:45 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1631 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:45.961203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:45.971471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:45.985974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.002044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.002703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.003620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.004208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.004745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.043215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:46.100857 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-739021e4-915e-4d84-9d87-f361e619de49 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143032 Oct 04 17:54:46.103907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 860/1617] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:45 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:46.115918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:46.119067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:46.129330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:46.146083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.148094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.150635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.151879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.153877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.154575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.255907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0d5ddca82c4d8c83e182837bec0c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f02c42a7e1479bb776a01901053d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:46.273536 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a124c151-9041-46e6-991a-dccb468d1613 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 200 len: 1469 microversion: 2.1 time: 1.031231 Oct 04 17:54:46.274135 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 758/1618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:45 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 1469 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:46.351060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:46.360683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:46.365357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:46.380133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-493bb25e-faa6-4312-86ab-6acfe3b014aa tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1438 microversion: 2.75 time: 0.274866 Oct 04 17:54:46.384054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 861/1619] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:46 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1438 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:46.538050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-unplugged", "status": "completed", "tag": "c56b884c-47ed-496f-b619-b3d4e18388c8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:46.590080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.590682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.591945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.629298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] Creating event network-vif-unplugged:c56b884c-47ed-496f-b619-b3d4e18388c8 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:46.640538 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eaa63db5-ce8c-4bae-8399-7ce056f0ab97 req-5246b301-9aec-4f13-a01a-f609ce67c880 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106272 Oct 04 17:54:46.643783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 862/1620] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:46.761349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:46.766661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:46.785484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.786045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.788848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.791902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.795334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.795838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.796909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-deleted", "tag": "d0fc32da-3822-40b7-af07-fe88112cdb28"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:46.829076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.829977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.830687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.870973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] Creating event network-vif-deleted:d0fc32da-3822-40b7-af07-fe88112cdb28 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:46.878647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-67714ceb-69a0-4759-a83b-b80323f6dee4 req-dc271756-2652-4a66-8408-718e3198d984 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086231 Oct 04 17:54:46.885101 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 863/1621] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 17:54:46.979255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:46.993323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:46.994713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:47.003730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:47.004678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:47.005918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:47.007675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:47.008597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:47.042666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.043541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.044546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.045855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.046690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.075062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.196051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:47.215839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.216676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.217245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.218180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.218760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.219482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.599144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:47.627344 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-982faac3-8ea5-458f-ab08-3f20fca1f0b2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca/action" status: 202 len: 1944 microversion: 2.75 time: 1.209957 Oct 04 17:54:47.629536 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 759/1622] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:54:46 2022] POST /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca/action => generated 1944 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 17:54:47.637620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1760485926", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1a1507de-64a0-41ec-99ee-723250e9aaaa"}], "block_device_mapping_v2": [{"uuid": "02f91f60-f696-474a-8729-e0bd95e98236", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:47.754335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] validate_networks() for [('1a1507de-64a0-41ec-99ee-723250e9aaaa', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:47.971105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:47.988610 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-471bcff2-548e-4892-bd65-c9f6a1a7866f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1495 microversion: 2.1 time: 1.007478 Oct 04 17:54:47.994766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 864/1623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:46 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1495 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:48.013169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.023858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:48.041421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.042245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.043027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.043973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.046614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.047908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.137518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0bbc3069-b189-42e8-881b-7beccb13959d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139231 Oct 04 17:54:48.140519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 865/1624] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:47 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:48.146080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.146975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] [instance: e095fa3a-214a-486b-93f8-b3f9daca82d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:48.156780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.186180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.188706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.195701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.199604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.200344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.272958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] HTTP exception thrown: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Request method failure captured: Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 HTTP/1.1 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHH8EvpTJiX9eV_b5gftSn3jvDM2KN0mWYxon2iZ0_3JFow-eeNQ6Sb6uNdpNp0AxitndF0jwl8T_BCxzHc6vazlXJ7qtedky83fuvBTH2pGp-N06tggkNV3Gbz5ByN3S9ZTAYeQFc_Zl58QSTlVoVeZe3D_edmU4U2OEaZGAVAY-wo Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1f02c42a7e1479bb776a01901053d1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1f02c42a7e1479bb776a01901053d1d Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MigrationsAdminTest-2043910287 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0d0d5ddca82c4d8c83e182837bec0c27 Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MigrationsAdminTest-2043910287-project Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e095fa3a-214a-486b-93f8-b3f9daca82d5'} Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:48.279876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. Oct 04 17:54:48.285079 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.290067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] Returning 404 to user: Instance e095fa3a-214a-486b-93f8-b3f9daca82d5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:48.291365 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5afbd4d5-1aed-453c-913f-36fa80bd83d0 tempest-MigrationsAdminTest-2043910287 tempest-MigrationsAdminTest-2043910287-project] 10.222.0.33 "GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5" status: 404 len: 111 microversion: 2.1 time: 0.149457 Oct 04 17:54:48.294681 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 866/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:48 2022] GET /compute/v2.1/servers/e095fa3a-214a-486b-93f8-b3f9daca82d5 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:48.324143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.325070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:48.336715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.338523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.339265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.340850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.341478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.342252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.644867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:48.733436 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-846548c0-8da6-4272-83a3-4418173097d2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.437383 Oct 04 17:54:48.735462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 867/1626] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:48 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:48.942946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e095fa3a-214a-486b-93f8-b3f9daca82d5", "name": "network-vif-deleted", "tag": "12eea033-8eb7-4aec-8d33-48f68ecedd99"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:48.966778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.967670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.968220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.982329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] Creating event network-vif-deleted:12eea033-8eb7-4aec-8d33-48f68ecedd99 for instance e095fa3a-214a-486b-93f8-b3f9daca82d5 on n-h2-831193-17 Oct 04 17:54:48.988400 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cc8c3ee8-197f-4c4c-bbaa-5fb084bb8800 req-80115ebc-0614-410c-9c05-80a74597f90c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051822 Oct 04 17:54:48.989675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 868/1627] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:49.031387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:49.032139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:49.048459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.049108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.049448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.050515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.051302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.051800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.217263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:49.229029 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cb9459e-cb9a-485d-b6b7-cef945110ada tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1453 microversion: 2.1 time: 0.210788 Oct 04 17:54:49.230368 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 869/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:49 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:49.239948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:49.248126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:49.266842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.268859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.272267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.273129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.273688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.274192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.345294 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8fd775b3-fcd2-4808-9303-32b1b0da263d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111580 Oct 04 17:54:49.347979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 870/1629] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:49 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:49.776395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:49.777229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:49.788901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.791506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.793784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.795737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:49.798130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:49.815600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:49.989736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:50.032719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-edd9b364-707e-47b3-9c79-9d29f06380c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.261000 Oct 04 17:54:50.033404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 871/1630] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:49 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:50.082846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:50.083896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:50.084480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:50.085472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:50.086090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:50.114596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.116414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.117127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.117943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.118413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.118876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.179141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:50.187494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Getting quotas for user ee53a080f77a44f8aac80b34c1dd179e and project 9704eb841a9845948b9b01555c7051c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:50.254442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.256091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:50.278207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.279511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.281682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.282795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.285546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.286683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.380921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:50.385268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02f91f60-f696-474a-8729-e0bd95e98236',volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:50.523228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.525775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.526524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.527653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lazy-loading 'fault' on Instance uuid cd347e55-e148-43a7-a259-fbf75ed9036c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:50.754727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:50.768223 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b39e214-aba0-46ca-87df-a33ffcabaafd tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 200 len: 1301 microversion: 2.1 time: 0.517960 Oct 04 17:54:50.768814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 872/1631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:50 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 1301 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:50.775584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.794810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:50.820234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.820753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.822271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.823074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.823541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.823976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.837885 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4154e5e-376b-4870-9f90-ca0c18fb296e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.203462 Oct 04 17:54:50.845367 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 760/1632] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:54:50.856002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.856672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:50.985004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70428c1f-681b-41f8-be1a-0d9bc450d2cd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213123 Oct 04 17:54:50.986217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 873/1633] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:50 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:51.069364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:51.070754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:51.080054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:51.083295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.085777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.087945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.090384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.091197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.091880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.093495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:51.096063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:51.101708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-29b826af-031b-4131-b9fa-5b23a1274404 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1104 microversion: 2.25 time: 0.247912 Oct 04 17:54:51.102418 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 761/1634] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:50 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1104 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:51.113797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd347e55-e148-43a7-a259-fbf75ed9036c", "name": "network-vif-deleted", "tag": "c56b884c-47ed-496f-b619-b3d4e18388c8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:51.150102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.151194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.152401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.175623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] Creating event network-vif-deleted:c56b884c-47ed-496f-b619-b3d4e18388c8 for instance cd347e55-e148-43a7-a259-fbf75ed9036c on n-h1-831193-17 Oct 04 17:54:51.185736 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-eea1a09c-758c-4428-a158-d924a365bcae req-8da42009-82ab-4256-8089-1935cc34a6f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078428 Oct 04 17:54:51.187174 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 762/1635] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:51.241965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:51.262453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fba3d607-fd65-4546-9382-ebce1cf42397 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.198991 Oct 04 17:54:51.263766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 874/1636] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:51 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:51.814701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:51.816599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:51.848945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.849812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.850617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.859584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.861118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.862238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.909366 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c HTTP/1.1 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'cd347e55-e148-43a7-a259-fbf75ed9036c'} Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:51.915222 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:51.919865 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5a164658-ccde-4008-88c4-3517467a575d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 404 len: 111 microversion: 2.1 time: 0.119596 Oct 04 17:54:51.925257 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 763/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:51 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:52.002340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.009011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:52.034591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.035870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.040845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.045026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.045824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.048104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.133459 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a6831a1-6a3b-4fb4-9529-76de43f32703 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135518 Oct 04 17:54:52.136425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 875/1638] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:51 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:54:52.142356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.144026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:52.182382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.182882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.189865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.191014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.191693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.192316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.293720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.294253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:52.311218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.312022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.312917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.314230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.314940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.315629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.478770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:52.498466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:52.500706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:52.504431 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55d4c518-f439-4e66-bf31-93e9304b2068 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1185 microversion: 2.25 time: 0.371800 Oct 04 17:54:52.507848 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 764/1639] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:52 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1185 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:52.742663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:52.855149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e688ca71-2da9-43f9-9aca-7b6a9a001967 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.565929 Oct 04 17:54:52.859829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 876/1640] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:52 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:53.536461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.537864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:53.553314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.554401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.556964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.559470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.560779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.562981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.773286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:53.782820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:53.790399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:53.794769 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec09fb60-9d77-43ed-92e8-baefc55482f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1241 microversion: 2.25 time: 0.260670 Oct 04 17:54:53.795635 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 765/1641] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:53 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1241 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:53.888085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.889640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:53.921821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.922655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.923741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.928892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.929978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.935572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:54.472740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:54.530416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:54.614526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6edfc907-3b91-4bd1-9545-f65c2e5d0aa2 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.730886 Oct 04 17:54:54.640892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 877/1642] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:53 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:54.851251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:54.852628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:54.870353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:54.873194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:54.873985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:54.885885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:54.887955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:54.891532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:55.134810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:55.155173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:55.157478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:55.159654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-35c52307-cce1-4fc5-851c-2e8c413bc47d tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1251 microversion: 2.25 time: 0.315348 Oct 04 17:54:55.160561 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 766/1643] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:54 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1251 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:55.450879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11dc4b10-2695-4959-940b-81a64499a773 tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] Calling method '.version_select at 0x7f6345e2c1f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:55.476376 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11dc4b10-2695-4959-940b-81a64499a773 tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.337248 Oct 04 17:54:55.477682 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 878/1644] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:54:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:55.491184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-034048ed-1206-4c43-ba8e-2ab4de9418fd tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] Action: 'update', calling method: .version_select at 0x7f63419f0550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:55.670533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:55.671223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:55.683430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:55.684310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:55.684972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:55.685997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:55.688261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:55.688951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:55.829963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:UPDATE=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:56.043619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:56.057443 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-034048ed-1206-4c43-ba8e-2ab4de9418fd tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.568845 Oct 04 17:54:56.059807 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 767/1645] 10.222.0.33 () {60 vars in 1206 bytes} [Tue Oct 4 17:54:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:56.079592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2fa735c-6435-4c1c-b682-33abd78655ad tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] Calling method '.version_select at 0x7f6341725e50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:56.103829 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c741b50-dcc4-474a-a918-813630e77c2e tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.437599 Oct 04 17:54:56.107923 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 879/1646] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:55 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:56.111880 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2fa735c-6435-4c1c-b682-33abd78655ad tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041463 Oct 04 17:54:56.112766 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 768/1647] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 17:54:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:56.129183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89d6ec95-1f83-45a6-a172-dfefcf262b5b tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] Action: 'update', calling method: .version_select at 0x7f634181b4c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:56.195821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:56.198035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:56.219923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:56.221395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:56.222268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:56.225491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:56.227543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:56.230160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:56.371181 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89d6ec95-1f83-45a6-a172-dfefcf262b5b tempest-QuotaClassesAdminTestJSON-1829363860 tempest-QuotaClassesAdminTestJSON-1829363860-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.248831 Oct 04 17:54:56.373802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 880/1648] 10.222.0.33 () {60 vars in 1206 bytes} [Tue Oct 4 17:54:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:57.132617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:57.141314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:57.142294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:57.154546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:57.161379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:57.162632 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8d1e9212-0f3c-41ef-a38a-ee81b35b4dd3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1293 microversion: 2.25 time: 0.978749 Oct 04 17:54:57.163629 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 769/1649] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:56 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1293 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:57.177036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.184770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.186964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:57.191183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.193171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.194236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:57.339512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:57.397980 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd832222-cfac-413f-afdc-8395c06a5b23 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.243293 Oct 04 17:54:57.399487 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 881/1650] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:57 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:58.194689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.195636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:58.227468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.241539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.245206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.257219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.257894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.266055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.436240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.436240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:58.445165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.451344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.454783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.459552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.460510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.461783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.760751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:58.809262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e7d331d-0297-4a65-9a5a-59faf6988634 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.382597 Oct 04 17:54:58.813846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 882/1651] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:58 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:54:59.239449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:59.254085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:59.264559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:59.266266 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1fa76a01-0908-433b-aba1-1bd836db01d1 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1293 microversion: 2.25 time: 1.077032 Oct 04 17:54:59.283217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 770/1652] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:58 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1293 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:59.522090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8ea762-4cf4-4934-a420-cab6da4c42b1", "tag": "5bff0370-ae03-404d-8664-52aeac2685de"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:59.546458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.547261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.548506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.565165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] Creating event network-changed:5bff0370-ae03-404d-8664-52aeac2685de for instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 on n-h1-831193-17 Oct 04 17:54:59.571609 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bd9ae8dd-7455-42ac-abab-b896edb167c4 req-3c0f56a8-ec6f-4d71-bbc2-62c73f174aae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056929 Oct 04 17:54:59.573118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 883/1653] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:59.849266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.850042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.861574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.863723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.871380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.872665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.873392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.875715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:00.157621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:00.205995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:00.265111 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5704e99c-fedc-43e3-b43a-283c5933066c tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.418072 Oct 04 17:55:00.267472 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 771/1654] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:00.298572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:00.299929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:00.321846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:00.324706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:00.325409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:00.326354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:00.328003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:00.328592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:00.721209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:00.737660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:00.744581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:00.747655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4d1fc2c-54b0-47b6-88c4-4cda1fa6b611 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1293 microversion: 2.25 time: 0.454535 Oct 04 17:55:00.748826 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 884/1655] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:00 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:01.296844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.297567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.308465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.308976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.309416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.319793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.320304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.320855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.536938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.542760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.545302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:01.548436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Searching by: {'deleted': False, 'project_id': '283165e2cb5044d5a97f24e500f05c9e'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:01.579047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.579827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.580427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.581365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.584797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.587334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.608161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d409edf-c578-42a6-a56f-9bb47c440ddc tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.314504 Oct 04 17:55:01.613727 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 772/1656] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:01.651736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:01.717543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-777e3c98-c42b-447d-aab1-3a119f4c59fb tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.184399 Oct 04 17:55:01.718876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 885/1657] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers => generated 340 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:55:01.732777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.738189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.746039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Searching by: {'deleted': False, 'project_id': '283165e2cb5044d5a97f24e500f05c9e'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:01.758603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.764534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.765363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.766946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.767717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.768465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.794725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.795974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.808205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.809162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.810650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.816217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.817184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.817888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.032467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:02.261523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.279660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.280136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.280590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.291629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.308580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.311132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.312555 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff4afc55-4f38-47c8-b374-4e9687264417 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1293 microversion: 2.25 time: 0.523452 Oct 04 17:55:02.334547 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 886/1658] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1293 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:02.559158 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1702c43a-e5b7-4418-a6da-97ffc1eb2511 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.831300 Oct 04 17:55:02.577942 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 773/1659] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:02.588657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6f0d761-be29-4ce5-8a67-70906ee940cd tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.598072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6f0d761-be29-4ce5-8a67-70906ee940cd tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013431 Oct 04 17:55:02.599474 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 887/1660] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:02.642196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.643291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:02.652813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.653726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.654351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.655292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.655918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.656529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.784933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:02.810931 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b0c44543-b390-4289-8523-200aa78fa8c9 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.172348 Oct 04 17:55:02.812577 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 774/1661] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:02.926636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.927685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:02.957129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.957734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.958608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.959433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.960905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.962482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.024951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:03.173552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:03.220083 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91878184-6aa1-4172-816f-ff5a8e20af28 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "DELETE /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 204 len: 0 microversion: 2.1 time: 0.295366 Oct 04 17:55:03.223353 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 888/1662] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:02 2022] DELETE /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:03.239680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.245543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.264997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.266970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.272662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.274115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.277351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.277899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.403822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-338556324", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:03.570898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5532075507e0480f959d973467f8f834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283165e2cb5044d5a97f24e500f05c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.584630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbbf2fff-4ed4-415d-bf13-aacb9d4087cf tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 200 len: 1714 microversion: 2.1 time: 0.356266 Oct 04 17:55:03.587935 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 889/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 1714 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:03.596428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.598453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.607539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.608764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.609862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.610991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.611929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.612635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.933875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.950506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.958088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.959308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f2326fb-c03b-43fa-abbe-908520a5fd10 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1293 microversion: 2.25 time: 0.368863 Oct 04 17:55:03.959880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 890/1664] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:03.982248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.982883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.989230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.989767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.990211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.990928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.991669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.992331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.162135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:04.198986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3ea208d-a2d5-4f9e-9a57-f882ea20687f tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1931 microversion: 2.75 time: 0.222755 Oct 04 17:55:04.219535 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 891/1665] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:04.506369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1228297329", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "74b612a8-0c44-426c-a355-6073fc352baf"}, {"uuid": "836b0adc-5a91-4756-9c48-dd78e46093f8"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:06.361172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:11.609597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:11.864109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:12.256528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=39,nova_cell0:UPDATE=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:12.790014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:13.427523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=6,nova_api:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:14.182186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:14.601558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:15.586796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:15.602090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] validate_networks() for [('74b612a8-0c44-426c-a355-6073fc352baf', None, None, None, None, None), ('836b0adc-5a91-4756-9c48-dd78e46093f8', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:15.933922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:15.934591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:15.935268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:15.936383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:15.936830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:15.955294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.955799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.956370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.957097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.957951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.958782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.998196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:16.005002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for user 05c694e9eeb548fea9e2ec8a311c8485 and project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:16.022169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:16.026177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:16.094908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6cd7c1fa-b5d3-4f0b-82cf-0a7d9144a81c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.965801 Oct 04 17:55:16.107528 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 775/1666] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 12968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:16.109643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.110307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] [instance: 994a2193-4329-42d3-aa61-ba83e2ba994d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:16.130795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.132705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.135211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.137204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.140739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.143501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.198354 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] HTTP exception thrown: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Request method failure captured: Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d HTTP/1.1 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHMoaoqb7f0bIh2qKmRr9FpbdQ38Xo52ZzDQlnQLrlLGGRLdMFege162BXh9bNRwUL2d4ARWbNB_IJd5vojQOG-f7dIFX80eeBMc8fYX9vfdOquFGIXWYnJGpbJAterSX_jmC08k0Z-kogV8j2QrY-V7VkkqA4oORtUe3mZDdEEJo6Y Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 283165e2cb5044d5a97f24e500f05c9e Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestManualDisk-1194314265 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/283165e2cb5044d5a97f24e500f05c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_283165e2cb5044d5a97f24e500f05c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/283165e2cb5044d5a97f24e500f05c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/283165e2cb5044d5a97f24e500f05c9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestManualDisk-1194314265 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 283165e2cb5044d5a97f24e500f05c9e Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestManualDisk-1194314265 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestManualDisk-1194314265-project Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5532075507e0480f959d973467f8f834 Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestManualDisk-1194314265-project Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '994a2193-4329-42d3-aa61-ba83e2ba994d'} Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:16.204715 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Returning 404 to user: Instance 994a2193-4329-42d3-aa61-ba83e2ba994d could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-af2e2cc9-4977-4f81-a44c-46e77c27d910 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d" status: 404 len: 111 microversion: 2.1 time: 0.107954 Oct 04 17:55:16.210927 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 776/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers/994a2193-4329-42d3-aa61-ba83e2ba994d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:16.220711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.221328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:16.244634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.246654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.247246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.248067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.250245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.250762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.481041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.522746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.527721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.531023 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b352d9f-d045-4d59-933c-e4b93b291902 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1281 microversion: 2.25 time: 0.319900 Oct 04 17:55:16.552323 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 777/1668] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:16.579290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.581467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:16.589130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.590556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.592195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.593623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.594613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.595311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.706083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] Lazy-loading 'services' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:16.734028 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9be1470-423b-4739-b84e-2e468abb3a37 tempest-ServersAdmin275Test-1707461118 tempest-ServersAdmin275Test-1707461118-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1922 microversion: 2.75 time: 0.178728 Oct 04 17:55:16.747650 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 778/1669] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1922 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:16.769493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994a2193-4329-42d3-aa61-ba83e2ba994d", "name": "network-vif-deleted", "tag": "c8763e48-5ed2-4f63-a6a1-e6b5f698771e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:16.789537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.790420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.791129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.807466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] Creating event network-vif-deleted:c8763e48-5ed2-4f63-a6a1-e6b5f698771e for instance 994a2193-4329-42d3-aa61-ba83e2ba994d on n-h1-831193-17 Oct 04 17:55:16.814559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-37ac8fa4-3e45-4537-8e8a-8043327f752e req-8ac542e1-444d-42c2-8652-9a238c0b4eac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065477 Oct 04 17:55:16.831723 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 779/1670] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:16.921833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1268734256", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:17.038432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] validate_networks() for [('c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:17.475693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:17.476241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:17.477115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:17.477819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:17.478581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:17.497658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.503581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.505228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.509933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.510465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.510964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.571964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Getting quotas for project f79ad7bb006342c5a55112a4d04d4ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:17.579020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Getting quotas for user 860db374eab0453d96c6a14e71134b48 and project f79ad7bb006342c5a55112a4d04d4ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:17.596856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:17.610979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:17.687842 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13235b34-7c95-4647-8049-329568b078ec tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.192633 Oct 04 17:55:17.695193 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 892/1671] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 13209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:17.702464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4eb6db85-1e07-4142-9d43-630b5e9e9c52 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] Calling method '.version_select at 0x7f63416d34c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:17.727117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4eb6db85-1e07-4142-9d43-630b5e9e9c52 tempest-ServersTestManualDisk-1194314265 tempest-ServersTestManualDisk-1194314265-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88530446" status: 202 len: 0 microversion: 2.1 time: 0.029049 Oct 04 17:55:17.728010 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 893/1672] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 17:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88530446 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:17.747437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-395118612", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:17.856498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:18.301423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:18.302506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:18.303179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:18.303957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:18.304542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:18.329521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.335888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.335888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.336184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.340472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.344573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.402037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:18.408258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for user 05c694e9eeb548fea9e2ec8a311c8485 and project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:18.442281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:18.444843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:18.564406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec3b72c6-18d2-4e43-87ab-978771716404 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834182 Oct 04 17:55:18.565125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 894/1673] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:18.579642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8ea762-4cf4-4934-a420-cab6da4c42b1", "name": "network-vif-plugged", "status": "completed", "tag": "5bff0370-ae03-404d-8664-52aeac2685de"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:18.610698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.611236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.611773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.640065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] Creating event network-vif-plugged:5bff0370-ae03-404d-8664-52aeac2685de for instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 on n-h1-831193-17 Oct 04 17:55:18.655146 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f56f40c3-991d-4353-bd75-f1f4b6cf5547 req-d146c621-9710-49cf-a74a-00b93e0499bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077308 Oct 04 17:55:18.658123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 895/1674] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:18.660004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:18.660527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:18.661066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:18.661574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:18.664364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:18.669082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:18.676585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:18.691683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.692181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.692630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.693378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.693840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.694275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.702805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.707097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.707588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.716257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.716795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.717251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.780569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:18.793923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for user 242be122e02f4be3abdd0e7a989764b4 and project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:18.800265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:18.870385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:18.875846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:19.028883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85b92fdf-713d-492f-9f70-e2b18d1f7ba4 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 204 len: 0 microversion: 2.75 time: 0.368916 Oct 04 17:55:19.033205 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 896/1675] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:55:18 2022] DELETE /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:55:19.062275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.064990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.066052 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c5301b9-38d3-4bed-ba4d-5fade5c49814 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232748 Oct 04 17:55:19.066732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 780/1676] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:19.078300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.084073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.084992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.085920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.089292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.090408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.097720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.099929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.124134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.135659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.138736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.139907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.140412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.140866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.549442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.577888 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab578536-b664-4eff-bd9f-0c7c00e2e5a2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1265 microversion: 2.1 time: 0.482609 Oct 04 17:55:19.577888 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 781/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:19.577888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c346cf8-d973-4044-94ca-d77436a97bf1 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.577888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c346cf8-d973-4044-94ca-d77436a97bf1 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.721404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0c346cf8-d973-4044-94ca-d77436a97bf1 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.741269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c346cf8-d973-4044-94ca-d77436a97bf1 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1213 microversion: 2.1 time: 0.180805 Oct 04 17:55:19.763428 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 782/1678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:19.779835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.781531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.797372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.801736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.803415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.804480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.807321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.808017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.043700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.094030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.107907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.112357 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c94a00c-fbe8-499f-b75d-c6e0a9bb208c tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1281 microversion: 2.25 time: 1.077656 Oct 04 17:55:20.117150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 897/1679] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1281 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:20.128947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.135379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:20.144200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.163378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.167231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.168703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.173045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.178175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.181385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.181815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.185290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.200576 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c4b7207-16ca-40ae-9bce-aeec301b189c tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1444 microversion: 2.75 time: 0.428575 Oct 04 17:55:20.224695 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 783/1680] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1444 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:20.518064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.532985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a73dfec-6268-4b4e-aeed-84b7b5428638 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1212 microversion: 2.1 time: 0.414076 Oct 04 17:55:20.534572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 898/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1212 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:20.599382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.600014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:20.628604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.629204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.629939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.633480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.634277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.636097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.783620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.784348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:20.797801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.799127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.805484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.809637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.811230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.812460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.876844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.914364 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-64ac80e0-e97e-44ad-a86c-b64aef33fe61 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1271 microversion: 2.1 time: 0.301680 Oct 04 17:55:20.919132 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 784/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:21.017831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.028827 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d71dcd2d-6490-4a4c-8351-46892263b770 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1265 microversion: 2.1 time: 0.249444 Oct 04 17:55:21.030793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 899/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:21.150365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.153052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.169836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.172172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.173774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.178821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.179732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.180411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.242046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.244631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.257227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.257958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.258532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.260221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.260781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.261305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.446104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.461199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.467792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.480968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db22418f-73c2-4e2e-a7c1-758266420189 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1444 microversion: 2.75 time: 0.246416 Oct 04 17:55:21.486746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 900/1684] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1444 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:55:21.556481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.557478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.558453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.568186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.574573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.575473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.576073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.576282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.577260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.577384 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-961f9813-05a4-4a70-858a-4d6d9cc627b9 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1476 microversion: 2.25 time: 0.431463 Oct 04 17:55:21.577858 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 785/1685] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:21.578300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.579121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.847516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.848646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.856980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.857774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.861885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.863193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.864065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.864895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.917227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:21.933784 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12eaed18-b6dd-4d86-b8e3-f7f269872517 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1266 microversion: 2.1 time: 0.382582 Oct 04 17:55:21.939477 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 901/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:21.944827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.945718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.970574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.971954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.972883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.973877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.974573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.975308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.173077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:22.182217 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a0e8986-93f2-4f63-b69d-1750e50983c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1271 microversion: 2.1 time: 0.241285 Oct 04 17:55:22.186437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 902/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:22.205297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.206165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.218237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.219110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.219778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.220735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.221388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.222303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.374880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:22.388245 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd9769d7-dc80-40a3-8cd5-92244c207ac2 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1283 microversion: 2.1 time: 0.200458 Oct 04 17:55:22.388709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid eb8ea762-4cf4-4934-a420-cab6da4c42b1 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:22.399264 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 903/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:22.424089 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a33783f9-99e5-4834-9222-ddf1caebdf70 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1971 microversion: 2.25 time: 0.822517 Oct 04 17:55:22.427766 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 786/1689] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1971 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:22.452126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.453435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.460044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.461159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.462545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.463903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.464658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.465313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.516950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.517871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.529237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.529735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.530173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.530893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.531386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.531814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.608064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.608707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.609725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.610366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lazy-loading 'fault' on Instance uuid 9ad99c85-f39b-4702-a861-f4e2a3468eca {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:22.795379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid eb8ea762-4cf4-4934-a420-cab6da4c42b1 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:22.832510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52e03426-9246-4517-94cb-4347fc1d4277 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1971 microversion: 2.25 time: 0.382419 Oct 04 17:55:22.833149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 904/1690] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1971 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:22.857437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.862686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.863860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.866672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.867809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.869355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.871320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.964258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70ec30e8-1615-41e9-a014-d87c113b277f tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.110434 Oct 04 17:55:22.969856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 905/1691] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:22.983871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.984963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.998136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.001167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.003427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.004502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.005994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.010820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.255553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.291295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.303392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '131d97155d5044b9859eede1fa7f350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fd3aea259403b817b1873be55aa81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.310260 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e6deeab-a073-479e-a1e6-96ff30476c4a tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 200 len: 1449 microversion: 2.75 time: 0.797590 Oct 04 17:55:23.310974 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 787/1692] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 1449 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:23.338935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831193-17", "block_migration": "auto"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:23.346675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:23.354557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.355826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.356908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.357991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.358698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.359387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.391209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'flavor' on Instance uuid eb8ea762-4cf4-4934-a420-cab6da4c42b1 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:23.424688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Going to try to live migrate instance to n-h2-831193-17 {{(pid=128771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:55:24.288596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.293710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7234857-b551-47e4-950b-b0f5fb75ad9e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 1.322488 Oct 04 17:55:24.298075 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 906/1693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:24.304607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:24.307848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:24.326316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.336714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.337779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.338549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.339025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.339476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.768770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.782926 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0aafa438-4bc7-452a-bbf7-6ff35aa110c2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1271 microversion: 2.1 time: 0.483601 Oct 04 17:55:24.791759 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 907/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:24 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1271 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:24.808270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:24.821604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:24.843992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.851174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.853341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.854450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.855129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.856527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.416456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:25.431956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e47a322b-d4fa-4c87-8545-8454c8863a7b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.638844 Oct 04 17:55:25.436363 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 908/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:24 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:25.449315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:25.450279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] [instance: 9ad99c85-f39b-4702-a861-f4e2a3468eca] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:25.470355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.470847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.475482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.477145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.479790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.480778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.528004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] HTTP exception thrown: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Request method failure captured: Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca HTTP/1.1 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHM-a1BaWwApTFYi8NOyId_kGJLdl4yNoWlu-P00dq6ULGTTIv8cRzvvh6hbVowunEkyvPjRACEopEh-LoLx4QaK56jULfWufpJsT-nCsT66J07vff2AxyoiAfmTBUUGfL7qpb0jPsYYv5CgvvfXZVFL7gZQHm_GpQDcLqECjEQCabA Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9e5fd3aea259403b817b1873be55aa81 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdmin275Test-633721569 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e5fd3aea259403b817b1873be55aa81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9e5fd3aea259403b817b1873be55aa81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e5fd3aea259403b817b1873be55aa81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9e5fd3aea259403b817b1873be55aa81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdmin275Test-633721569 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9e5fd3aea259403b817b1873be55aa81 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdmin275Test-633721569 Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdmin275Test-633721569-project Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 131d97155d5044b9859eede1fa7f350f Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdmin275Test-633721569-project Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9ad99c85-f39b-4702-a861-f4e2a3468eca'} Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:25.530089 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. Oct 04 17:55:25.535114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:25.543456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] Returning 404 to user: Instance 9ad99c85-f39b-4702-a861-f4e2a3468eca could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:25.544782 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8bebb0d-4b08-4f7e-925d-fa1065260657 tempest-ServersAdmin275Test-633721569 tempest-ServersAdmin275Test-633721569-project] 10.222.0.33 "GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca" status: 404 len: 111 microversion: 2.75 time: 0.106950 Oct 04 17:55:25.546963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 909/1696] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:25 2022] GET /compute/v2.1/servers/9ad99c85-f39b-4702-a861-f4e2a3468eca => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:55:25.573590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:25.574549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:25.583119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.588470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.589180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.590387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.591188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.595259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:26.154258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:26.162513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:26.169764 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1119ae90-38c4-4da2-b8cf-3f336a3d7e85 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 0.616574 Oct 04 17:55:26.170570 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 910/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:25 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:26.176392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:26.188536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:26.216394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:26.218826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:26.220456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:26.221441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:26.223632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:26.224975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:27.040171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:27.066495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1fd65d9-f000-4b4f-bfea-71141aaab601 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1313 microversion: 2.1 time: 0.893796 Oct 04 17:55:27.067324 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 911/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:26 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1313 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:27.084593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:27.090162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:27.102653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:27.103185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:27.103630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:27.104354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:27.104816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:27.105249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.181007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:28.191665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0682596f-acd2-4d3f-a773-bb77c2e8c953 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 1.123084 Oct 04 17:55:28.192588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 912/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:27 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:28.218438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0763ff04-b85e-47e4-a9a9-76095d5b5fd1", "tag": "47bc100a-5f09-467f-b164-0431cc8a25ac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:28.245403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.246387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.247740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.328741 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] Creating event network-changed:47bc100a-5f09-467f-b164-0431cc8a25ac for instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 on n-h1-831193-17 Oct 04 17:55:28.343443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c30714ec-2d73-47a5-8e4c-d3d879fb0dd5 req-f27ff1b5-abf5-4c24-a898-4eb8c59a22fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132727 Oct 04 17:55:28.345831 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 913/1700] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:28.360172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:28.362168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:28.390063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.393482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.396975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.400778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.401716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.404285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.420189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:28.634584 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1885710c-eb79-444b-8bc3-b018d536419a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1/action" status: 202 len: 0 microversion: 2.25 time: 5.299524 Oct 04 17:55:28.635696 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 788/1701] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:55:23 2022] POST /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1/action => generated 0 bytes in 5302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:28.654068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:28.664158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:28.696794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.697859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.698505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.702680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.704705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.705356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.789472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:29.564850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:29.577079 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8199c520-e1ba-4328-9f04-eb406b32b19e tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1313 microversion: 2.1 time: 0.932199 Oct 04 17:55:29.579995 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 789/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:28 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1313 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:29.589622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:29.591215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:29.609264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.612767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.615296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.616003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.616403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.616842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.732286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:29.742034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:29.748122 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4e1dd1b-a69e-425f-881c-6973773926b3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 1.400289 Oct 04 17:55:29.748720 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 914/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:28 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:29.763356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1408688688", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8ad523f5-c1d5-477d-bb94-eca407196b2f"}], "security_groups": [{"name": "tempest-securitygroup--1359614447"}], "key_name": "tempest-keypair-783607875", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0146f9f9-4155-41e3-ba97-f16d4679c43c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:30.145500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] validate_networks() for [('8ad523f5-c1d5-477d-bb94-eca407196b2f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:30.146274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.163250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.167004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.169216 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d2598e28-9adb-4cb3-8697-7ed0b13d52ca tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.588062 Oct 04 17:55:30.183058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 790/1704] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:29 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:30.183058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.183058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.187101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.188249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.189003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.190064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.190737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.192350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.560546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.572094 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b0381a09-18d4-411b-98fb-de1f0b5925fc tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.398907 Oct 04 17:55:30.572942 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 791/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:30 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:30.579112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:30.592648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.593126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.593556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.597867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:30.610393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] Creating event network-changed:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:55:30.618755 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-bedb2ed6-d3fb-44d3-8fbe-9f8e45261ba0 req-e37d0152-fa1b-474a-b88f-fbf9a2050140 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044125 Oct 04 17:55:30.619408 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 792/1706] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:30.626826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eb8fff-2237-43d4-9e47-14ebd914088d", "tag": "8be6f217-129a-4ce3-a1c9-41769d091d4c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:30.641576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.642309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.642911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.660589 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] Creating event network-changed:8be6f217-129a-4ce3-a1c9-41769d091d4c for instance f0eb8fff-2237-43d4-9e47-14ebd914088d on n-h2-831193-17 Oct 04 17:55:30.666194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2b46318e-cbd5-45b7-82e6-84bd8a282d0c req-5ea2237e-3869-4c73-b5ec-3a0a24603325 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045343 Oct 04 17:55:30.667437 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 793/1707] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:30.673676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.674388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.681878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.682396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.683178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.684119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.684583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.685220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.157617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:31.172127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bcd875c3-3c28-4ed3-b96d-266ea4838027 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.502761 Oct 04 17:55:31.187587 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 794/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:30 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:31.195005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:31.195969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:31.205155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.205578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.206838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.207930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.208743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.209338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.733133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:31.745757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for user a79dac7c0cb441ada4f755ba2bc7aaa0 and project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:31.781055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:31.782965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:31.784999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:31.785527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:31.786139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:31.807338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.808627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.809326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.810518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.811246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.812707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.835639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:31.846479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:31.857418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Getting quotas for user a79dac7c0cb441ada4f755ba2bc7aaa0 and project be2456d4a42e4da8abbbdc4fc79cbc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:31.983462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:31.999970 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2d9a7402-6882-4516-b9f0-9c5d6cfd7410 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 0.809924 Oct 04 17:55:32.001865 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 795/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:31 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:32.021961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1820249880", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "35bfa742-c59f-4f7e-a228-2ef392c75418"}], "block_device_mapping_v2": [{"uuid": "05f559fc-273d-46a4-b5cb-e805a1f55608", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:32.023403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:32.028749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0146f9f9-4155-41e3-ba97-f16d4679c43c',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:32.172135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] validate_networks() for [('35bfa742-c59f-4f7e-a228-2ef392c75418', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:32.645760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd760999-0912-452b-b48a-7421fdf0d49f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.895651 Oct 04 17:55:32.647316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 915/1710] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:32.678989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:32.681167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:32.704710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:32.710447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:32.711610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:32.713536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:32.717173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:32.723797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.208250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.226754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.230432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.233980 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-25b24a7e-19dd-4adb-9ae7-b878db6e2cdb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 1.573107 Oct 04 17:55:34.239547 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 916/1711] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:32 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:34.247520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:34.250364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:34.266393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.266914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.267725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.268706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.275823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.276514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.674636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.688483 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-910588bc-5ea3-495d-8f11-42e61518151e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.447375 Oct 04 17:55:34.691944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 917/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:34 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:34.706520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:34.709152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:34.727146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.728491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.741576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.741576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.741576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.741576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.239016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:35.254744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d55cd7e2-ba99-4a48-9360-bd2f173c25e8 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.561393 Oct 04 17:55:35.255995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 918/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:34 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:35.277334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:35.277955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:35.316976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.331399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.332002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.341496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.342035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.342480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.512035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:35.530534 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d2c8021-5b21-46f9-82bc-5da8481d0a15 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1237 microversion: 2.1 time: 0.264455 Oct 04 17:55:35.533424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 919/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:35 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:35.549540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "tag": "affb1bc1-44c1-4d4a-8585-ea42399e0504"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:35.597603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.598082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.599277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.631189 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] Creating event network-changed:affb1bc1-44c1-4d4a-8585-ea42399e0504 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:55:35.645767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ba26b6b3-3efb-488b-9f44-5cd5660ebdcb req-3ced3775-fd7e-4aff-b9b0-bec6d48aac6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107758 Oct 04 17:55:35.647489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 920/1715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:35.668917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:35.670065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:35.681356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.683266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.686419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.687425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.694057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.694712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.638795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:36.647888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de0098a2-bd2b-4d7f-8e8f-3e6bbd414de6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 0.998747 Oct 04 17:55:36.659484 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 921/1716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:35 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:37.079700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.084768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.084768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.084768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.087307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.087307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.087307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.162012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d05ec505-77f3-42ad-85cc-57ac16590255 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.503634 Oct 04 17:55:37.170848 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 922/1717] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:37.178875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.179609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:37.199213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.199936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.203379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.204674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.205187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.211460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.638357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.654634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.656441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.657849 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eeff15b0-a5fe-41da-89a0-0ae4ca5f5524 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.493826 Oct 04 17:55:37.671393 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 923/1718] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:37.680571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "tag": "3bb6df5d-cadb-4d33-a675-69118cc77537"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:37.695635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.696973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.697606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.712393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] Creating event network-changed:3bb6df5d-cadb-4d33-a675-69118cc77537 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:55:37.719484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-492a5ef2-f049-4d04-aa2c-6f09606b9558 req-ac6b2225-335c-4f8d-95eb-c03d41366473 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047953 Oct 04 17:55:37.720589 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 924/1719] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:37.729139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.730133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:37.739228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.740056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.741042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.741995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.743679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.744525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.017789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.028808 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bf19d9e-ba1e-4b31-bf8f-21336689f7c3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.306289 Oct 04 17:55:38.029678 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 925/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:38.038220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.039440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:38.051854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.052643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.053617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.054578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.056016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.058913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.323587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.332553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ccf5d93-f80f-4b6c-8ee0-b286fdac5280 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.301184 Oct 04 17:55:38.350763 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 926/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:38.356432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0763ff04-b85e-47e4-a9a9-76095d5b5fd1", "name": "network-vif-plugged", "status": "completed", "tag": "47bc100a-5f09-467f-b164-0431cc8a25ac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:38.367788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.369357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.370006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.383581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] Creating event network-vif-plugged:47bc100a-5f09-467f-b164-0431cc8a25ac for instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 on n-h1-831193-17 Oct 04 17:55:38.389320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-084afd51-2d9e-4931-be7e-b200921b05d6 req-c1ed1844-6ef5-40a9-90c4-d46b5bf93b89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Oct 04 17:55:38.390571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 927/1722] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:38.397804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.398827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:38.405901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.406817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.407849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.408881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.410851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.411592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.739702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.759596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d258cbc3-3f00-411a-b2b2-55d7432bfcdc tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1305 microversion: 2.1 time: 0.363807 Oct 04 17:55:38.760956 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 928/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:38.773001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.785431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.789659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.791831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.794300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.794870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.795401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.836328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd00942f-34f0-4410-9e78-422ca181b4a3 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-831193-17" status: 200 len: 581 microversion: 2.1 time: 0.073812 Oct 04 17:55:38.838060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 929/1724] 10.222.0.33 () {58 vars in 1174 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/os-services?host=n-d-831193-17 => generated 581 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:38.846047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.847165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:38.858145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.858990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.859682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.860649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.861334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.861886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.044345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.066759 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0ea9c0f-5444-4a57-b116-80d37563a3fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1308 microversion: 2.1 time: 0.224865 Oct 04 17:55:39.068712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 930/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:39.092153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e2e1c2-12d1-44f8-8e25-2edd3bfda603", "tag": "2c7e45ac-0665-45e3-bceb-b24d3a5f022b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:39.120080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.120689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.121137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.139347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] Creating event network-changed:2c7e45ac-0665-45e3-bceb-b24d3a5f022b for instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 on n-h2-831193-17 Oct 04 17:55:39.147717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7a32b5bb-da6b-4cb0-858f-9f0844bba599 req-7c73781e-2d77-4fdb-b7c1-45cc7f86ee9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076876 Oct 04 17:55:39.148349 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 931/1726] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:39.156123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:39.157042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:39.164365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.165189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.165838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.167114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.167866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.168522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.400863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.405446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:39.420468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.436060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.436060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4826f50-5950-4918-95bb-68361915f60b tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.277299 Oct 04 17:55:39.436060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 932/1727] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:39 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:39.438147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:39.443269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.444321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.444971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.446639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.447498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.448232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.487103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7174d1a-2e9a-4109-a94d-00f8a946502b tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054363 Oct 04 17:55:39.487936 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 933/1728] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 17:55:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:39.494083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:39.495201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:39.502554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.503581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.504212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.505310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.505959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.506612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.776828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.788479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-550c1b44-a811-4c22-af85-6fcd1afb987a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.299115 Oct 04 17:55:39.789382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 934/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:39 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:39.809484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:39.811418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:39.827546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.828283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.831345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.832389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.833039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.836378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.325562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:40.338052 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0281897d-14a5-4f8e-b333-604b11676bd4 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.544950 Oct 04 17:55:40.338632 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 935/1730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:39 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:40.353900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.361302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.361794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.364747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.366022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.369209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.376183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.454397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3ceb948-9442-4afd-aa48-acbc97694b56 tempest-ServicesAdminTestJSON-19016577 tempest-ServicesAdminTestJSON-19016577-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.114613 Oct 04 17:55:40.455063 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 936/1731] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/os-services => generated 949 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:40.474221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.474221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:40.477642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.479626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.480072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.480811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.481271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.481693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.853549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:40.866158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24e43142-7f52-47c0-a515-793eb79f2821 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1305 microversion: 2.1 time: 0.406895 Oct 04 17:55:40.871105 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 937/1732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1305 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:40.878766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.881150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:40.900217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.901053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.901676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.903287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.908709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.909345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.281235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.297661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13a59664-1aef-4a83-955f-4e35c1ca7f88 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1487 microversion: 2.1 time: 0.425235 Oct 04 17:55:41.302123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 938/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:41.327537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eb8fff-2237-43d4-9e47-14ebd914088d", "name": "network-vif-plugged", "status": "completed", "tag": "8be6f217-129a-4ce3-a1c9-41769d091d4c"}, {"server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "name": "network-vif-plugged", "status": "completed", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:41.368619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.369398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.369950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.413512 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Creating event network-vif-plugged:8be6f217-129a-4ce3-a1c9-41769d091d4c for instance f0eb8fff-2237-43d4-9e47-14ebd914088d on n-h2-831193-17 Oct 04 17:55:41.414599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] Creating event network-vif-plugged:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:55:41.453084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-779b5622-0bf1-4b7d-878f-ffa8c90faec4 req-aea518f9-b52d-4465-abd4-7f54e50de191 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.148887 Oct 04 17:55:41.454063 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 939/1734] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:41.459462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.460165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:41.478437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.478931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.479395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.480108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.480564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.480986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.870196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:41.986509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.990259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:41.996873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.998267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.999504 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d4ca7c3-d986-4a68-9a4a-1fa5493e31f7 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.544335 Oct 04 17:55:42.000159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 940/1735] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:42.022737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.026815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:42.034947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:42.040931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.057632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.058391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.059354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.059973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.060576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.347951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:42.357607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35fb1cda-90ee-454e-9bf5-f40856d66fbf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1313 microversion: 2.1 time: 0.356440 Oct 04 17:55:42.358659 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 941/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:42.364041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:42.364838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:42.389691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.390505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.391976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.392698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.393157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.396458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.561672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea94db85-814d-40dc-8161-dbfa8b1dd2cd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1/action" status: 202 len: 0 microversion: 2.1 time: 0.201310 Oct 04 17:55:42.571666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 942/1737] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:55:42 2022] POST /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:42.584002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.586071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:42.596452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.603339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.604016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.604883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.606570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.607008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.011771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.023254 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-842f153f-be6f-4439-bad1-78fb90dafb5b tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.449776 Oct 04 17:55:43.055244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 943/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:43.068444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.069099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:43.086722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.087260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.087702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.092941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.093718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.094475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.380310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.391011 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee590e46-e392-4031-bda6-3f644a60d85c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1305 microversion: 2.1 time: 0.333953 Oct 04 17:55:43.397214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 944/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:43.402604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.403561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:43.428121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.432187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.433031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.433963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.436136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.436773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.756636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.775627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc22e8c5-b4ec-4f6e-baae-b3b63900292c tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 200 len: 1472 microversion: 2.1 time: 0.376958 Oct 04 17:55:43.793646 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 945/1740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:43.806844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.807647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:43.816063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.816838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.817494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.818483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.819272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.819717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.572057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.593877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.602963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.605089 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-391f45cf-b918-4ae3-beb1-9c614b99d357 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.809168 Oct 04 17:55:44.607194 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 946/1741] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:44.651743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:44.652529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:44.665610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.666110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.666589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.667341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.671331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.672007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.954735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.969087 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38987c9a-01c9-4217-b850-f9d1645ed6f0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1463 microversion: 2.1 time: 0.360085 Oct 04 17:55:44.969698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 947/1742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:44.995915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-122533719"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:44.999680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:45.007731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.008574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.009675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.010597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.011681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.012340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.556673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11370e7a-8fb8-4567-8afd-d067da3ca451 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1/action" status: 202 len: 0 microversion: 2.1 time: 0.567142 Oct 04 17:55:45.559315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 948/1743] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:55:44 2022] POST /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:55:45.582064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.588726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:45.609133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.614774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.616648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.621220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.628486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.630344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.691557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:45.988184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.005080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72958add-4111-467f-ac6b-c49790b475e2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.439152 Oct 04 17:55:46.016094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 949/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.033740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.034507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.042898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.043422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.044302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.045418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.045947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.046823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.387571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.403600 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11749e97-fdac-48fb-9ca4-67c716fc5e01 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1305 microversion: 2.1 time: 0.378184 Oct 04 17:55:46.407140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 950/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1305 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.420034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.421584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.430306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.431800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.432400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.433565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.434491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.435257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.688547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.713727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c096ca14-8290-45c9-a070-08bd7a70bd29 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1463 microversion: 2.1 time: 0.304598 Oct 04 17:55:46.717140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 951/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1463 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.728535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eeba20f6-2313-4ae3-9d28-1fff774f2f47 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d87ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.814610 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eeba20f6-2313-4ae3-9d28-1fff774f2f47 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.092102 Oct 04 17:55:46.815576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 952/1747] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.841015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.841640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.861374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.864036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.864604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.865372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.867486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.870949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.139233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.166886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.168408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.169625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fd80a84-40f1-4f55-8664-2186fbe689de tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.339096 Oct 04 17:55:47.170388 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 953/1748] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:47.741761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1240635091", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:47.830484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:48.323276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:48.324097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:48.324696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:48.325241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:48.325905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:48.344564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:48.345147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:48.345687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:48.346575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:48.347321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:48.348447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:48.359550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=17 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:48.374119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:48.376820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:48.382436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:48.399921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:48.402274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:48.454399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06d76f8c-2e29-4de7-8e43-8ed094584be7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283028 Oct 04 17:55:48.455709 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 954/1749] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:48.461125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1240611385", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b8a67720-d954-40a2-aae5-71ae42c6d9f9"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:48.549305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:48.850850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:48.851575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:48.852168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:48.852492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:48.861172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:48.884751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:48.887622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:48.890504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:48.897631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:48.898522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:48.899738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:48.951713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:48.959878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Getting quotas for user 05c694e9eeb548fea9e2ec8a311c8485 and project d740fd379d8f4d3ca498d2ae25f383af. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:48.981416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:48.983969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:49.065576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac1fa729-d6eb-478f-8c60-3ab4c2d437cf tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605860 Oct 04 17:55:49.074452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 955/1750] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:49.086533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:49.087998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:49.097736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.098643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.099549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.100648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.101617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.102606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.419921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:49.432320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43288097-863f-4dca-a8d4-9f25c4469579 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.361873 Oct 04 17:55:49.451073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 956/1751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:49.459475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:49.460588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:49.469041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.469539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.469964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.472298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.472907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.473335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.686578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:49.702887 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e3d0cf4d-876c-4ca2-ab71-0bac47e05ef4 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.249374 Oct 04 17:55:49.704282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 957/1752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:49.860401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:49.866258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.868657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.870485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.872302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.873461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.874867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.923993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8ee81005-35a6-4dfa-96ec-d3a6f3e000ba tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.218318 Oct 04 17:55:49.924854 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 958/1753] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/os-services => generated 949 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:49.931106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "name": "network-vif-plugged", "status": "completed", "tag": "affb1bc1-44c1-4d4a-8585-ea42399e0504"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:49.942472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.943244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.943882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.966842 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] Creating event network-vif-plugged:affb1bc1-44c1-4d4a-8585-ea42399e0504 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:55:49.974334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e537d998-fa86-4b04-a949-e41c9859408d req-76214d8d-6881-42ca-84e4-2c8c03b9e733 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047467 Oct 04 17:55:49.976373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 959/1754] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:49.988039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aae35cdf-37fd-4c8f-978d-ec5737643ce0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63416dd0d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.071073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aae35cdf-37fd-4c8f-978d-ec5737643ce0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.090738 Oct 04 17:55:50.071816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 960/1755] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:50.079511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.080631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:50.091082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.091902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.092623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.093823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.094373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.094865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.316760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.334520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.337825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.344440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e2275d9-e230-4bd3-9ef9-a29bdba44539 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.270876 Oct 04 17:55:50.350575 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 961/1756] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:50.387225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.391762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:50.402118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.403109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.415722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.416929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.418121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.422723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.638241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.650542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ed4f06f-feab-444b-aaf1-0aadeac9882f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1267 microversion: 2.1 time: 0.297943 Oct 04 17:55:50.651211 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 962/1757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:50.682662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.685022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:50.698312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.698729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.701131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.701559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.702041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.702481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.844640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.854323 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4516edac-8390-45d0-8b30-e88d22afe9c9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1210 microversion: 2.1 time: 0.178078 Oct 04 17:55:50.859579 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 963/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:50.886341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.905309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.906106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.906556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.907375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.907881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.908312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.976691 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b781c79b-89bc-4a93-91f5-7096f783d207 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.113780 Oct 04 17:55:50.977990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 964/1759] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:50.988095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.992508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:51.006899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.010791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.011569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.014939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.015563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.017703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.911643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.923463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f251eca2-66db-4734-b518-5da9e838c33c tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.943983 Oct 04 17:55:51.939801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 965/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:51.955324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:51.956308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:51.970917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.976607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.977418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.978430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.979212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.980456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.425812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:52.437846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a2460e8-e2a5-4696-ab63-789b44f7e710 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.496523 Oct 04 17:55:52.443256 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 966/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:51 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:52.455952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.472501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.474194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.475278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.476564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.478106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.480589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.571690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fef2336-67ff-43e5-9bb0-ab98deda8e7a tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.126165 Oct 04 17:55:52.576604 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 967/1762] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/os-services => generated 949 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:52.590799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1a839aa-c188-40da-8602-3fd0084d8b2b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d678b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.706614 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1a839aa-c188-40da-8602-3fd0084d8b2b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.124706 Oct 04 17:55:52.708054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 968/1763] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:52.728344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.731244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:52.748289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.753359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.754971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.759959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.760490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.760966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.365405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.377857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.390277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.394831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9cf4761-0ded-4490-90a4-161f5dc1b766 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.676969 Oct 04 17:55:53.403278 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 969/1764] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:53.423599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.424450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.433939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.443050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.443710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.444584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.448215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.453568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.631370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.647352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bda63d90-ce58-440b-ba77-abd94c340bbe tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1273 microversion: 2.1 time: 0.240771 Oct 04 17:55:53.649937 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 970/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:53.667431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.668375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.676143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.679080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.679571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.680825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.681292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.681722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.796352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.809805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88465344-f292-4257-a38b-e4eefde8758a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1272 microversion: 2.1 time: 0.157144 Oct 04 17:55:53.811662 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 971/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:53.821686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "name": "network-vif-plugged", "status": "completed", "tag": "3bb6df5d-cadb-4d33-a675-69118cc77537"}, {"server_uuid": "0763ff04-b85e-47e4-a9a9-76095d5b5fd1", "name": "network-vif-plugged", "status": "completed", "tag": "47bc100a-5f09-467f-b164-0431cc8a25ac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:53.858044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.861894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.865180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.902349 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Creating event network-vif-plugged:3bb6df5d-cadb-4d33-a675-69118cc77537 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:55:53.905016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] Creating event network-vif-plugged:47bc100a-5f09-467f-b164-0431cc8a25ac for instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 on n-h1-831193-17 Oct 04 17:55:53.960968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b99dd986-1b12-4a65-8dd2-462b2bf7f493 req-fc053b49-6cd3-466f-bbe5-b55c2faba31a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.147732 Oct 04 17:55:53.964514 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 972/1767] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:54.000235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8ea762-4cf4-4934-a420-cab6da4c42b1", "name": "network-vif-unplugged", "status": "completed", "tag": "5bff0370-ae03-404d-8664-52aeac2685de"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:54.061952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.073309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.074000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.142608 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] Creating event network-vif-unplugged:5bff0370-ae03-404d-8664-52aeac2685de for instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 on n-h1-831193-17 Oct 04 17:55:54.184981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-606c1688-d3fd-4b81-bcfd-0630f86942d9 req-4057a5ca-1b05-4fdf-9165-20126753f1f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.216703 Oct 04 17:55:54.195202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 973/1768] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:54.246978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:54.277643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.279238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.279238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.282453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.284664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.287291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.308998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:54.373661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea794513-db05-43d6-885b-c5c1666d4ed9 tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-831193-17&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.175896 Oct 04 17:55:54.391183 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 974/1769] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Oct 4 17:55:54 2022] GET /compute/v2.1/os-services?host=n-d-831193-17&binary=xxx => generated 16 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:55:54.406953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:54.411292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:54.432929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.433836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.434936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.436718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.437857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.438514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.822008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:54.846992 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-149c3248-8a4b-4c05-951a-e476a5414515 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1334 microversion: 2.1 time: 0.464155 Oct 04 17:55:54.848543 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 975/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:54 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1334 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:54.854340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:54.855416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:54.897268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.901624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.903135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.913997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.919075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.920219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.524550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:55.533752 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb7d4093-baa3-422e-bfae-99c1ea3bf55b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.683836 Oct 04 17:55:55.544371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 976/1771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:54 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:55.544371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c167547e-fe2c-4d0f-80cd-f54c92f59e83 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d678b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:55.655725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c167547e-fe2c-4d0f-80cd-f54c92f59e83 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.116092 Oct 04 17:55:55.656695 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 977/1772] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:55:55 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:55.663639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:55.673357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.674228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.675906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.677048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.682317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.684024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.739919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9cf77252-2b7b-4162-aafd-a0674e76c80d tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.081758 Oct 04 17:55:55.742746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 978/1773] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:55 2022] GET /compute/v2.1/os-services => generated 949 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:55.767197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:55.768919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:55.781022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.782482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.783214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.787506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.788273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.788899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.065951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.088370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.092514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.096468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be019ffd-9ec3-46ec-8d04-6d6635c38e47 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.340797 Oct 04 17:55:56.097994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 979/1774] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:55 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:56.114146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.116277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:56.126879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.127738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.127955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.128927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.129726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.130491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.583299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.594837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb0e8bdd-8b62-419c-84d1-63fb116ca6c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1315 microversion: 2.1 time: 0.494805 Oct 04 17:55:56.595470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 980/1775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:56.602116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.602746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:56.614047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.614548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.615228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.616140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.616789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.617217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.875258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.910025 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aeaa1f57-3d77-4de1-9c0a-34c28c3f19cd tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.313471 Oct 04 17:55:56.916778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 981/1776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:56.931251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.943349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.943884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.944338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.947380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.947935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.948391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.000986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30197465-967d-42aa-9dcc-4a7cfd6c457e tempest-ServicesAdminNegativeTestJSON-211843457 tempest-ServicesAdminNegativeTestJSON-211843457-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.082925 Oct 04 17:55:57.002465 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 982/1777] 10.222.0.33 () {58 vars in 1198 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:55:57.007302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.010088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.033831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.034367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.038402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.039377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.039913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.040426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.317493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:57.327471 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3c20811-78d5-456e-a6c0-446d0e0f56c7 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1668 microversion: 2.1 time: 0.323861 Oct 04 17:55:57.328074 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 983/1778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:57.373150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5e07c3-69d8-4902-b286-a66bb8da5d20", "tag": "316357e8-289b-492a-b64e-3deb1652d605"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:57.389613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.390097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.390742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.404981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] Creating event network-changed:316357e8-289b-492a-b64e-3deb1652d605 for instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 on n-h1-831193-17 Oct 04 17:55:57.410591 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4b8d4d4a-6818-4bf2-8938-e2256bfda0af req-28c786f6-4545-44bf-a0fd-c556b396eb39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049065 Oct 04 17:55:57.415496 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 984/1779] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:57.421446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8ea762-4cf4-4934-a420-cab6da4c42b1", "tag": "5bff0370-ae03-404d-8664-52aeac2685de"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:57.432693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.433491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.434104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.454606 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] Creating event network-changed:5bff0370-ae03-404d-8664-52aeac2685de for instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 on n-h1-831193-17 Oct 04 17:55:57.460328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f4760df9-63b4-408b-90d4-7dc9a78d172b req-6ba85f75-9f3d-4766-8a24-0d7296e0edac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042965 Oct 04 17:55:57.461577 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 985/1780] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:57.473263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.474846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.484453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.484962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.485414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.486604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.487104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.487545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.685394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:57.698727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72a2635b-1096-428c-ba9e-15ba4005852c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.235595 Oct 04 17:55:57.699348 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 986/1781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:57.704253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44259c83-5503-46b1-abae-b670c80977dc tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345cdf160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.756381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44259c83-5503-46b1-abae-b670c80977dc tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.055876 Oct 04 17:55:57.757077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 987/1782] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:57.917193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba3283f9-0ee3-4e1d-9d5b-b861852a2b77 tempest-ServicesAdminNegativeTestJSON-1636949416 tempest-ServicesAdminNegativeTestJSON-1636949416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.923188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba3283f9-0ee3-4e1d-9d5b-b861852a2b77 tempest-ServicesAdminNegativeTestJSON-1636949416 tempest-ServicesAdminNegativeTestJSON-1636949416-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fc787f9e25284efb8d28f6eaad42cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b8037307704b9fa91ac90433144e1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba3283f9-0ee3-4e1d-9d5b-b861852a2b77 tempest-ServicesAdminNegativeTestJSON-1636949416 tempest-ServicesAdminNegativeTestJSON-1636949416-project] Request method failure captured: Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOi8XB4slXkYXZuTM0h052rhe304sfQqCbUEB60ZYG17KdvWq7BQEQH9llib76L_CJFJ8z4FmsBd6huIbxTtfTQ7V7EFwUE4otyR-q08T99WJECx2gdTGgiQWOsZgJ0606MZG_MeArqOdYu0vY6PTiwDHnWJgkG5cBKM6c5pOjAPQk Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 66b8037307704b9fa91ac90433144e1e Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1636949416 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66b8037307704b9fa91ac90433144e1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66b8037307704b9fa91ac90433144e1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66b8037307704b9fa91ac90433144e1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66b8037307704b9fa91ac90433144e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1636949416 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 66b8037307704b9fa91ac90433144e1e Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1636949416 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServicesAdminNegativeTestJSON-1636949416-project Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fc787f9e25284efb8d28f6eaad42cfa2 Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1636949416-project Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:55:57.929933 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba3283f9-0ee3-4e1d-9d5b-b861852a2b77 tempest-ServicesAdminNegativeTestJSON-1636949416 tempest-ServicesAdminNegativeTestJSON-1636949416-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba3283f9-0ee3-4e1d-9d5b-b861852a2b77 tempest-ServicesAdminNegativeTestJSON-1636949416 tempest-ServicesAdminNegativeTestJSON-1636949416-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.174035 Oct 04 17:55:57.943628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 988/1783] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:57.948771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.950240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.961079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.962697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.963487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.964708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.965880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.966603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.197545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.208146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.209599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.211148 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-710b4abe-1cd4-4b86-aa3e-6972348adeeb tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.275605 Oct 04 17:55:58.211754 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 989/1784] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:58.240640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.243243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.254643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.255448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.256182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.257082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.257710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.259157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.301866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2566d71f-4589-486e-a391-4f95ac511f7f tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e/ips" status: 200 len: 178 microversion: 2.1 time: 0.077417 Oct 04 17:55:58.307896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 990/1785] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e/ips => generated 178 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:58.322050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.326265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.337756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.339256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.340409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.341383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.342014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.343021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.804631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.821606 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5b92426-ce26-4b5b-86b0-abf3813af70e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1315 microversion: 2.1 time: 0.511853 Oct 04 17:55:58.822603 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 991/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:58.852445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.853081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.856543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:58.869929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.871627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.872084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.872819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.873286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.873716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.972278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:59.624642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:59.661481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-202bfe7a-d78c-4f40-b091-bf1296402a82 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.821166 Oct 04 17:55:59.664871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 992/1787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:59.678906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:59.681308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:59.699877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.700685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.701301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.704661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.705491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.708330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.768021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:59.933929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad20d81b-a524-4a18-852f-27f1a898bbed tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 204 len: 0 microversion: 2.1 time: 0.267586 Oct 04 17:55:59.934907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 993/1788] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:59 2022] DELETE /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:59.941151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:59.946468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:59.955075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.955873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.956391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.957198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.957753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.958294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.325724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.350453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb8f6a31-8ebd-4d3d-bd2d-55aeec68bbe6 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.413715 Oct 04 17:56:00.351393 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 994/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:59 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:00.363108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58a91553-5692-4b14-875d-750b97b691ac tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d3b940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:00.543650 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58a91553-5692-4b14-875d-750b97b691ac tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.190540 Oct 04 17:56:00.545463 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 995/1790] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:00 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:00.574800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:00.576175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:00.594385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.595231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.595951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.597121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.597967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.598592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.976922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.982222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:00.990022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.991967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.994122 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0212e1ab-7a6c-463c-8d02-0f0ca6c37179 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.443845 Oct 04 17:56:00.995459 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 996/1791] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:00 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:01.001698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730cb606-e8a8-4990-81fa-1909b721fa96", "tag": "31876ec8-28a9-4594-ba89-50fc196c5992"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:01.014409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.015714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.016427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.035310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] Creating event network-changed:31876ec8-28a9-4594-ba89-50fc196c5992 for instance 730cb606-e8a8-4990-81fa-1909b721fa96 on n-h1-831193-17 Oct 04 17:56:01.043733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-967a57f3-1767-417a-b10a-0700ed513cc4 req-bcf1bba9-bf70-45d3-b052-15075fe3d27c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045336 Oct 04 17:56:01.048959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 997/1792] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:01.056167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:01.057307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:01.067770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.068805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.069578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.070643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.072107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.073155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.323859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.336086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-622c3e72-35b8-4f81-88a6-2cba44ea3581 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1315 microversion: 2.1 time: 0.285497 Oct 04 17:56:01.340282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 998/1793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:01.353243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:01.354540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:01.362721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.363659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.364686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.365840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.366596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.367297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.670980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.681050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0eac0e94-acb1-44f3-8f34-5618f67ceb05 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1674 microversion: 2.1 time: 0.338284 Oct 04 17:56:01.685963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 999/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1674 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:01.692792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e2e1c2-12d1-44f8-8e25-2edd3bfda603", "name": "network-vif-plugged", "status": "completed", "tag": "2c7e45ac-0665-45e3-bceb-b24d3a5f022b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:01.741268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.742512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.743759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.771395 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] Creating event network-vif-plugged:2c7e45ac-0665-45e3-bceb-b24d3a5f022b for instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 on n-h2-831193-17 Oct 04 17:56:01.782771 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c90f26ef-7bf1-45eb-8184-0ba5035be412 req-31c92ac4-3425-441f-bbd5-83c3353e40e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092944 Oct 04 17:56:01.785594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1000/1795] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:01.795354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:01.797171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:01.814788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.819053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.822404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.827172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.828045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.829082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.065006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.080033 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ef16c3e-78bc-45de-96db-bed3db86aaf4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.287275 Oct 04 17:56:02.081988 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1001/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:02.095065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.096504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.109614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.110489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.112383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.113385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.114033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.115165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.424424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.437928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58853be5-0505-4562-b8ae-5cd4a6e69d0b tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1293 microversion: 2.1 time: 0.351177 Oct 04 17:56:02.457725 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1002/1797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1293 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:02.469099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-56cf4d92-3624-4a01-b4bb-0235d74200c8 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d005e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.554233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-56cf4d92-3624-4a01-b4bb-0235d74200c8 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.095044 Oct 04 17:56:02.564000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1003/1798] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:02.570108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.570971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.582567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.583387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.586083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.588690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.589347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.589910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.952821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.967752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.967752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.969242 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45058202-5d23-4339-b4fd-26e3939e3f64 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.403700 Oct 04 17:56:02.969844 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1004/1799] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:02.988349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.988980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.016796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.017315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.017766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.018643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.018961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.019418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.484304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.496409 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9b7d508-5b47-4ccc-a876-df4eef56182a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1315 microversion: 2.1 time: 0.522637 Oct 04 17:56:03.496409 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1005/1800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:03.518672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.519560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.531235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.532286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.532928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.533871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.534720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.535570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.924343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860db374eab0453d96c6a14e71134b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79ad7bb006342c5a55112a4d04d4ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.951719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73452e47-179b-4983-983f-1b8bf8de9516 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 200 len: 1653 microversion: 2.1 time: 0.454134 Oct 04 17:56:03.952698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1006/1801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 1653 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:03.982575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "name": "network-vif-deleted", "tag": "3bb6df5d-cadb-4d33-a675-69118cc77537"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:04.050446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.050967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.055716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.092748 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] Creating event network-vif-deleted:3bb6df5d-cadb-4d33-a675-69118cc77537 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:56:04.128205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f4b80749-e779-4b63-823c-76f917f23e54 req-25d14bb5-d5b5-4425-9d59-bf9fd75ab864 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150959 Oct 04 17:56:04.131763 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1007/1802] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:04.151382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.152695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.173703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.174212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.176254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.181399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.182166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.183277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.453603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.474239 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e8278b8-f2ef-44d0-bb9f-f9341af8d8f7 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.338756 Oct 04 17:56:04.476630 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1008/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:04.495474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.497627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.507567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.509150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.509984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.510932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.511600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.512111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.813194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.840993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5fa942e-948b-45cf-ac90-18011690386d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1484 microversion: 2.1 time: 0.360518 Oct 04 17:56:04.844170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1009/1804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1484 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:04.866427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe8e1bca-a52c-4fae-b46c-a1721259078b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d3bee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.948042 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fe8e1bca-a52c-4fae-b46c-a1721259078b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.101155 Oct 04 17:56:04.949221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1010/1805] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:04.954503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5e07c3-69d8-4902-b286-a66bb8da5d20", "name": "network-vif-plugged", "status": "completed", "tag": "316357e8-289b-492a-b64e-3deb1652d605"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:04.972752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.973270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.974983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.003000 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] Creating event network-vif-plugged:316357e8-289b-492a-b64e-3deb1652d605 for instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 on n-h1-831193-17 Oct 04 17:56:05.018251 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-52eb1f28-0138-4d7e-9e47-612e2ffca210 req-344ac234-f5c1-47ca-b9ad-8cca3bd2763b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067171 Oct 04 17:56:05.020795 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1011/1806] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:05.036608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.052425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.064202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.065157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.066517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.068112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.069208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.070485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.321910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.340453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.341919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.343158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2b447de-1a18-40f6-b64a-4498ab1d0884 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1486 microversion: 2.25 time: 0.316184 Oct 04 17:56:05.347862 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1012/1807] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1486 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:05.352893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.353737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.360395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.361088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.361738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.362640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.363305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.363919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.642187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.651693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-caa32c64-5dab-4474-bf08-0deab86f5a51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1315 microversion: 2.1 time: 0.302457 Oct 04 17:56:05.672015 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1013/1808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:05.677304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.677812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.691654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.692451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.692904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.693623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.694274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.694872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.784490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83f26065-f0ee-418e-850e-c4b318eabb7f tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110958 Oct 04 17:56:05.785096 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1014/1809] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:05.798461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.799342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.806010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.806742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.807379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.808295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.808924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.809523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.826695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e HTTP/1.1 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ea2ba04a-9143-41bf-b180-9e42df73683e'} Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:05.828603 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:05.834068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:05.836001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:05.837986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db1e1af5-66a6-45f0-8d93-bb13710ffcb2 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 404 len: 111 microversion: 2.1 time: 0.043704 Oct 04 17:56:05.840794 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1015/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:05.848794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.849420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.856568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.857075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.857743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.858640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.859295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.859900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.215444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:06.224347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96d63a47-2328-4519-adb3-862315772736 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.379318 Oct 04 17:56:06.230251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1016/1811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:06.236005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c6bec12-1255-4c44-b378-ea6a39e2099a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345e2cdc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:06.294710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c6bec12-1255-4c44-b378-ea6a39e2099a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.062450 Oct 04 17:56:06.296303 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1017/1812] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:06 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:06.309648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ba04a-9143-41bf-b180-9e42df73683e", "name": "network-vif-deleted", "tag": "affb1bc1-44c1-4d4a-8585-ea42399e0504"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:06.337561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:06.338237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:06.338867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.356550 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] Creating event network-vif-deleted:affb1bc1-44c1-4d4a-8585-ea42399e0504 for instance ea2ba04a-9143-41bf-b180-9e42df73683e on n-h2-831193-17 Oct 04 17:56:06.362522 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c512a3de-444d-4c13-b9f0-3cef17f093d5 req-65747d1e-ffd1-4f71-883e-e241cec453ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062178 Oct 04 17:56:06.363598 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1018/1813] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:06.385115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:06.386163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:06.395169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:06.395941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:06.396552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.397428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:06.398040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:06.398629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.959452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:07.076163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:07.090882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:07.104816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:07.109352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3bfa0ea-cd05-43b1-89ed-866ed51e1d6a tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1476 microversion: 2.25 time: 0.730480 Oct 04 17:56:07.110952 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1019/1814] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:06 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1476 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:07.124520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:07.125146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:07.140031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:07.140531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:07.140975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:07.146112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:07.146617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:07.147079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.304869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:08.309246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:08.322963 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-653a78d0-4a30-4b01-a65d-29cef3c68e0c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1503 microversion: 2.1 time: 1.209128 Oct 04 17:56:08.324668 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1020/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:07 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1503 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:08.335731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbffe565-0af9-4c28-940a-dd030d579056 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '.version_select at 0x7f6345ca7e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:08.343461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbffe565-0af9-4c28-940a-dd030d579056 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.343955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbffe565-0af9-4c28-940a-dd030d579056 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.346656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbffe565-0af9-4c28-940a-dd030d579056 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.375088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbffe565-0af9-4c28-940a-dd030d579056 tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2986 microversion: 2.25 time: 0.047418 Oct 04 17:56:08.378025 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1021/1816] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 17:56:08 2022] GET /compute/v2.1/os-migrations => generated 2986 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:08.391377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:08.395428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:08.417144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.417952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.418557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.419564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.423814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.424530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.016843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:09.049713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59fa854e-60c8-4bc7-a412-1598ec0637b9 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.670267 Oct 04 17:56:09.060444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1022/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:08 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:09.074602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730cb606-e8a8-4990-81fa-1909b721fa96", "name": "network-vif-plugged", "status": "completed", "tag": "31876ec8-28a9-4594-ba89-50fc196c5992"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:09.113735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.114219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.114653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.146868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] Creating event network-vif-plugged:31876ec8-28a9-4594-ba89-50fc196c5992 for instance 730cb606-e8a8-4990-81fa-1909b721fa96 on n-h1-831193-17 Oct 04 17:56:09.169368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8bd6002b-5cc6-408d-a4a6-f6c7979b67c9 req-fe4dc5e8-ccca-4aa5-9273-abdd917150a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107402 Oct 04 17:56:09.170784 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1023/1818] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:09.176517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3fe637a-4ca6-479a-8e85-00b9be9acb2e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345ca7e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:09.309004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3fe637a-4ca6-479a-8e85-00b9be9acb2e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1413 microversion: 2.1 time: 0.136635 Oct 04 17:56:09.309674 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1024/1819] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:09 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:09.322584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:09.327188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:09.341278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.345465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.346048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.347101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.350977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.352541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.423674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:09.591822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69830224-8855-461b-9215-f7228e86e79e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 204 len: 0 microversion: 2.1 time: 0.277231 Oct 04 17:56:09.598579 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1025/1820] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:09 2022] DELETE /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:09.606659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:09.608821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:09.616086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.617425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.618157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.619818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.620502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.621130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.940389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] Lazy-loading 'services' on Instance uuid eb8ea762-4cf4-4934-a420-cab6da4c42b1 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:09.979430 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-877faaca-f3ac-4a87-8586-4d8a5e698a0a tempest-LiveAutoBlockMigrationV225Test-2145399284 tempest-LiveAutoBlockMigrationV225Test-2145399284-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1971 microversion: 2.25 time: 0.374681 Oct 04 17:56:09.981617 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1026/1821] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:09 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1971 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:10.004816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.004816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.023994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.024326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.024766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.025555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.025957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.026391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.342706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.351770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5be5b009-dfec-4220-b82f-91867ac5551f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1509 microversion: 2.1 time: 0.363337 Oct 04 17:56:10.355890 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1027/1822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:09 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:10.361370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.362210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.369373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.370143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.370813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.371883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.372573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.373230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.401681 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e HTTP/1.1 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ea2ba04a-9143-41bf-b180-9e42df73683e'} Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:10.404268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:10.408760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:10.410993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:10.412173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5af4d8a0-a2a0-4ba8-b8a5-1138691d819a tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 404 len: 111 microversion: 2.1 time: 0.054782 Oct 04 17:56:10.413341 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1028/1823] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:10 2022] DELETE /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:10.420270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.421356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.428276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.429298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.430035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.430992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.432199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.432876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.797328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.806454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e764e47-6910-4d44-b401-3bbfb15a9c68 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1484 microversion: 2.1 time: 0.391780 Oct 04 17:56:10.827055 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1029/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:10 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1484 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:10.832782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e2e1c2-12d1-44f8-8e25-2edd3bfda603", "tag": "2c7e45ac-0665-45e3-bceb-b24d3a5f022b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:10.847230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.847716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.848153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.863465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] Creating event network-changed:2c7e45ac-0665-45e3-bceb-b24d3a5f022b for instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 on n-h2-831193-17 Oct 04 17:56:10.868970 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a79c9b72-8bcd-466f-a365-8de93a6d35dd req-7c234ca7-6923-4468-bac8-d75b6893b280 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040215 Oct 04 17:56:10.870051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1030/1825] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:10.875520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.876084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.895426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.895791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.896241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.896978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.897439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.897869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.958959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:11.094104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e6ed5b9-e6b6-43b4-95f9-a68848b2cb9e tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 204 len: 0 microversion: 2.25 time: 0.222576 Oct 04 17:56:11.094721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1031/1826] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:56:10 2022] DELETE /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:56:11.107506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.109401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:11.120110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.121408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.122232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.123474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.124198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.124853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.317797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:11.332010 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c1aa31b2-b68c-4270-aabf-f78b45df1f0f tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1314 microversion: 2.1 time: 0.229510 Oct 04 17:56:11.333631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1032/1827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:11.339369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b265eb74-490c-42ea-94da-fe1b817bd84a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d678b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.417650 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b265eb74-490c-42ea-94da-fe1b817bd84a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1422 microversion: 2.1 time: 0.082636 Oct 04 17:56:11.418689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1033/1828] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:11.424669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.425900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: ea2ba04a-9143-41bf-b180-9e42df73683e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:11.432629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.433630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.434274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.435947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.436652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.437314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.457088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e HTTP/1.1 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ea2ba04a-9143-41bf-b180-9e42df73683e'} Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:11.459196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. Oct 04 17:56:11.464490 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:11.468067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance ea2ba04a-9143-41bf-b180-9e42df73683e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:11.469899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5653c195-3d78-472d-bcec-9ed07271332d tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e" status: 404 len: 111 microversion: 2.1 time: 0.049179 Oct 04 17:56:11.471783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1034/1829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/servers/ea2ba04a-9143-41bf-b180-9e42df73683e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:11.479513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.480534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:11.489088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.490031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.490721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.493150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.493946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.494616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.752820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:11.764254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:11.774971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:11.786367 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70bd7a5d-802a-4e08-a38b-dd8ca24b46ad tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1482 microversion: 2.25 time: 0.309379 Oct 04 17:56:11.789200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1035/1830] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1482 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:11.806918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.807671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:11.834620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.835179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.835624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.837401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.837872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.838487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.192633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.209241 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f63f844-3e3e-42aa-882b-937cc34fbffa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 200 len: 1509 microversion: 2.1 time: 0.418847 Oct 04 17:56:12.210039 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1036/1831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 1509 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:12.216223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4474fc10-5f66-44f8-a9b7-436951a255ec tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345d00ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:12.301629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4474fc10-5f66-44f8-a9b7-436951a255ec tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 200 len: 1422 microversion: 2.1 time: 0.088374 Oct 04 17:56:12.302636 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1037/1832] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:12 2022] GET /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:12.317595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:12.318948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:12.331509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.332146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.332689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.333518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.334082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.334634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.374514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c HTTP/1.1 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'cd347e55-e148-43a7-a259-fbf75ed9036c'} Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:12.381119 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:12.386298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17b39794-78db-43ce-b2fb-3d555be838df tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 404 len: 111 microversion: 2.1 time: 0.079420 Oct 04 17:56:12.390424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1038/1833] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:12 2022] DELETE /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:12.424768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-160bcbef-36b6-4c55-a43a-99a23158f509 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f634258a040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.570639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-160bcbef-36b6-4c55-a43a-99a23158f509 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 204 len: 0 microversion: 2.1 time: 1.178536 Oct 04 17:56:13.574356 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1039/1834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:12 2022] DELETE /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:13.576866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.577645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:13.597055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.598279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.600273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.603157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.605953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.607470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.872831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:13.885525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91f1c845-f2bc-4d9c-a9da-ce137218a548 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1464 microversion: 2.1 time: 0.311001 Oct 04 17:56:13.903886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1040/1835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:13.926281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.927533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] [instance: cd347e55-e148-43a7-a259-fbf75ed9036c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:13.940238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.940924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.941480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.942303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.943102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.944765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.979289 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] HTTP exception thrown: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Request method failure captured: Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c HTTP/1.1 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHMoli0H1Ny3vAMzaFlV8w6VaLP7HXcdLMrT0Eso6xx-EJBe2f492kmi_zRgUIlgoOqxszrjIZZXoiE-o5y55QFTtGipKoyru4zzhq5gpknQykZbzSFZAXE-JtLVclnpBoj_fjpBRfWFQTmeXVWbOiUhVrrYRUx9JWpqIvjnj4EFIEM Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f79ad7bb006342c5a55112a4d04d4ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f79ad7bb006342c5a55112a4d04d4ce4 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestMultiNic-2085834284 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 860db374eab0453d96c6a14e71134b48 Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestMultiNic-2085834284-project Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'cd347e55-e148-43a7-a259-fbf75ed9036c'} Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:13.981429 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. Oct 04 17:56:13.986169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:13.989363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] Returning 404 to user: Instance cd347e55-e148-43a7-a259-fbf75ed9036c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:13.990550 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44fd6676-d0d9-4192-b470-7fbac18b2232 tempest-ServersTestMultiNic-2085834284 tempest-ServersTestMultiNic-2085834284-project] 10.222.0.33 "GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c" status: 404 len: 111 microversion: 2.1 time: 0.085336 Oct 04 17:56:13.992898 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1041/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/cd347e55-e148-43a7-a259-fbf75ed9036c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:13.999845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.000907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:14.008114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:14.012041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.012870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.014594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.015744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.016451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.017109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.042554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:14.123260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.133919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.136418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.138168 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b68e30bd-6302-48fb-bceb-375762bb9b50 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1266 microversion: 2.25 time: 0.143906 Oct 04 17:56:14.139364 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1042/1837] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:14.144917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8ea762-4cf4-4934-a420-cab6da4c42b1", "name": "network-vif-deleted", "tag": "5bff0370-ae03-404d-8664-52aeac2685de"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:14.157816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.158738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.159495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.175486 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] Creating event network-vif-deleted:5bff0370-ae03-404d-8664-52aeac2685de for instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 on n-h2-831193-17 Oct 04 17:56:14.181962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c6777c5e-f610-4121-b969-52fcc4292c99 req-663fb156-712a-4f6a-9290-fe9f1aff19a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041151 Oct 04 17:56:14.183781 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1043/1838] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:14.191292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5e07c3-69d8-4902-b286-a66bb8da5d20", "name": "network-vif-deleted", "tag": "316357e8-289b-492a-b64e-3deb1652d605"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:14.209483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.209980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.210612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.228919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] Creating event network-vif-deleted:316357e8-289b-492a-b64e-3deb1652d605 for instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 on n-h1-831193-17 Oct 04 17:56:14.234383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-954de5cc-d956-4aad-b80f-ac266970bd86 req-00c4b902-d38d-4276-b616-a886536ea727 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049208 Oct 04 17:56:14.235446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1044/1839] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:14.240986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.242029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:14.250990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.251681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.252224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.253368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.253935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.254478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.273046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 HTTP/1.1 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f5e07c3-69d8-4902-b286-a66bb8da5d20'} Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:14.278275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ede9ff7-8e94-4dfd-ab17-2e083903b599 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 404 len: 111 microversion: 2.1 time: 0.043847 Oct 04 17:56:14.293564 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1045/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:14 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:14.295063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.295333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:14.308785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.311649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.312353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.313744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.314570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.315521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.374007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:14.489544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08545a13-cfa9-4806-91cd-cec1c86e99bb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 204 len: 0 microversion: 2.1 time: 0.204687 Oct 04 17:56:14.490995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1046/1841] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:14 2022] DELETE /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:14.802547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.819558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'deleted': False, 'project_id': 'd1916792cb08498fbd888223c536a43d'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:14.827625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.832105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.833459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.834566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.840336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.842183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.986684 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1eaeff6-9166-40f2-bc72-6517099ddb31 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.494008 Oct 04 17:56:15.003690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1047/1842] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:56:14 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:15.008885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-3028048", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:15.097384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:15.688827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:15.689259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:15.689754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:15.690177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:15.690597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:15.705074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:15.705573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:15.706022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:15.706788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:15.707591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:15.708364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:15.734307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:15.743743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:15.760718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:15.764302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:15.842912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0a89991-a1f8-4c2a-b774-2099051ce0b7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837950 Oct 04 17:56:15.844881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1048/1843] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:15.850541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1512048295", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:15.988425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] validate_networks() for [('c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:17.292161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:17.292986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:17.293201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:17.293857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:17.294199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:17.313672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.314247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.314762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.315637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.316158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.316669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.358175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:17.364900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for user 242be122e02f4be3abdd0e7a989764b4 and project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:17.382470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:17.386278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:17.443293 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3dc0347f-1b69-4239-a9cf-ce6fbc3dc13b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596630 Oct 04 17:56:17.451372 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1049/1844] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:17.457256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0763ff04-b85e-47e4-a9a9-76095d5b5fd1", "name": "network-vif-unplugged", "status": "completed", "tag": "47bc100a-5f09-467f-b164-0431cc8a25ac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:17.469811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.470598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.473644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.487989 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] Creating event network-vif-unplugged:47bc100a-5f09-467f-b164-0431cc8a25ac for instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 on n-h1-831193-17 Oct 04 17:56:17.495926 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ffa20852-0aaa-4ec5-8b9e-69650783296c req-a6284d90-b425-4edc-a112-acdc61ead01d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042820 Oct 04 17:56:17.497243 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1050/1845] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:17.502460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:17.511982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'deleted': False} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:17.523687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.524518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.525162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.527423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.528121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.529101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.717778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Listed batch of 13 results from cell out of 999 limit. Returned 13 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:18.439846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:18.440503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:18.440791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.736107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-423c2d65-82e7-4b81-89de-2c2e05d0f457 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22404 microversion: 2.1 time: 2.237365 Oct 04 17:56:19.739695 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1051/1846] 10.222.0.33 () {58 vars in 1171 bytes} [Tue Oct 4 17:56:17 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22404 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:56:19.758792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.762697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.788503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.789026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.790095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.792213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.797716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.800855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.289761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.300116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.301304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.302521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ba58bf9-8fc1-4db5-8917-d1d579be5162 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 200 len: 1266 microversion: 2.25 time: 0.561284 Oct 04 17:56:20.326929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1052/1847] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 1266 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:20.342288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:20.345230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:20.382409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.382938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.384034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.389128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.390185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.393106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.905472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.947908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c4f9253-8aa8-40f7-9d04-488c0130744b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1312 microversion: 2.1 time: 0.618666 Oct 04 17:56:20.949557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1053/1848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:20 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1312 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:21.121375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1207438926", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "f1910403-b938-46c6-9410-6aee49e8eda5"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:21.205997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] validate_networks() for [('f1910403-b938-46c6-9410-6aee49e8eda5', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:22.479421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:22.481437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:22.482297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:22.482927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:22.483577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:22.495798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.496303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.496748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.497707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.498181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.498690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.533720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Getting quotas for project a26840318c34415fac60a8abe5d38cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:22.541376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Getting quotas for user a3327843b78c4dce80928d2752e01705 and project a26840318c34415fac60a8abe5d38cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:22.558520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:22.562501 n-d-831193-17 devstack@n-api.service[128770]: WARNING nova.utils [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1207438926 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-120743892 Oct 04 17:56:22.564424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:22.658183 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7788f29b-ed7e-4f80-92d1-a2df0e48a729 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708169 Oct 04 17:56:22.659151 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1054/1849] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:22.664847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:22.666036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:22.674391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.675090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.675887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.676990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.677647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.678980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.953756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.968758 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee4496ad-3bac-40ba-b9a5-92fa386ec373 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.307117 Oct 04 17:56:22.970334 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1055/1850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:22 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:22.987737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0763ff04-b85e-47e4-a9a9-76095d5b5fd1", "name": "network-vif-deleted", "tag": "47bc100a-5f09-467f-b164-0431cc8a25ac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:23.012891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.017977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.018686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.051490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] Creating event network-vif-deleted:47bc100a-5f09-467f-b164-0431cc8a25ac for instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 on n-h1-831193-17 Oct 04 17:56:23.065887 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e65e8a53-d45d-4bb6-a7c0-4fe1bffd62a3 req-207a0782-4148-48f2-851a-9313ca4df845 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089853 Oct 04 17:56:23.069247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1056/1851] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:23.080386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.096566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'deleted': False, 'project_id': 'd1916792cb08498fbd888223c536a43d'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:23.128185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.128756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.129256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.129872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.130338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.130775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.188553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d7e7ae2-8b45-4e0d-a44c-29844cf5bdfe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=d740fd379d8f4d3ca498d2ae25f383af" status: 200 len: 15 microversion: 2.1 time: 0.117889 Oct 04 17:56:23.203462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1057/1852] 10.222.0.33 () {58 vars in 1231 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/detail?tenant_id=d740fd379d8f4d3ca498d2ae25f383af => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:23.211263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.212341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: eb8ea762-4cf4-4934-a420-cab6da4c42b1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.220690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.221528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.222148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.223095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.223774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.224418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.242118 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] HTTP exception thrown: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Request method failure captured: Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 HTTP/1.1 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIPLcYqj9bUofWMwrzhRlO4Jtp1VGcsDDjRUnwjxReLmbbeXqvgfq652ptWlmL9VvZJw6cnsxuBWNPQVGdB2Mrs8zd3sGbVpEmnc2VZwG8TINhmelWwZBh_fIfdocygatnWjDoKoLpgIwGpe-Rct5tJsPbOYMm6rJN65x9NYTvYI-k Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9704eb841a9845948b9b01555c7051c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ee53a080f77a44f8aac80b34c1dd179e Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'eb8ea762-4cf4-4934-a420-cab6da4c42b1'} Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. Oct 04 17:56:23.245036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. Oct 04 17:56:23.249547 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:23.252075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Returning 404 to user: Instance eb8ea762-4cf4-4934-a420-cab6da4c42b1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:23.253265 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70718136-f19b-4767-8332-dd4b2e0955c6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1" status: 404 len: 111 microversion: 2.25 time: 0.048748 Oct 04 17:56:23.258080 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1058/1853] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/eb8ea762-4cf4-4934-a420-cab6da4c42b1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:56:23.266236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.266947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.274569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.275246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.275763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.276601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.277136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.277641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.762241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:23.775465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68a821a6-acb5-400e-bb84-d1a939266fa3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1312 microversion: 2.1 time: 0.514635 Oct 04 17:56:23.776286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1059/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:23.785536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.787759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.803506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.804189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.805467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.806361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.806995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.807598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.966147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.001051 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc745369-8008-4d11-88ce-6fc5e1212fb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1236 microversion: 2.1 time: 0.221993 Oct 04 17:56:24.001666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1060/1855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1236 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:24.020914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:24.036543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'tenant_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'deleted': False} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:24.054633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.055870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.056896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.057903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.058375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.062964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.145337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:24.299005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.300068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.300713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.947227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-655aaf8b-3aa7-4374-b3e5-3846d2175a40 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d740fd379d8f4d3ca498d2ae25f383af" status: 200 len: 4832 microversion: 2.1 time: 0.944400 Oct 04 17:56:24.948172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1061/1856] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 17:56:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d740fd379d8f4d3ca498d2ae25f383af => generated 4832 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:24.953391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf2603f-013e-44ee-af43-849d98b3f91b", "tag": "194d7870-4128-4b1c-8c84-713d1eed2d1c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:24.965594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.966339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.967267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.980810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] Creating event network-changed:194d7870-4128-4b1c-8c84-713d1eed2d1c for instance ddf2603f-013e-44ee-af43-849d98b3f91b on n-h2-831193-17 Oct 04 17:56:24.986043 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b55c74a8-5b51-442c-be3d-a416764c7bb6 req-7337d4eb-44e8-4817-83ed-5ac437c8cb0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036041 Oct 04 17:56:24.987232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1062/1857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:24.993422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:24.994402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:25.001452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.002226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.003023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.003974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.004606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.005201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.284693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.295482 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b25faf57-e7cb-4e38-9a54-85dfbdd63ae6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.306653 Oct 04 17:56:25.307196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1063/1858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:24 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:25.319936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.321863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:25.340673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:25.344172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.344690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.349250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.350083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.350573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.351015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.369125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:25.650587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.662355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5048ffd-d359-4ac8-bf80-19a53ee66e24 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1312 microversion: 2.1 time: 0.363613 Oct 04 17:56:25.674131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1064/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:25.692618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.713218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'tenant_id': 'd1916792cb08498fbd888223c536a43d', 'deleted': False} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:25.721659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.723071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.723768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.725375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.726056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.726973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.776876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cc8efe2-04ae-4385-ba7f-66d41dfd36d5 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d1916792cb08498fbd888223c536a43d" status: 200 len: 15 microversion: 2.1 time: 0.101053 Oct 04 17:56:25.778398 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1065/1860] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d1916792cb08498fbd888223c536a43d => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:25.784350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.785346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:25.793597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.794527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.795369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.796398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.797115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.797861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.894965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.913305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6cadcfa-b47a-4a99-a08d-93a7fdd93be1 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1290 microversion: 2.1 time: 0.125403 Oct 04 17:56:25.922852 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1066/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:25.942685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cbd653-fc5d-4603-9453-436e2600734d", "tag": "ddb80283-d809-48d3-9d32-598a63b95679"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:25.962681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.964056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.964748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.980599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] Creating event network-changed:ddb80283-d809-48d3-9d32-598a63b95679 for instance 03cbd653-fc5d-4603-9453-436e2600734d on n-h1-831193-17 Oct 04 17:56:25.988238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9c3d3ff5-dbc5-44d9-a719-134409bcb317 req-8f3b5682-6dc0-4bb3-b89b-3c304acffdef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061855 Oct 04 17:56:25.989884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1067/1862] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:25.998455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-395e44b2-3f01-4c28-a8e7-73650f56eeba tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.022822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-395e44b2-3f01-4c28-a8e7-73650f56eeba tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.030964 Oct 04 17:56:26.024462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1068/1863] 10.222.0.33 () {58 vars in 1189 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:26.050238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:26.053263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:26.061524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.062355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.063178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.064266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.064986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.065656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.214170 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db9c300d-6dd1-4094-a6d1-50efa1b8ed6e tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 0 microversion: 2.1 time: 0.168224 Oct 04 17:56:26.215405 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1069/1864] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:26 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:56:26.223856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.233605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:26.236109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:26.247231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.248145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.250126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.251726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.257002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.257340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.485028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:26.667446 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2322fd00-840c-4e88-a513-f0c4e7f26040 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.447930 Oct 04 17:56:26.668845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1070/1865] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:56:26.681683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.682381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:26.715055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.719743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.720327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.721337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.721885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.731464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.160304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:27.178748 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5e193d9-d322-40ad-b7dd-9c5e63440d61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.508232 Oct 04 17:56:27.179377 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1071/1866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:27.206079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:27.212051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.229721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.230973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.231442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.232175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.233254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.233711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.436347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dca495f4-6c7a-4613-bed1-e5d4827c2687 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 0 microversion: 2.1 time: 0.250500 Oct 04 17:56:27.440491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1072/1867] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:27 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:27.453560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.455671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.468428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.469647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.470971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.473898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.478538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.480330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.885939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:27.900728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7d0d0d9d-5d2e-4c6f-9d64-5d872e429673 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1312 microversion: 2.1 time: 0.455514 Oct 04 17:56:27.910291 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1073/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:27.923334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.924081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.941849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.942743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.943450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.945904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.946518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.947140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.162041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:28.174718 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39919681-58e9-4e8d-b637-ed05e8698104 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1332 microversion: 2.1 time: 0.263029 Oct 04 17:56:28.176108 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1074/1869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1332 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.182101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cbd653-fc5d-4603-9453-436e2600734d", "name": "network-vif-plugged", "status": "completed", "tag": "ddb80283-d809-48d3-9d32-598a63b95679"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:28.195997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.195997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.196421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.210018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] Creating event network-vif-plugged:ddb80283-d809-48d3-9d32-598a63b95679 for instance 03cbd653-fc5d-4603-9453-436e2600734d on n-h1-831193-17 Oct 04 17:56:28.216022 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5e65db55-5f66-4971-8827-fcc0a3aa0e80 req-beaef32d-4ca0-40be-992f-d652d61ac8e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038374 Oct 04 17:56:28.217058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1075/1870] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:28.223345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.224469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.232011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.232662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.233280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.234105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.234556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.235069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.393219 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-97e6cb6b-6f5b-4dd5-b6b0-6f02af6ac4a2 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1616 microversion: 2.1 time: 0.174948 Oct 04 17:56:28.394069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1076/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:28 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1616 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.408583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793ba4ae-3d2a-46a7-b741-8708334a3219", "tag": "283b6ab1-5df1-4886-a685-9104f4e976e7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:28.424747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.425288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.425870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.438660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] Creating event network-changed:283b6ab1-5df1-4886-a685-9104f4e976e7 for instance 793ba4ae-3d2a-46a7-b741-8708334a3219 on n-h1-831193-17 Oct 04 17:56:28.446496 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e672443a-1949-4042-95d6-73b2c05419c6 req-8fa195f5-e007-4d4e-a5c2-0d4f85a117fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 Oct 04 17:56:28.447515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1077/1872] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:28.453711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.454577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.461882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.462376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.462816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.463586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.464230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.465108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.629486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:28.645982 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90bfaa4b-092f-4f14-a56b-83cfbbb4f453 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.197098 Oct 04 17:56:28.656886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1078/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:28 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.656886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.656886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.666137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.666716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.667269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.667964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.668570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.668841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.892966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9ab9386-1508-48bd-8707-d49fd0b91350 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1616 microversion: 2.1 time: 0.244308 Oct 04 17:56:28.894271 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1079/1874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:28 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1616 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.909888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.910395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.924578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.925996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.926567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.928045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.929068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.930369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.968897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:28.989614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:29.155635 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47485d28-4e92-4d58-8e31-e17ee015ec49 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 204 len: 0 microversion: 2.25 time: 0.253741 Oct 04 17:56:29.156553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1080/1875] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:56:28 2022] DELETE /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:56:29.162733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:29.168998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'host': 'n-h1-831193-17', 'deleted': False} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:29.174905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.175471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.176038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.176787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.177248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.177960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.361178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:29.463800 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-594db6bd-9e52-40cd-a841-8477cbda3efe tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=n-h1-831193-17&all_tenants=1" status: 200 len: 1977 microversion: 2.1 time: 0.305937 Oct 04 17:56:29.464807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1081/1876] 10.222.0.33 () {58 vars in 1192 bytes} [Tue Oct 4 17:56:29 2022] GET /compute/v2.1/servers?host=n-h1-831193-17&all_tenants=1 => generated 1977 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:29.471371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:29.472123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:29.482522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.483075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.483529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.484461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.484981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.485421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.764250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:29.777534 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e75eebc-ce77-4eb5-a43a-8c528dddd485 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1312 microversion: 2.1 time: 0.311092 Oct 04 17:56:29.778680 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1082/1877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:29 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:29.784865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:29.785967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:29.797113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.797873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.799333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.800528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.801126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.802007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.062620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:30.098703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:30.105158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:30.108881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aea32a9c-e991-417c-b395-2f9287520f42 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1730 microversion: 2.25 time: 0.328616 Oct 04 17:56:30.110253 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1083/1878] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:29 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:30.118141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:30.121085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:30.139948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.141294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.141756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.143187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.144873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.144873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.401162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:30.411356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-430c4485-87fb-4961-bb40-bc700b465abd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1332 microversion: 2.1 time: 0.299402 Oct 04 17:56:30.431385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1084/1879] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:30 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1332 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:30.441672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:30.451025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:30.459505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.460136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.460641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.463249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.463808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.464257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.505858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d40e495-ebfa-4aa1-9600-fdc823ee6437 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.072971 Oct 04 17:56:30.506956 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1085/1880] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Oct 4 17:56:30 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:30.516675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:30.517307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:30.526155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.526739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.527325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.528305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.528768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.529281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.923700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:30.935939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d5df16c-2446-4be0-8c01-7ab2108f0959 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.427529 Oct 04 17:56:30.936772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1086/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:30 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:30.952009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:30.964643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:30.977396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.977830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.978272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:30.979130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:30.979454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:30.979877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.134143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5aee1498-3479-401d-878f-e65a91c97024 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 0 microversion: 2.1 time: 0.196325 Oct 04 17:56:31.136551 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1087/1882] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:30 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:31.146811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:31.149334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:31.165541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.166068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.166507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.167271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.167732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.168160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.592271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:31.610276 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f165821-9dfb-4a77-a7f8-8d704b544589 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1499 microversion: 2.1 time: 0.470814 Oct 04 17:56:31.611014 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1088/1883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:31 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1499 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:31.631441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:31.632263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:31.655267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.657876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.658432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.660215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.662568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.663537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.859981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:31.871834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:31.875662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:31.883333 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fdeb261-5757-4303-8d61-464d1f262880 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 200 len: 1663 microversion: 2.25 time: 0.268774 Oct 04 17:56:31.898091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1089/1884] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:31 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 1663 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:31.928602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:31.932866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:31.969250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.979911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.980665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.983948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.003840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.004608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.252134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:32.253824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:32.255355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:32.257012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:32.258482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:32.410683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:32.424905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.424905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.427665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.429041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.430078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.430078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.473514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa0bdd1a-e824-4310-bbfe-c7f6c8990193 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 1067 microversion: 2.1 time: 0.547847 Oct 04 17:56:32.475371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1090/1885] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:31 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 1067 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:56:32.483057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:32.483839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:32.496344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.497072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.497870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.499402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.500446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.501264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.847344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:32.859067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-700f1288-845d-4b51-abd9-a83e88bedc84 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1332 microversion: 2.1 time: 0.380569 Oct 04 17:56:32.859855 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1091/1886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:32 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1332 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:32.865734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf2603f-013e-44ee-af43-849d98b3f91b", "name": "network-vif-plugged", "status": "completed", "tag": "194d7870-4128-4b1c-8c84-713d1eed2d1c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:32.880159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.880919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.881810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.904848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] Creating event network-vif-plugged:194d7870-4128-4b1c-8c84-713d1eed2d1c for instance ddf2603f-013e-44ee-af43-849d98b3f91b on n-h2-831193-17 Oct 04 17:56:32.914705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-48d3f8f3-ab77-4e0e-986c-a71d4bf9e724 req-1a84b546-b8ed-4333-b052-d46975f695fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052419 Oct 04 17:56:32.915793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1092/1887] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:32.940461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5a0e13-6a4b-41a3-9c8c-7360749aebcd", "name": "network-vif-deleted", "tag": "6af6be49-8736-439e-b61a-bf5f01cebd4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:32.980688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.981261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.983684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.017767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] Creating event network-vif-deleted:6af6be49-8736-439e-b61a-bf5f01cebd4d for instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd on n-h2-831193-17 Oct 04 17:56:33.028071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e5843b08-37a2-4111-9cc3-511b93e44038 req-6d2ffdda-a981-4d82-b39e-5af445bba310 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109125 Oct 04 17:56:33.036871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1093/1888] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:33.045203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:33.046784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:33.059706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.060344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.060803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.061669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.062319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.063625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.137307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:33.634456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:33.657279 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9f0e0c5-234b-41a7-bd57-d25a4312667e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1308 microversion: 2.1 time: 0.614902 Oct 04 17:56:33.669909 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1094/1889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:33 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:33.670985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:33.672081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:33.705714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.707956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.710011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.711895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.718730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.720105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.276419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:34.287692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e3d66a7-6379-4cfa-b707-53c73ef0d97b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.627504 Oct 04 17:56:34.288876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1095/1890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:33 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:34.297597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:34.298565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:34.300965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=22 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:34.313646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.315950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.317101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.319685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.322304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.323001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.427928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] HTTP exception thrown: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Request method failure captured: Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd HTTP/1.1 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIPLcYqj9bUofWMwrzhRlO4Jtp1VGcsDDjRUnwjxReLmbbeXqvgfq652ptWlmL9VvZJw6cnsxuBWNPQVGdB2Mrs8zd3sGbVpEmnc2VZwG8TINhmelWwZBh_fIfdocygatnWjDoKoLpgIwGpe-Rct5tJsPbOYMm6rJN65x9NYTvYI-k Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9704eb841a9845948b9b01555c7051c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ee53a080f77a44f8aac80b34c1dd179e Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4b5a0e13-6a4b-41a3-9c8c-7360749aebcd'} Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. Oct 04 17:56:34.436736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. Oct 04 17:56:34.442568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:34.447993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Returning 404 to user: Instance 4b5a0e13-6a4b-41a3-9c8c-7360749aebcd could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:34.452261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-776a1cb4-cf75-48ac-817f-76b78ff3f8d6 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd" status: 404 len: 111 microversion: 2.25 time: 0.162224 Oct 04 17:56:34.453102 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1096/1891] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:34 2022] GET /compute/v2.1/servers/4b5a0e13-6a4b-41a3-9c8c-7360749aebcd => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:56:34.465946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:34.466948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:34.485663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.486444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.487301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.488245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.489087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.489689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.129885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:35.147964 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-926db861-d308-4d87-9ee2-3a507dde4cb0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1332 microversion: 2.1 time: 0.692345 Oct 04 17:56:35.151249 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1097/1892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:34 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1332 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:35.158347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00f908b3-d5bb-48dd-b95a-35eeaf2e4762 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '.version_select at 0x7f6342603b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:35.193456 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00f908b3-d5bb-48dd-b95a-35eeaf2e4762 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847818090" status: 204 len: 0 microversion: 2.25 time: 0.039744 Oct 04 17:56:35.201138 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1098/1893] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 17:56:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847818090 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:56:35.208956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0850497-aa7a-4ae4-81a9-3a5cb2972e0a"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:35.214880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:35.225940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.227321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.227955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.229308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.230530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.231431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.618561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d0ae760-804a-49f6-ab9f-5582270dab25 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413996 Oct 04 17:56:35.647066 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1099/1894] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 17:56:35 2022] POST /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:35.662573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:35.666288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:35.686624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.687195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.689650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.696403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.697084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.697583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:36.206939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:36.232903 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2d4fb0a-1a01-4ef0-92dc-194a6c26ab6d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1487 microversion: 2.1 time: 0.588144 Oct 04 17:56:36.235456 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1100/1895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:35 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1487 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:36.247842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:36.250311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:36.271069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:36.273084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:36.276187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:36.277332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:36.278295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:36.280643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:36.725344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:36.745719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c04eeee7-256a-4094-8769-1f9046d2078a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.506577 Oct 04 17:56:36.764412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1101/1896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:36 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:36.770111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:36.772223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:36.781293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:36.782014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:36.782898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:36.783866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:36.784684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:36.785321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:37.754745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:37.777672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-337114ee-aa8f-448c-bea7-7c5f09693ca5 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1332 microversion: 2.1 time: 1.011607 Oct 04 17:56:37.791076 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1102/1897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:36 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1332 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:37.795243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:37.803194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:37.803975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:37.805115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:37.930990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 17:56:38.040755 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbb64d81-1fe5-4127-928b-e6b19627c0da tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b/action" status: 202 len: 0 microversion: 2.1 time: 0.259234 Oct 04 17:56:38.042180 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1103/1898] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:37 2022] POST /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:38.064590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793ba4ae-3d2a-46a7-b741-8708334a3219", "name": "network-vif-plugged", "status": "completed", "tag": "283b6ab1-5df1-4886-a685-9104f4e976e7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:38.082251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.083211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.083988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.101576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] Creating event network-vif-plugged:283b6ab1-5df1-4886-a685-9104f4e976e7 for instance 793ba4ae-3d2a-46a7-b741-8708334a3219 on n-h1-831193-17 Oct 04 17:56:38.108847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5760d024-d2e8-40ae-82c7-406e98221c70 req-1b5e1594-3e55-406d-8635-3e16d33346d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064743 Oct 04 17:56:38.110153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1104/1899] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:38.119011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:38.119958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:38.130611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.131431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.132354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.133818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.136501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.137571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.238452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:38.390113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:38.401105 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ea48360-239f-4af4-a174-20071b09d47e tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "DELETE /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 204 len: 0 microversion: 2.1 time: 0.285852 Oct 04 17:56:38.403017 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1105/1900] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:38 2022] DELETE /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:38.410938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:38.412040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:38.423150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.423681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.424268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.425045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.425835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.426278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.641866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:38.653815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c471c09b-0555-484f-9917-844fee330650 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.249440 Oct 04 17:56:38.654807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1106/1901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:38 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:38.667980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:38.668998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:38.676509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.676702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.677720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.677942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.678433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.678864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.710694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:38.781234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:38.829944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be889fea-efcf-4c1d-a8ed-37e5100b7888 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 204 len: 0 microversion: 2.25 time: 0.173582 Oct 04 17:56:38.831115 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1107/1902] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:56:38 2022] DELETE /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:56:38.837049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:38.838072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:38.844566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.845060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.845500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.846208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.846661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.847120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:39.029501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:39.052884 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c26586b2-7494-4de3-b619-8ce6da088891 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.220285 Oct 04 17:56:39.067228 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1108/1903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:38 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:39.077195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:39.077820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:39.084328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:39.084915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:39.085434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:39.086567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:39.086792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:39.087320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:39.292377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:39.301871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c05797e-32a2-4a95-bb97-69cf0045b9ab tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1664 microversion: 2.1 time: 0.233404 Oct 04 17:56:39.307196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1109/1904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:39 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:39.646987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1666377203", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "76da73b9-1868-4fac-9e36-fe62558679a0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:39.775992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] validate_networks() for [('76da73b9-1868-4fac-9e36-fe62558679a0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:40.491293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=22 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:40.611466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:40.612152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:40.612955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:40.613664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:40.614453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:40.642342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:40.643693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:40.644895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:40.649769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:40.652765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:40.656115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:40.738022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Getting quotas for project b88de433a562475ba0c1eb16d3345fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:40.755875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Getting quotas for user 1dd4917ced9d4ceabc17899a7f57259d and project b88de433a562475ba0c1eb16d3345fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:40.808819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:40.812976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:40.916026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2cafc32-aa56-4af8-8b24-cd4caf822d13 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611251 Oct 04 17:56:40.917716 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1110/1905] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:40.930081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:40.931857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:40.947024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:40.948135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:40.949000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:40.950310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:40.951309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:40.952365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:41.431192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:41.443505 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50811cf6-4d22-4734-9ba1-0ed6fd131ca2 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1537 microversion: 2.1 time: 0.523929 Oct 04 17:56:41.444162 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1111/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:40 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1537 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:41.476328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:41.478784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:41.493857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:41.495505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:41.496757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:41.499390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:41.500631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:41.502107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:41.610707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:41.611736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:41.612206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:41.613121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lazy-loading 'fault' on Instance uuid 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:41.722471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:41.737884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:41.745111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee53a080f77a44f8aac80b34c1dd179e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9704eb841a9845948b9b01555c7051c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:41.750585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a832141b-467b-48cd-9fcb-d77817ca0386 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 200 len: 1351 microversion: 2.25 time: 0.286129 Oct 04 17:56:41.767077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1112/1907] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:41 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 1351 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:41.783060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:41.786508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:41.793825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:41.794629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:41.795390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:41.796650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:41.797685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:41.798820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.115545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:42.126135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21737bc5-511b-4ba7-8531-3ce8645d8cf3 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.352717 Oct 04 17:56:42.126833 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1113/1908] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:41 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:42.139360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:42.139360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:42.152260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.152857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.153570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.154444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.154994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.155512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.394891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:42.420972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2afd8502-12c9-4538-b50a-e58587d20b12 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.290456 Oct 04 17:56:42.428539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1114/1909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:42 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:42.433527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:42.434163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:42.451751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.456269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.457123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.458411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.459729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.460407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.560905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.561610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.561874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.562328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lazy-loading 'fault' on Instance uuid 465a1204-eacd-4237-bba3-2bc47eb35694 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:42.673421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:42.685954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-132fc3d1-babd-484a-9ed9-9b6f1a876d11 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 200 len: 1324 microversion: 2.1 time: 0.256145 Oct 04 17:56:42.687159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1115/1910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:42 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:42.693346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa1e9b1-7158-42b0-9640-5162ae82e1d7", "name": "network-vif-deleted", "tag": "c8ff3d05-8685-46f1-9de7-bddad808637d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:42.709109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.711287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.712572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.729429 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] Creating event network-vif-deleted:c8ff3d05-8685-46f1-9de7-bddad808637d for instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 on n-h2-831193-17 Oct 04 17:56:42.741394 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-21c5f078-e8de-4fa6-97b7-6637bf77fefc req-ea162e4a-2774-4907-88cf-9b80593f24e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052063 Oct 04 17:56:42.743105 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1116/1911] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:42.751464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:42.752537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:42.761579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.762175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.762683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.763678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.764205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.764873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.853690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:42.863063 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39b98a97-397b-49d5-8f9e-4e02c18b0246 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1269 microversion: 2.1 time: 0.117768 Oct 04 17:56:42.864528 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1117/1912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:42 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:42.870012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465a1204-eacd-4237-bba3-2bc47eb35694", "name": "network-vif-deleted", "tag": "51147125-b60d-4dfe-b394-be1d9c023361"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:42.893357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:42.894171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:42.894788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:42.919258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] Creating event network-vif-deleted:51147125-b60d-4dfe-b394-be1d9c023361 for instance 465a1204-eacd-4237-bba3-2bc47eb35694 on n-h1-831193-17 Oct 04 17:56:42.931161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3b907acf-fa76-4c74-9e86-7ee5b3661664 req-f5667728-fc59-4e7d-922a-a746bd1fe166 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064381 Oct 04 17:56:42.935426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1118/1913] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:42.942034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9042eb3-84dc-411c-940b-2e4ea6cb9a49 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'create', calling method: .version_select at 0x7f6341d51af0>, body: {"pool": "e82663ac-0786-4ba6-8aef-a44f9e2d8a12"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:45.614452 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9042eb3-84dc-411c-940b-2e4ea6cb9a49 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.677314 Oct 04 17:56:45.615428 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1119/1914] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 17:56:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:45.622056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:45.622873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 4fa1e9b1-7158-42b0-9640-5162ae82e1d7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:45.638012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.638598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.639353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:45.640241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.640710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.641323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:45.660085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] HTTP exception thrown: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Request method failure captured: Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 HTTP/1.1 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIPLcYqj9bUofWMwrzhRlO4Jtp1VGcsDDjRUnwjxReLmbbeXqvgfq652ptWlmL9VvZJw6cnsxuBWNPQVGdB2Mrs8zd3sGbVpEmnc2VZwG8TINhmelWwZBh_fIfdocygatnWjDoKoLpgIwGpe-Rct5tJsPbOYMm6rJN65x9NYTvYI-k Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9704eb841a9845948b9b01555c7051c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ee53a080f77a44f8aac80b34c1dd179e Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4fa1e9b1-7158-42b0-9640-5162ae82e1d7'} Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. Oct 04 17:56:45.661913 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Returning 404 to user: Instance 4fa1e9b1-7158-42b0-9640-5162ae82e1d7 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc709ec5-d9f9-4f86-b201-fefe8284f741 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7" status: 404 len: 111 microversion: 2.25 time: 0.047183 Oct 04 17:56:45.669426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1120/1915] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:45 2022] GET /compute/v2.1/servers/4fa1e9b1-7158-42b0-9640-5162ae82e1d7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:56:45.673075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:45.673769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:45.680593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.681309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.681694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:45.682575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.683081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.683568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:45.908763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:45.917449 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-453ba1dd-aedc-444d-b5c3-901054a35216 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.251910 Oct 04 17:56:45.918027 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1121/1916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:45 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:45.922894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:45.923526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:45.929983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.930754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.931467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:45.932124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:45.932736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:45.933426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.150096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:46.158433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6288d096-bc73-4718-9443-6acfd34d42ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.238998 Oct 04 17:56:46.159023 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1122/1917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:45 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:46.163912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:46.164468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 465a1204-eacd-4237-bba3-2bc47eb35694] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:46.171819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.172678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.173180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.173841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.174429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.174713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.200108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] HTTP exception thrown: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Request method failure captured: Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 HTTP/1.1 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJiOsuTGAzTYqdDIBzy0Ql85gRHfGyQJDi9Oi5zmYCIMgZySZT6SDHNY3xl3nNoUPQh9LRohdcRUgwsPHPusY35NusCWueDIEJwGrfB-1t5htfUCetN-tOiydkkdUOFYeg-m1RhRSdx7TNpj5uwVfX95wgkjPfELZ3R5nf_3jAR7ZE Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationTest-1686988312-project Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6f2ae8c47aca4786b8bde4da30d84158 Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationTest-1686988312-project Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '465a1204-eacd-4237-bba3-2bc47eb35694'} Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:46.202114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Returning 404 to user: Instance 465a1204-eacd-4237-bba3-2bc47eb35694 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbea7ee2-04bc-4550-8f05-f2f26c6e70e2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694" status: 404 len: 111 microversion: 2.1 time: 0.045385 Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1123/1918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:46 2022] GET /compute/v2.1/servers/465a1204-eacd-4237-bba3-2bc47eb35694 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:46.213056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:46.220236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.221178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.221407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.222137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.222605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.225472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.456419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:46.464539 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7433be93-ead4-4c52-bbad-4a06bc35938a tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1317 microversion: 2.1 time: 0.257104 Oct 04 17:56:46.465117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1124/1919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:46 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:46.469967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: .version_select at 0x7f63436d93a0>, body: {"addFloatingIp": {"address": "172.25.6.104"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:46.473095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:46.480642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.481419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.482077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.483299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:46.483853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:46.484375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:46.565435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:56:46.565841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquired lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:56:48.065907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:56:48.657958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Updating instance_info_cache with network_info: [{"id": "283b6ab1-5df1-4886-a685-9104f4e976e7", "address": "fa:16:3e:fb:88:81", "network": {"id": "f1910403-b938-46c6-9410-6aee49e8eda5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1153909386-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a26840318c34415fac60a8abe5d38cf9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap283b6ab1-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:56:48.673001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Releasing lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:56:48.673854 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21cd4c31-3889-46ce-8b2b-b072b13aa4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 202 len: 0 microversion: 2.1 time: 2.207768 Oct 04 17:56:48.674820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1125/1920] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:46 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 0 bytes in 2209 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:56:48.679821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:48.680338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:48.687247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:48.687754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:48.688197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:48.688945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:48.689408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:48.689841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:48.720603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:48.737805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:48.813143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58a957f4-ca14-4d3f-b9d2-e057f81016c3 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 204 len: 0 microversion: 2.25 time: 0.136893 Oct 04 17:56:48.814100 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1126/1921] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:56:48 2022] DELETE /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:56:48.822679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:48.829373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:48.831027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Searching by: {'deleted': False, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:48.841897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:48.842388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:48.842827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:48.843656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:48.844119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:48.844545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:48.873317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:48.914214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2552350-27dc-4367-9e52-9ae5fec9239c tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.098707 Oct 04 17:56:48.922634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1127/1922] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 17:56:48 2022] GET /compute/v2.1/servers => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:48.922634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5", "tag": "46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:48.934349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:48.934938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:48.935584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:48.953635 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] Creating event network-changed:46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4 for instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 on n-h2-831193-17 Oct 04 17:56:48.958849 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0b2c34d0-672c-4dea-9d9d-62dd565deb61 req-642e14ee-c262-41bc-9aee-082229180af2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042378 Oct 04 17:56:48.959900 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1128/1923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:48.966776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff766bfd-f583-48f1-aff7-217899d32125 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '.version_select at 0x7f6342560a60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:49.006020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff766bfd-f583-48f1-aff7-217899d32125 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864939728" status: 202 len: 0 microversion: 2.1 time: 0.044279 Oct 04 17:56:49.006633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1129/1924] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 17:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864939728 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:49.017942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:49.018693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:49.031517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.032033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.034353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.035383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.036022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.036631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.281312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:49.308094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58a15451-b10f-443a-a29e-9860f01f6849 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1471 microversion: 2.1 time: 0.300178 Oct 04 17:56:49.309873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1130/1925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:49 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:49.327436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:49.328333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:49.335323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.336405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.337048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.337950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.338583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.339232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.659443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:49.669642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cccf09c-f943-473c-84a4-a9d47cf4f5e6 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.351706 Oct 04 17:56:49.670892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1131/1926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:49 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:49.676161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:49.676778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:49.683557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.684055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.684494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.685622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:49.685767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:49.686200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:49.896388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:49.906453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9af68da-ad09-45bb-aee1-9abe7a7a1c1e tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1317 microversion: 2.1 time: 0.233543 Oct 04 17:56:49.907411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1132/1927] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:49 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:49.912910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85ec4dcb-b839-481e-8c52-dcf7d0a3ba93 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'create', calling method: .version_select at 0x7f6341c54790>, body: {"pool": "e82663ac-0786-4ba6-8aef-a44f9e2d8a12"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:50.777258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:51.317495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85ec4dcb-b839-481e-8c52-dcf7d0a3ba93 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.408841 Oct 04 17:56:51.318144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1133/1928] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 17:56:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:51.324299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:51.324922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] [instance: 2152578d-d896-4038-9f23-29b08bd0c0ea] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:51.332546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.333037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.333469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.334212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.334665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.335150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.349922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] HTTP exception thrown: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Request method failure captured: Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea HTTP/1.1 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHIPLcYqj9bUofWMwrzhRlO4Jtp1VGcsDDjRUnwjxReLmbbeXqvgfq652ptWlmL9VvZJw6cnsxuBWNPQVGdB2Mrs8zd3sGbVpEmnc2VZwG8TINhmelWwZBh_fIfdocygatnWjDoKoLpgIwGpe-Rct5tJsPbOYMm6rJN65x9NYTvYI-k Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9704eb841a9845948b9b01555c7051c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9704eb841a9845948b9b01555c7051c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9704eb841a9845948b9b01555c7051c6 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417 Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ee53a080f77a44f8aac80b34c1dd179e Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025129417-project Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2152578d-d896-4038-9f23-29b08bd0c0ea'} Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. Oct 04 17:56:51.351670 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] Returning 404 to user: Instance 2152578d-d896-4038-9f23-29b08bd0c0ea could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cebc657a-38b1-4b5a-95ec-6d62fdbefb41 tempest-LiveAutoBlockMigrationV225Test-1025129417 tempest-LiveAutoBlockMigrationV225Test-1025129417-project] 10.222.0.33 "GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea" status: 404 len: 111 microversion: 2.25 time: 0.034013 Oct 04 17:56:51.357224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1134/1929] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:51 2022] GET /compute/v2.1/servers/2152578d-d896-4038-9f23-29b08bd0c0ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:56:51.358824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:51.363849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:51.365104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Searching by: {'deleted': False, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:51.371124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.371609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.372043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.372777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.373231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.373655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.402332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:56:51.439600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:51.446697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.447224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.447666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.573762 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f4cdbdd-7384-45b2-a3bf-842f04751016 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.218543 Oct 04 17:56:51.574183 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1135/1930] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 17:56:51 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:51.579201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:51.579924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:51.586221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.586719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.587472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.588189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.588646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.589073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.647636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:51.779561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4fed14b-3383-4c57-bd8a-33a4d0199bf2 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "DELETE /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 204 len: 0 microversion: 2.1 time: 0.203568 Oct 04 17:56:51.780265 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1136/1931] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:51 2022] DELETE /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:51.789319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:51.789909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:51.795477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:51.797786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.798292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.798732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.799680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.800138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.800564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.834140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:51.943507 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d99d08a7-915f-4eb8-9151-e7389a93685b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 204 len: 0 microversion: 2.1 time: 0.161458 Oct 04 17:56:51.944119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1137/1932] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:51 2022] DELETE /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:51.950144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:51.951520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:51.970551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.971093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.971541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:51.972323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:51.972789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:51.973228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.145851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.156151 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9ffd285-4ffa-4cb1-bd2a-ce6c56c664af tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1477 microversion: 2.1 time: 0.210572 Oct 04 17:56:52.156913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1138/1933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:51 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:52.178669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:52.179936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.186607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.187224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.187744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.188526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.189096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.189850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.337347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.345350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e288644-767a-474c-a28f-da44903d8f11 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.170523 Oct 04 17:56:52.346321 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1139/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:52 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:52.351723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:52.352352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.358615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.359475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.359921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.360637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.361090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.361712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.501375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.510225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-904e1b1c-384a-4e1d-beae-6565c6f7bebe tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1317 microversion: 2.1 time: 0.162608 Oct 04 17:56:52.510823 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1140/1935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:52 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:52.515582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793ba4ae-3d2a-46a7-b741-8708334a3219", "tag": "283b6ab1-5df1-4886-a685-9104f4e976e7"}, {"server_uuid": "2152578d-d896-4038-9f23-29b08bd0c0ea", "name": "network-vif-deleted", "tag": "084175da-5b7e-4e5f-a3bd-c2e86da78a78"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:52.528968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.529760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.530492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.537323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:52.550962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Creating event network-changed:283b6ab1-5df1-4886-a685-9104f4e976e7 for instance 793ba4ae-3d2a-46a7-b741-8708334a3219 on n-h1-831193-17 Oct 04 17:56:52.551531 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] Creating event network-vif-deleted:084175da-5b7e-4e5f-a3bd-c2e86da78a78 for instance 2152578d-d896-4038-9f23-29b08bd0c0ea on n-h2-831193-17 Oct 04 17:56:52.560264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8fff604d-ceb3-4046-a80d-5925a17bfdf9 req-7b5117d6-c331-4eb7-93bd-1b4e5c6047e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048142 Oct 04 17:56:52.561143 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1141/1936] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:52.569382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.126"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:52.572432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.580165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.580667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.581109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.581830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.582322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.582760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.610220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:56:52.610535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquired lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:56:53.367738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12.", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:56:53.367738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Releasing lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:56:53.368496 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.368496 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Request method failure captured: Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action HTTP/1.1 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 46 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHO_zsSgpWdEss-G5TFplpwFQoj9v7H9WakAdu4zilp03ux8xB7xHzH6dfmmMtddl_ze-RIEXuQucojabxCBWW6v3n82mDFwARlkRIanZGrQJiNM1Pmd8vXb53CCMxl-Akep4fWrSX7J5cvEfacL-CR87dUIhVeNyGO-EJbtl9_zXg8 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a3327843b78c4dce80928d2752e01705 Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: {"addFloatingIp": {"address": "172.25.6.126"}} Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '793ba4ae-3d2a-46a7-b741-8708334a3219', 'body': {'addFloatingIp': {'address': '172.25.6.126'}}} Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:56:53.376590 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] Oct 04 17:56:53.388760 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.399469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Returning 400 to user: Cannot associate floating IP 172.25.6.126 (7e5657a5-f1ef-4173-bb89-8a5901fafda4) with port 283b6ab1-5df1-4886-a685-9104f4e976e7 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network e82663ac-0786-4ba6-8aef-a44f9e2d8a12. Oct 04 17:56:53.399469 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-5612187e-ec08-4a31-96eb-aa35ca88fa63'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:53.399469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cab53a5f-dfa9-4c0a-af6e-1dc6014aaf19 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 400 len: 382 microversion: 2.1 time: 0.812995 Oct 04 17:56:53.399469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1142/1937] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:52 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 382 bytes in 818 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:56:53.399469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8d997a2-9ab3-4ef9-8f82-d9da2c783aee tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.405533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8d997a2-9ab3-4ef9-8f82-d9da2c783aee tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023766 Oct 04 17:56:53.405533 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1143/1938] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:53.410172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.410993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:53.424758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.425662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.425662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.426340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.426797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.427485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.682348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2ae8c47aca4786b8bde4da30d84158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cf8480aeb94879a38b896077eaf56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:53.692469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57bc0f91-62ab-4a97-830a-02d81c32cc92 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 200 len: 1482 microversion: 2.1 time: 0.286353 Oct 04 17:56:53.707286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1144/1939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 1482 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:53.725152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.726752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:53.742311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.743306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.744336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.745454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.746232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.746747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.021266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:54.039325 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d55d2b64-71ae-4c92-a55a-3ca4e2135087 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1551 microversion: 2.1 time: 0.329378 Oct 04 17:56:54.042370 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1145/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1551 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:54.064921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.066819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:54.078813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.079424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.079879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.080610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.081076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.081559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.468679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:54.480727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-413cfc84-2f2f-4020-a595-d8f0567d4e2b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1477 microversion: 2.1 time: 0.436836 Oct 04 17:56:54.482106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1146/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:54.487724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "name": "network-vif-unplugged", "status": "completed", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:54.501259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.503775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.504648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.531465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] Creating event network-vif-unplugged:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:56:54.547789 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e124ccb1-3d94-401c-87b3-fcca6033b43d req-7ca812ea-3682-4e81-9f49-d3ca2cdad414 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063681 Oct 04 17:56:54.548409 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1147/1942] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:54.557900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.558736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:54.566148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.571781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.573070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.573723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.574695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.575514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.121276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:55.132466 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fce65efc-857b-4fb1-add8-c5d2877545a4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.579539 Oct 04 17:56:55.152877 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1148/1943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.177223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ff7e8d8-510b-47b7-970c-7902a8c62762 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '.version_select at 0x7f6341c41550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:56.686698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ff7e8d8-510b-47b7-970c-7902a8c62762 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/7e5657a5-f1ef-4173-bb89-8a5901fafda4" status: 202 len: 0 microversion: 2.1 time: 1.532302 Oct 04 17:56:56.687981 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1149/1944] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:56:55 2022] DELETE /compute/v2.1/os-floating-ips/7e5657a5-f1ef-4173-bb89-8a5901fafda4 => generated 0 bytes in 1534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:56.695801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:56.696454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:56.703210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:56.703701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:56.704140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:56.705172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:56.705631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:56.706273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:56.982445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:57.004890 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33a1cbef-0b79-4c60-95f7-a8c45cf83321 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1317 microversion: 2.1 time: 0.314071 Oct 04 17:56:57.019065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1150/1945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:56 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:57.019065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:57.019065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:57.019065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.027548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.028238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.029132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.029813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.030259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.065115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:57.167700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf5f5db8-31fb-41ad-a164-974f5077b74e tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "DELETE /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 204 len: 0 microversion: 2.1 time: 0.160102 Oct 04 17:56:57.168722 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1151/1946] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:57 2022] DELETE /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:57.177111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:57.177826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: acee0e99-55b1-4963-b49a-d3f09c9250b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:57.185437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.185935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.186367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.187312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.187937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.188363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.208491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] HTTP exception thrown: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Request method failure captured: Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 HTTP/1.1 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJiOsuTGAzTYqdDIBzy0Ql85gRHfGyQJDi9Oi5zmYCIMgZySZT6SDHNY3xl3nNoUPQh9LRohdcRUgwsPHPusY35NusCWueDIEJwGrfB-1t5htfUCetN-tOiydkkdUOFYeg-m1RhRSdx7TNpj5uwVfX95wgkjPfELZ3R5nf_3jAR7ZE Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationTest-1686988312-project Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6f2ae8c47aca4786b8bde4da30d84158 Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationTest-1686988312-project Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'acee0e99-55b1-4963-b49a-d3f09c9250b0'} Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:57.211221 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. Oct 04 17:56:57.216939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:56:57.218582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Returning 404 to user: Instance acee0e99-55b1-4963-b49a-d3f09c9250b0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:57.220301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc8dc40e-f9fd-482e-8040-b68f68deb29d tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0" status: 404 len: 111 microversion: 2.1 time: 0.050054 Oct 04 17:56:57.220881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1152/1947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:57 2022] GET /compute/v2.1/servers/acee0e99-55b1-4963-b49a-d3f09c9250b0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:57.225900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acee0e99-55b1-4963-b49a-d3f09c9250b0", "name": "network-vif-deleted", "tag": "c42df1a1-e456-42cb-b731-8b5eb199a70e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:57.235767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.236254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.236683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.249952 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] Creating event network-vif-deleted:c42df1a1-e456-42cb-b731-8b5eb199a70e for instance acee0e99-55b1-4963-b49a-d3f09c9250b0 on n-h1-831193-17 Oct 04 17:56:57.255672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e53511bc-0da2-453d-a808-bcddba92aac2 req-25eeb9e2-b818-48ab-9d88-bb381c05cef6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Oct 04 17:56:57.256286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1153/1948] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:57.262295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:57.263000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:57.269563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.269999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.270828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.271734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.272370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.272858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.353278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:57.362330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-765f2c31-07fa-4653-b16d-1b16dc668b09 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1343 microversion: 2.1 time: 0.104783 Oct 04 17:56:57.363231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1154/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:57 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1343 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:57.368706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:57.369576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:57.388668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.389170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.389609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.390407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.390872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.391328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.549677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:57.560908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e44f0b88-524f-4978-b371-db7dc481e152 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1477 microversion: 2.1 time: 0.194440 Oct 04 17:56:57.560908 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1155/1950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:57 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:57.564230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cbd653-fc5d-4603-9453-436e2600734d", "name": "network-vif-deleted", "tag": "ddb80283-d809-48d3-9d32-598a63b95679"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:57.574558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.575060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.575506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.588596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] Creating event network-vif-deleted:ddb80283-d809-48d3-9d32-598a63b95679 for instance 03cbd653-fc5d-4603-9453-436e2600734d on n-h1-831193-17 Oct 04 17:56:57.593620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-964db8c8-52ce-419c-b3f4-3701a92abada req-5b5403e5-6f97-4c10-b1d4-ed2c686b5d16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Oct 04 17:56:57.594632 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1156/1951] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:57.600066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:57.601676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:57.609343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.610147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.610588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.611538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.612174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.612777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.762590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:57.773573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19e72df9-c8e8-445c-a85d-47fa62fa6181 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.176303 Oct 04 17:56:57.775015 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1157/1952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:57 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:57.781187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5", "name": "network-vif-plugged", "status": "completed", "tag": "46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4"}, {"server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "name": "network-vif-plugged", "status": "completed", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:57.794154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:57.794866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:57.795319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:57.808914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Creating event network-vif-plugged:46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4 for instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 on n-h2-831193-17 Oct 04 17:56:57.809968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] Creating event network-vif-plugged:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:56:57.822379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-62baa06c-cf3a-4d57-b7be-501912551c43 req-db2de620-79c0-4b52-9029-6fa23e81df5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045368 Oct 04 17:56:57.829307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1158/1953] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:57.832775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: .version_select at 0x7f63436d94c0>, body: {"removeFloatingIp": {"address": "172.25.6.104"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:58.066187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:58.074936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.077437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.077437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:58.077437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.080194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.080194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:58.732525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:56:58.733230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquired lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:56:59.701835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:57:00.604532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Updating instance_info_cache with network_info: [{"id": "283b6ab1-5df1-4886-a685-9104f4e976e7", "address": "fa:16:3e:fb:88:81", "network": {"id": "f1910403-b938-46c6-9410-6aee49e8eda5", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1153909386-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a26840318c34415fac60a8abe5d38cf9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap283b6ab1-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:57:00.620749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Releasing lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:00.623067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a917fc8-9eaf-46d8-bfba-f5db8a926387 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 202 len: 0 microversion: 2.1 time: 2.794997 Oct 04 17:57:00.629322 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1159/1954] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:57 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 0 bytes in 2802 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:57:00.637056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:00.638043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:00.649292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.650330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.651564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.653032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.654607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.655854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.749767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.763142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48f408ce-af19-4029-beb7-bab0e070d660 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1541 microversion: 2.1 time: 0.131968 Oct 04 17:57:00.775660 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1160/1955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:00 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1541 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:00.786185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:00.786795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:00.802874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.803421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.803899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.804628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.805582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.805755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.858364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:00.876600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:01.062213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67065164-bafe-490b-b0b2-5c4308fe2b78 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "DELETE /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 204 len: 0 microversion: 2.1 time: 0.284906 Oct 04 17:57:01.066301 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1161/1956] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:00 2022] DELETE /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:01.085182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:01.085898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:01.099925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.105894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.106594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.107406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.107877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.108306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.379681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:01.422749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:01.440217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:01.443576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7fdfd6e-9273-4ef2-9961-7a848763be74 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1507 microversion: 2.1 time: 0.373003 Oct 04 17:57:01.466627 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1162/1957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:01 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:01.474305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:01.474935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:01.494735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.497034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.497801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.498804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.502334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.503115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.584120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.584696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.585194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.585660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'fault' on Instance uuid 03cbd653-fc5d-4603-9453-436e2600734d {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:01.735349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:01.744007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f67310a5-e696-4996-96b9-ffe516fbdc26 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 200 len: 1302 microversion: 2.1 time: 0.275643 Oct 04 17:57:01.757924 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1163/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:01 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 1302 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:01.770836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:01.771798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:01.785189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.786078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.797619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.798718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.799425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.800090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.199543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.210866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c79178fc-0138-4525-b8f8-61abb694721d tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1463 microversion: 2.1 time: 0.449781 Oct 04 17:57:02.234002 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1164/1959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:01 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1463 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:02.243255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:02.244387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:02.251857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.252614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.253227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.254351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.254990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.255633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.589465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.601827 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e1ca046-912c-4f14-86c5-abf7d70937f4 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1497 microversion: 2.1 time: 0.366597 Oct 04 17:57:02.603090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1165/1960] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:02 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:02.609600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793ba4ae-3d2a-46a7-b741-8708334a3219", "tag": "283b6ab1-5df1-4886-a685-9104f4e976e7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:02.623825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.624357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.624995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.659134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] Creating event network-changed:283b6ab1-5df1-4886-a685-9104f4e976e7 for instance 793ba4ae-3d2a-46a7-b741-8708334a3219 on n-h1-831193-17 Oct 04 17:57:02.669590 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b36d5256-001e-4696-b210-c6a9d0c52307 req-6cd2945e-fd62-4ef3-abb7-16e2000b4a92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064961 Oct 04 17:57:02.672139 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1166/1961] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:02.684091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce0c5202-08d6-40ec-83a5-3888b3c634f3 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '.version_select at 0x7f6341a4f3a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.330153 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce0c5202-08d6-40ec-83a5-3888b3c634f3 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/c5dbf461-af55-4244-9fce-4652669b15b1" status: 202 len: 0 microversion: 2.1 time: 1.655567 Oct 04 17:57:04.335314 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1167/1962] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 17:57:02 2022] DELETE /compute/v2.1/os-floating-ips/c5dbf461-af55-4244-9fce-4652669b15b1 => generated 0 bytes in 1662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:04.343106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e2e1c2-12d1-44f8-8e25-2edd3bfda603", "name": "network-vif-deleted", "tag": "2c7e45ac-0665-45e3-bceb-b24d3a5f022b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:04.356049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.356734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.357175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.369207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] Creating event network-vif-deleted:2c7e45ac-0665-45e3-bceb-b24d3a5f022b for instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 on n-h2-831193-17 Oct 04 17:57:04.374483 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-faa74913-44c7-4079-912a-d171d8f07b1b req-0c39c955-5058-4cd4-9f56-948253ee2990 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037254 Oct 04 17:57:04.375373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1168/1963] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:04.380453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.381275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] [instance: 12349714-03d5-4a6d-b094-6ad0ae13ccb8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.388504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.389003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.389652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.390378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.390842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.391305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.408041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] HTTP exception thrown: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Request method failure captured: Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 HTTP/1.1 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHJiOsuTGAzTYqdDIBzy0Ql85gRHfGyQJDi9Oi5zmYCIMgZySZT6SDHNY3xl3nNoUPQh9LRohdcRUgwsPHPusY35NusCWueDIEJwGrfB-1t5htfUCetN-tOiydkkdUOFYeg-m1RhRSdx7TNpj5uwVfX95wgkjPfELZ3R5nf_3jAR7ZE Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72cf8480aeb94879a38b896077eaf56a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-LiveMigrationTest-1686988312 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 72cf8480aeb94879a38b896077eaf56a Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-LiveMigrationTest-1686988312 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-LiveMigrationTest-1686988312-project Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6f2ae8c47aca4786b8bde4da30d84158 Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-LiveMigrationTest-1686988312-project Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '12349714-03d5-4a6d-b094-6ad0ae13ccb8'} Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:04.410183 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Returning 404 to user: Instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:04.417191 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-405f5ecf-abf7-43ef-9e2f-02402a76d6bd tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8" status: 404 len: 111 microversion: 2.1 time: 0.040429 Oct 04 17:57:04.418599 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1169/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/12349714-03d5-4a6d-b094-6ad0ae13ccb8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:04.426179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.426689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.433989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.434496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.434920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.435728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.436184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.436995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.475165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d0e7a1a-6f60-4f55-a6a6-131720a814d0 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips" status: 200 len: 110 microversion: 2.1 time: 0.055294 Oct 04 17:57:04.478082 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1170/1965] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips => generated 110 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:04.483940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.484990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.494266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.495061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.495693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.497436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.499000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.499817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.583974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:04.594552 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eef2b59d-78b5-476d-b22a-abead186d06d tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1252 microversion: 2.1 time: 0.115175 Oct 04 17:57:04.611244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1171/1966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1252 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:04.613915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.614582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.622199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.623060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.623747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.625385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.626078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.626916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.875386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:04.887862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e834d1e-63a4-4fa9-8004-127be0f12384 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1463 microversion: 2.1 time: 0.278833 Oct 04 17:57:04.888702 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1172/1967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1463 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:04.894915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.895953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.906575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.908341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.909051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.910801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.911747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.912823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.938778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d HTTP/1.1 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '03cbd653-fc5d-4603-9453-436e2600734d'} Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:04.941750 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:04.949112 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:04.968284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:04.970095 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-660d639d-c4a8-4e4b-9a98-0fccb79281c8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 404 len: 111 microversion: 2.1 time: 0.079519 Oct 04 17:57:04.971764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1173/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:04.981644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.984756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.001735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.002255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.002700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.003489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.006019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.006732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.668237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:05.696329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48e87a3a-31c6-4ff9-9505-eb477c9b4560 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 200 len: 1474 microversion: 2.1 time: 0.723446 Oct 04 17:57:05.697301 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1174/1969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 1474 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:05.703101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8679a3fc-4f1e-4b4a-9974-4211b72cface tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8679a3fc-4f1e-4b4a-9974-4211b72cface tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Request method failure captured: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action HTTP/1.1 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 34 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHO_zsSgpWdEss-G5TFplpwFQoj9v7H9WakAdu4zilp03ux8xB7xHzH6dfmmMtddl_ze-RIEXuQucojabxCBWW6v3n82mDFwARlkRIanZGrQJiNM1Pmd8vXb53CCMxl-Akep4fWrSX7J5cvEfacL-CR87dUIhVeNyGO-EJbtl9_zXg8 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a3327843b78c4dce80928d2752e01705 Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: {"addFloatingIp": {"address": ""}} Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '793ba4ae-3d2a-46a7-b741-8708334a3219', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:57:05.714598 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:05.719788 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:05.722041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8679a3fc-4f1e-4b4a-9974-4211b72cface tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:05.722041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8679a3fc-4f1e-4b4a-9974-4211b72cface tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 400 len: 142 microversion: 2.1 time: 0.022374 Oct 04 17:57:05.724427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1175/1970] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:05 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 142 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:05.729842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:05.730679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.738331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.739247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.739935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.740967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.741672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.742402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.775720 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b93ceff6-5664-4cf9-94e5-4f22dbebd44f tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips" status: 200 len: 110 microversion: 2.1 time: 0.051169 Oct 04 17:57:05.776683 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1176/1971] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 17:57:05 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips => generated 110 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:05.785432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:05.788599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.797388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.797897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.798351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.799088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.799557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.799991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.902520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:05.903447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:05.904083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:05.904713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:05.905396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:05.989855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.998015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.998609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.999149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.000622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.001446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.002093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.039543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-82bec908-6298-40c6-b129-6e5e679e2b59 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 1067 microversion: 2.1 time: 0.258495 Oct 04 17:57:06.051057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1177/1972] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:05 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 1067 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:57:06.056034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:06.060560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.067297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:06.074293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.074883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.075444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.076414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.077317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.077816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.097660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d/os-volume_attachments HTTP/1.1 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '03cbd653-fc5d-4603-9453-436e2600734d'} Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:06.099743 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7253e599-d550-45ea-8003-598baa29d802 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059652 Oct 04 17:57:06.104910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1178/1973] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 17:57:06 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:06.112310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:06.113063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.120339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.121298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.122131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.123098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.123788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.124419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.225564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79dac7c0cb441ada4f755ba2bc7aaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2456d4a42e4da8abbbdc4fc79cbc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:06.248022 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c16feb5b-4fce-45f2-9375-eb731dd859a8 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 200 len: 1252 microversion: 2.1 time: 0.144575 Oct 04 17:57:06.249792 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1179/1974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:06 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 1252 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:06.258809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-159190008"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:06.265484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.276141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.276999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.279188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.280605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.281434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.282079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.313850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:06.633462 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ed805fe-e653-4cc9-8ce6-a942c0797697 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b/action" status: 202 len: 0 microversion: 2.1 time: 0.380373 Oct 04 17:57:06.634125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1180/1975] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:06 2022] POST /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:57:06.650581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:06.657601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.668285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.668973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.669101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.669830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.670282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.670702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.710043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:57:06.710967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquired lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Releasing lock "refresh_cache-793ba4ae-3d2a-46a7-b741-8708334a3219" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] HTTP exception thrown: floating IP not found Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Request method failure captured: Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action HTTP/1.1 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 41 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHO_zsSgpWdEss-G5TFplpwFQoj9v7H9WakAdu4zilp03ux8xB7xHzH6dfmmMtddl_ze-RIEXuQucojabxCBWW6v3n82mDFwARlkRIanZGrQJiNM1Pmd8vXb53CCMxl-Akep4fWrSX7J5cvEfacL-CR87dUIhVeNyGO-EJbtl9_zXg8 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a3327843b78c4dce80928d2752e01705 Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: exception: floating IP not found Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '793ba4ae-3d2a-46a7-b741-8708334a3219', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:06.904920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Returning 404 to user: floating IP not found {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:06.911619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7fb1ce5-8dbe-49dd-8a95-3a50f6ce5d6a tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 404 len: 67 microversion: 2.1 time: 0.264239 Oct 04 17:57:06.913917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1181/1976] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:06 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 67 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:57:06.919934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:06.920726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.930346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.930952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.943504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.946021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.947063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.947547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:07.024881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67f229ce-54cb-4614-a023-cb543ba3f7ae tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips/tempest-ServerAddressesTestJSON-1176766934-network" status: 200 len: 95 microversion: 2.1 time: 0.106379 Oct 04 17:57:07.025779 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1182/1977] 10.222.0.33 () {58 vars in 1401 bytes} [Tue Oct 4 17:57:06 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5/ips/tempest-ServerAddressesTestJSON-1176766934-network => generated 95 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:07.033674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:07.034650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:07.042236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:07.043150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:07.043846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:07.044804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:07.045495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:07.046176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:07.307172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:07.330730 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41a09973-9934-404c-87a3-10ecefc3567a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 0.302759 Oct 04 17:57:07.343057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1183/1978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:07 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:07.343057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12349714-03d5-4a6d-b094-6ad0ae13ccb8", "name": "network-vif-deleted", "tag": "08030174-2cfa-43fb-b31a-652ca7e122d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:07.347977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:07.348798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:07.349468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:07.368617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] Creating event network-vif-deleted:08030174-2cfa-43fb-b31a-652ca7e122d4 for instance 12349714-03d5-4a6d-b094-6ad0ae13ccb8 on n-h2-831193-17 Oct 04 17:57:07.378154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-62c03628-03c5-4fd1-adc6-1fccf92e635f req-8941d894-059f-47ae-ae9e-6779baaef92f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045108 Oct 04 17:57:07.379450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1184/1979] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:07.385911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-568973741", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:07.504287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:08.044941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:08.045718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:08.046594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:08.047425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:08.048180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:08.060592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.061249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.061715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.062447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.062901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.063557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.084728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:08.091178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:08.106795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:08.110167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:08.181218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3fe2699-b68d-4f9f-b429-e0b4b5f45d01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800236 Oct 04 17:57:08.190016 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1185/1980] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:08.499300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Action: 'update', calling method: .version_select at 0x7f6341a66dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:08.608773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.609526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.610084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.611524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.612437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.613156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.682085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8ef8633-804e-45fc-9c67-90b934c86350 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a" status: 200 len: 240 microversion: 2.36 time: 0.496333 Oct 04 17:57:08.684046 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1186/1981] 10.222.0.33 () {62 vars in 1303 bytes} [Tue Oct 4 17:57:08 2022] PUT /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a => generated 240 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:08.690452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c057605-5f6e-4947-b634-d8889a83ff70 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63419be5e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:08.750480 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c057605-5f6e-4947-b634-d8889a83ff70 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.064559 Oct 04 17:57:08.752907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1187/1982] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:08 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:08.759225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f9ff626-5bca-4e70-b481-761fd22903dd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:08.859984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9f9ff626-5bca-4e70-b481-761fd22903dd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f9ff626-5bca-4e70-b481-761fd22903dd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Request method failure captured: Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action HTTP/1.1 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 44 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHO_zsSgpWdEss-G5TFplpwFQoj9v7H9WakAdu4zilp03ux8xB7xHzH6dfmmMtddl_ze-RIEXuQucojabxCBWW6v3n82mDFwARlkRIanZGrQJiNM1Pmd8vXb53CCMxl-Akep4fWrSX7J5cvEfacL-CR87dUIhVeNyGO-EJbtl9_zXg8 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a3327843b78c4dce80928d2752e01705 Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP not found for address 0.0.0.0. Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '793ba4ae-3d2a-46a7-b741-8708334a3219', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 17:57:08.861971 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f9ff626-5bca-4e70-b481-761fd22903dd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f9ff626-5bca-4e70-b481-761fd22903dd tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action" status: 404 len: 88 microversion: 2.1 time: 0.109262 Oct 04 17:57:08.867218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1188/1983] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:08 2022] POST /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219/action => generated 88 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:57:08.872221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:08.872741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:08.894175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.894789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.895811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.896149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.896686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.897756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.957968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:09.180222 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa79a0ce-f5de-4205-a399-fe732a625d76 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 204 len: 0 microversion: 2.1 time: 0.313408 Oct 04 17:57:09.190127 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1189/1984] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:08 2022] DELETE /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:09.196533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.197493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] [instance: 58e2e1c2-12d1-44f8-8e25-2edd3bfda603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.204502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.205003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.205495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.206223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.206682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.207314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.231324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] HTTP exception thrown: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Request method failure captured: Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 HTTP/1.1 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHNge9le6o4FqK6cd9eqZoKX835OawT7kX8yqFWGwg5uLkq8QiVR7f2vX4HG4ZJesnTQmtLLV2WLZrqkEXW5bvawjTjupi1uhXCtDzbEZ1a8KEwBfSDB51h6EWySXA0gOh_rsvCzJuAV5VlmbU2HMABpdcnSBXVF5Blsa-zL75WMmk0 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: be2456d4a42e4da8abbbdc4fc79cbc8e Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestBootFromVolume-1512274150 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be2456d4a42e4da8abbbdc4fc79cbc8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be2456d4a42e4da8abbbdc4fc79cbc8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be2456d4a42e4da8abbbdc4fc79cbc8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be2456d4a42e4da8abbbdc4fc79cbc8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestBootFromVolume-1512274150 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: be2456d4a42e4da8abbbdc4fc79cbc8e Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1512274150 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestBootFromVolume-1512274150-project Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a79dac7c0cb441ada4f755ba2bc7aaa0 Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestBootFromVolume-1512274150-project Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '58e2e1c2-12d1-44f8-8e25-2edd3bfda603'} Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:09.236497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. Oct 04 17:57:09.242536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:09.243389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Returning 404 to user: Instance 58e2e1c2-12d1-44f8-8e25-2edd3bfda603 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:09.247302 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2f4da64c-ebdb-437c-989c-4b5afd217e48 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603" status: 404 len: 111 microversion: 2.1 time: 0.054367 Oct 04 17:57:09.251236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1190/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/58e2e1c2-12d1-44f8-8e25-2edd3bfda603 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:09.262779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.263883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.271770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.272846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.273475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.274320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.274840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.275298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.439192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:09.453283 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c33b56a-42ef-4ac3-a438-97f0c9c56389 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1266 microversion: 2.1 time: 0.204175 Oct 04 17:57:09.454472 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1191/1986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:09.483708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.485109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.495872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.496653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.497309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.498213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.498847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.504201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.688231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:09.698584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ac61f7c-64a4-406c-a602-ff75f054b109 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 0.227742 Oct 04 17:57:09.712042 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1192/1987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:09.720859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Calling method '.version_select at 0x7f63419be160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.794517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.795393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.796081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.797071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.797976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.798641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.827628 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91856539-5f98-401c-9a35-ad97dd4aab37 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a/detail" status: 200 len: 672 microversion: 2.36 time: 0.113988 Oct 04 17:57:09.828753 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1193/1988] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a/detail => generated 672 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:09.852619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.855800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.875697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.879631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.883738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.885870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.886616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.889666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.976431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:10.238082 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-207e1799-387f-4687-907f-5c077cdddb8b tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "DELETE /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 204 len: 0 microversion: 2.1 time: 0.405324 Oct 04 17:57:10.240520 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1194/1989] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:09 2022] DELETE /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:10.256071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.257173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:10.271845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.273574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.274224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.275370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.277647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.278104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.576118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd4917ced9d4ceabc17899a7f57259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88de433a562475ba0c1eb16d3345fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.589296 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c9a99d8-eee1-4447-b215-5092fd0c9ef1 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 200 len: 1513 microversion: 2.1 time: 0.342396 Oct 04 17:57:10.590393 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1195/1990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:10 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 1513 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:10.615783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c07d9c53-1846-4488-be46-9c650ca93896 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] Calling method '.version_select at 0x7f63417e7280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.644326 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c07d9c53-1846-4488-be46-9c650ca93896 tempest-ServersTestBootFromVolume-1512274150 tempest-ServersTestBootFromVolume-1512274150-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783607875" status: 202 len: 0 microversion: 2.1 time: 0.035118 Oct 04 17:57:10.644845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1196/1991] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 17:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783607875 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:10.656299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.657516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:10.665157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.666006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.666625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.667563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.668197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.668791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.701071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:10.838524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:10.909763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8d05431-3914-43a8-9b65-893054154fb7 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 204 len: 0 microversion: 2.1 time: 0.260243 Oct 04 17:57:10.910733 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1197/1992] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:10 2022] DELETE /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:10.923606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c2e50fe-1d8b-4d3b-aa4d-30242d026016 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341b1a550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.021434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c2e50fe-1d8b-4d3b-aa4d-30242d026016 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.109176 Oct 04 17:57:11.022514 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1198/1993] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:10 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:11.027375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Action: 'update', calling method: .version_select at 0x7f63417e7040>, body: {"quota_set": {"ram": "2048"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.234684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.248872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.250610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.251880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.252928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.255882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.256584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.360851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:11.424576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48d5dca1-b7cc-40e4-a969-4a8720b2a10d tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a?user_id=e4e239eb6b3245ad8ce930a2973a3294" status: 200 len: 240 microversion: 2.36 time: 0.400647 Oct 04 17:57:11.433389 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1199/1994] 10.222.0.33 () {62 vars in 1384 bytes} [Tue Oct 4 17:57:11 2022] PUT /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a?user_id=e4e239eb6b3245ad8ce930a2973a3294 => generated 240 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:11.451233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.452341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:11.458986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.460394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.471817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.472937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.473634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.474324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:12.177005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3327843b78c4dce80928d2752e01705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26840318c34415fac60a8abe5d38cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:12.190229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01337c5a-59ec-4d29-8897-889f0c354728 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 200 len: 1543 microversion: 2.1 time: 0.755273 Oct 04 17:57:12.191910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1200/1995] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:11 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 1543 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:12.206898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:12.208362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:12.227712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:12.229288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:12.230713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:12.233030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:12.244810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:12.245367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.387212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:13.423616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-761df8c8-c3f5-416f-b302-f40362a2bb44 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 1.226305 Oct 04 17:57:13.435985 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1201/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:12 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:13.446809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:13.447649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:13.455784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.456512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.457084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.458537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.459199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.459827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.635349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:13.651062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cdad060-9251-41d3-b5b8-33682167939f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1272 microversion: 2.1 time: 0.212297 Oct 04 17:57:13.652421 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1202/1997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:13 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:13.658022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3232320c-2683-44f3-bb65-cefff27b1215 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] Calling method '.version_select at 0x7f6341a4f700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:13.780745 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3232320c-2683-44f3-bb65-cefff27b1215 tempest-QuotasAdminTestV236-1457584973 tempest-QuotasAdminTestV236-1457584973-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a?user_id=e4e239eb6b3245ad8ce930a2973a3294" status: 200 len: 282 microversion: 2.36 time: 0.126844 Oct 04 17:57:13.781994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1203/1998] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 17:57:13 2022] GET /compute/v2.1/os-quota-sets/3f4324dd3e434890a01f3bb53aaf731a?user_id=e4e239eb6b3245ad8ce930a2973a3294 => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:13.787296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:13.788243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] [instance: a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:13.800376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.801099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.801666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.802779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.803984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.804551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.827479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] HTTP exception thrown: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Request method failure captured: Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 HTTP/1.1 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHPWhKKaxr0IdLldh8j07fEvco28oDsLdA3C-2_tNtPDNQ7V6qCskcalxFh9G30Alhwj-9jdl6Ii8nbVeVMOS9KBj1oQ0alYVtl61gxq6iFT5mQ4v7DBcmcDFf5bElwB2Gyma4MNWw2X8AMGeCe2khDlJ10aU_S-GUET7FUYVr3g238 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b88de433a562475ba0c1eb16d3345fc8 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerAddressesTestJSON-1798987420 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b88de433a562475ba0c1eb16d3345fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b88de433a562475ba0c1eb16d3345fc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b88de433a562475ba0c1eb16d3345fc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b88de433a562475ba0c1eb16d3345fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerAddressesTestJSON-1798987420 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b88de433a562475ba0c1eb16d3345fc8 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1798987420 Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerAddressesTestJSON-1798987420-project Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1dd4917ced9d4ceabc17899a7f57259d Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerAddressesTestJSON-1798987420-project Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5'} Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:13.829639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. Oct 04 17:57:13.836417 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:13.839871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] Returning 404 to user: Instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:13.840896 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca00571b-0a9f-4c08-a3ae-f19da2e685b8 tempest-ServerAddressesTestJSON-1798987420 tempest-ServerAddressesTestJSON-1798987420-project] 10.222.0.33 "GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5" status: 404 len: 111 microversion: 2.1 time: 0.057760 Oct 04 17:57:13.842170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1204/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:13 2022] GET /compute/v2.1/servers/a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:13.868770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dceb21c5-3aec-4f43-9742-b3a1e8b6231d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341827f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:13.970680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dceb21c5-3aec-4f43-9742-b3a1e8b6231d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.119615 Oct 04 17:57:13.973619 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1205/2000] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:13 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:13.991319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf2603f-013e-44ee-af43-849d98b3f91b", "name": "network-vif-plugged", "status": "completed", "tag": "194d7870-4128-4b1c-8c84-713d1eed2d1c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:14.072909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.076786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.079932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.133213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] Creating event network-vif-plugged:194d7870-4128-4b1c-8c84-713d1eed2d1c for instance ddf2603f-013e-44ee-af43-849d98b3f91b on n-h2-831193-17 Oct 04 17:57:14.151966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1122ef68-c585-40bf-b049-cc8445fb806e req-bacf2b60-b600-478d-aa49-c7420aceb376 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175794 Oct 04 17:57:14.155667 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1206/2001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:14.170445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5", "name": "network-vif-deleted", "tag": "46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:14.200504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.203476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.205369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.245868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] Creating event network-vif-deleted:46d05e49-7a6e-46a5-934e-f2bcfc6b3ee4 for instance a5ef80fa-719c-41bd-aa5f-9a7cf09e28d5 on n-h2-831193-17 Oct 04 17:57:14.255492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-47b5f84e-3daa-40ff-bb15-7d0e705f1756 req-400ce393-b303-4d01-9413-dd5828ed18b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097610 Oct 04 17:57:14.261446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1207/2002] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:14.277824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.280794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] [instance: 793ba4ae-3d2a-46a7-b741-8708334a3219] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.293900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.295138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.300159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.301993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.304906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.305435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.345497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] HTTP exception thrown: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Request method failure captured: Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 HTTP/1.1 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHO_zsSgpWdEss-G5TFplpwFQoj9v7H9WakAdu4zilp03ux8xB7xHzH6dfmmMtddl_ze-RIEXuQucojabxCBWW6v3n82mDFwARlkRIanZGrQJiNM1Pmd8vXb53CCMxl-Akep4fWrSX7J5cvEfacL-CR87dUIhVeNyGO-EJbtl9_zXg8 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a26840318c34415fac60a8abe5d38cf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a26840318c34415fac60a8abe5d38cf9 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a3327843b78c4dce80928d2752e01705 Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '793ba4ae-3d2a-46a7-b741-8708334a3219'} Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. Oct 04 17:57:14.349803 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. Oct 04 17:57:14.352900 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:14.355228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] Returning 404 to user: Instance 793ba4ae-3d2a-46a7-b741-8708334a3219 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:14.357489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c698014b-8832-4472-b2f8-7269979224d0 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130 tempest-FloatingIPsAssociationNegativeTestJSON-2002614130-project] 10.222.0.33 "GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219" status: 404 len: 111 microversion: 2.1 time: 0.094153 Oct 04 17:57:14.361205 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1208/2003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/793ba4ae-3d2a-46a7-b741-8708334a3219 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:14.458559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.460856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.473359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.481420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.482031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.482928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.485244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.486853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.607731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:15.620026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-778a663e-d513-4887-a8c9-6592b39f8a7e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 1.166021 Oct 04 17:57:15.621825 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1209/2004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:15.630293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:15.631862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:15.641686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.643160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.644416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.645704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.646410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.648223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.594634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.611526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0daa67bd-60fe-44da-b051-160e39cefb56 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1314 microversion: 2.1 time: 0.988391 Oct 04 17:57:16.614914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1210/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:15 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:16.622470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5d6b94d-7b70-448d-b7cf-d10cd77054df tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63417ef670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:16.693498 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5d6b94d-7b70-448d-b7cf-d10cd77054df tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.076554 Oct 04 17:57:16.694815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1211/2006] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:16 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:16.707014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793ba4ae-3d2a-46a7-b741-8708334a3219", "name": "network-vif-deleted", "tag": "283b6ab1-5df1-4886-a685-9104f4e976e7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:16.719020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.719909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.720557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.737225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] Creating event network-vif-deleted:283b6ab1-5df1-4886-a685-9104f4e976e7 for instance 793ba4ae-3d2a-46a7-b741-8708334a3219 on n-h1-831193-17 Oct 04 17:57:16.743839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bb46b1cd-c296-47de-b895-c6adaadd8b2b req-ca2aa776-3255-4cc8-9f7e-7175fcf2484e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047353 Oct 04 17:57:16.745148 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1212/2007] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:16.751524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:16.752880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:16.762830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.764716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.765461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.766629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.767489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.768151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:18.204799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:18.222914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f82724e6-0c37-4bc0-b5a9-9782495d1651 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 1.475595 Oct 04 17:57:18.242576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1213/2008] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:16 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:18.257202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:18.258171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:18.266407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:18.267266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:18.267893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:18.268778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:18.269365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:18.269922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:18.663132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:18.676318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16098477-dc3a-4e22-b158-48e2557abc47 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1314 microversion: 2.1 time: 0.422908 Oct 04 17:57:18.676912 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1214/2009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:18 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:18.687995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91698bed-d011-4744-8d3e-0de02c730605 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341a155e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:18.769151 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91698bed-d011-4744-8d3e-0de02c730605 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.084747 Oct 04 17:57:18.770366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1215/2010] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:18 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:19.264402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:19.268299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:19.293897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.294757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.309015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.310430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.317598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.326254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.518423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:20.534266 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91ff6bf3-a233-44a3-af33-af2745ffee2e tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 1.277593 Oct 04 17:57:20.538280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1216/2011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:19 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:20.552174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:20.555402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:20.578305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.580584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.581882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.586961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.589030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.590625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:21.283068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=11 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:21.825023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:21.846136 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e218694-8e47-43fd-9be3-80b3ec59f067 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1314 microversion: 2.1 time: 1.304741 Oct 04 17:57:21.853203 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1217/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:20 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1314 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:21.862810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7ce5571-9a4e-400b-9d99-9ae0487f006b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63417e7040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:21.952391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c7ce5571-9a4e-400b-9d99-9ae0487f006b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.097495 Oct 04 17:57:21.953623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1218/2013] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:21 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:21.959761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:21.961201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:21.971979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.972756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.973267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:21.974199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.975387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.975967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.546423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.556324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c3992da-6cbf-4879-a7f5-bb08b4cd4e81 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1472 microversion: 2.1 time: 0.601389 Oct 04 17:57:22.568190 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1219/2014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:21 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1472 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:22.874132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:22.875107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:22.891559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.892145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.892587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.893338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.893798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.894231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.772018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=32 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:23.858563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:23.873719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3472bd6-a467-4124-8005-ed467bebb647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1314 microversion: 2.1 time: 1.003138 Oct 04 17:57:23.875244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1220/2015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:22 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1314 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:23.891196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12ec711-6fda-4a8c-842b-a316314701b0", "tag": "e760d0c3-a277-4255-a795-c611a616c39f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:23.910764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.914667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.915314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.963320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] Creating event network-changed:e760d0c3-a277-4255-a795-c611a616c39f for instance b12ec711-6fda-4a8c-842b-a316314701b0 on n-h1-831193-17 Oct 04 17:57:23.974396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6d093e86-3049-4618-89d7-00d8bef3ada7 req-ec54433b-a0cc-4968-a4ce-82b9bb9d85b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095068 Oct 04 17:57:23.977283 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1221/2016] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:23.994308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1fcdfc77-2d0f-4e1c-8eeb-1267c27d7564 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63417e7ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:24.087766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1fcdfc77-2d0f-4e1c-8eeb-1267c27d7564 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.105622 Oct 04 17:57:24.088363 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1222/2017] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:23 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:24.567054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Action: 'update', calling method: .version_select at 0x7f6345ca7700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:24.755154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.762604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.766621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.768606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.775181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.775716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.050090 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5cc64683-98c0-43b6-8094-ee7066b91b38 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6" status: 200 len: 148 microversion: 2.57 time: 0.960301 Oct 04 17:57:25.050965 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1223/2018] 10.222.0.33 () {62 vars in 1303 bytes} [Tue Oct 4 17:57:24 2022] PUT /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6 => generated 148 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:25.072578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.073378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.134380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.137052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.139631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.144223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.149638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.151291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.372253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:26.389810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12a47d73-7d23-4d8f-9d0f-b23f87f01de8 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1478 microversion: 2.1 time: 1.337761 Oct 04 17:57:26.394644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1224/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1478 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:26.414138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:26.414919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:26.458045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.462569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.465545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.466379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.472523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.473064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.214196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.233700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90659fe1-6842-4f12-8cd6-cdc57d6ccd21 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1258 microversion: 2.1 time: 0.830041 Oct 04 17:57:27.234603 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1225/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:26 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1258 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:27.263116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Calling method '.version_select at 0x7f6345c84ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.120759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.121397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.121692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.122596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.123258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.124253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.164292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:28.207227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c36f2435-58a2-4dc3-a5ea-98c486d27ec8 tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6/detail" status: 200 len: 463 microversion: 2.57 time: 0.959794 Oct 04 17:57:28.208337 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1226/2021] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 17:57:27 2022] GET /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6/detail => generated 463 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:28.233177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c333a02-e693-4386-af5d-74e309a03853 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63418a9430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.364285 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c333a02-e693-4386-af5d-74e309a03853 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.153031 Oct 04 17:57:28.374671 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1227/2022] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:28.383644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.390965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.413648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.415883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.417109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.420232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.422924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.424849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.102018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.111808 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6deeacf9-6be9-4a48-93f6-3f169581e6d0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1478 microversion: 2.1 time: 0.735581 Oct 04 17:57:29.118412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1228/2023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1478 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:29.133803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12ec711-6fda-4a8c-842b-a316314701b0", "name": "network-vif-deleted", "tag": "e760d0c3-a277-4255-a795-c611a616c39f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:29.183517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.184269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.186451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.214789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_external_events [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] Unable to find a host for instance b12ec711-6fda-4a8c-842b-a316314701b0. Dropping event network-vif-deleted {{(pid=128770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 17:57:29.222994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9c72bdad-b027-442a-8742-85a095bfdc6e req-8cb0e1b5-0ca5-4b93-826a-9a1db10fca5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.099787 Oct 04 17:57:29.223938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1229/2024] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 17:57:29.229659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:29.244008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:29.250521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.251287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.251900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.252855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.253580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.254138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.337133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.337628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.338080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.338519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'fault' on Instance uuid b12ec711-6fda-4a8c-842b-a316314701b0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:29.489472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.513488 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3a57691-36c5-4b6c-a730-f5e78d55f1d2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 200 len: 1220 microversion: 2.1 time: 0.288168 Oct 04 17:57:29.523252 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1230/2025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:29 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 1220 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:29.544634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Action: 'update', calling method: .version_select at 0x7f6345ca4790>, body: {"quota_set": {"ram": "2048"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:29.924806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.929449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.932874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.936448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.940077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.940725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.037953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.041294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.042115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.044355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.047354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.048337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.205501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:30.252597 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ad2eac2-f523-4e97-ae72-2f745526e17e tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6?user_id=2994adfc4419444ab8a91a80b264ff6e" status: 200 len: 148 microversion: 2.57 time: 0.727875 Oct 04 17:57:30.260419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1231/2026] 10.222.0.33 () {62 vars in 1384 bytes} [Tue Oct 4 17:57:29 2022] PUT /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6?user_id=2994adfc4419444ab8a91a80b264ff6e => generated 148 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:30.276038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-770b58e2-3c94-43b5-8f0d-e6e64674f9a5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341827820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.403629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-770b58e2-3c94-43b5-8f0d-e6e64674f9a5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.132114 Oct 04 17:57:30.404573 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1232/2027] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:30.418344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.422784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.443249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.451631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.452434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.454801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.457366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.466639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.837272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.863476 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a140c54a-ba2f-4b90-a937-597fb5ca2130 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1478 microversion: 2.1 time: 0.452885 Oct 04 17:57:30.876081 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1233/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1478 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:30.886336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-babc1d6b-b33a-458b-a5c9-9d6a37b13a7a tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] Calling method '.version_select at 0x7f6345ca40d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:31.434092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-babc1d6b-b33a-458b-a5c9-9d6a37b13a7a tempest-QuotasAdminTestV257-88039847 tempest-QuotasAdminTestV257-88039847-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6?user_id=2994adfc4419444ab8a91a80b264ff6e" status: 200 len: 190 microversion: 2.57 time: 0.556751 Oct 04 17:57:31.439374 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1234/2029] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/os-quota-sets/bab365e946dd4e59916fd0c8596ab5b6?user_id=2994adfc4419444ab8a91a80b264ff6e => generated 190 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:31.458202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:31.461284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:31.479544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.481207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.483288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.484308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.486053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.487781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.529938 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 HTTP/1.1 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b12ec711-6fda-4a8c-842b-a316314701b0'} Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.538259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 17:57:31.541565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.549436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:31.550556 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c86b5389-1a8c-483c-a920-1ca6755c8e01 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 404 len: 111 microversion: 2.1 time: 0.109382 Oct 04 17:57:31.558607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1235/2030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:31 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:31.575507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48ca1740-eb1f-45ac-bfeb-26bc9b269a48 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63418a9670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:31.661567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48ca1740-eb1f-45ac-bfeb-26bc9b269a48 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.099729 Oct 04 17:57:31.663089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1236/2031] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:31 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:31.841392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2079423552", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.917714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:32.554026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:32.554656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:32.555145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:32.555672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:32.556201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:32.567546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.568775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.569326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.570199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.570907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.571628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.597214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:32.612403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:32.642541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:32.648469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:32.780102 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-219f451a-ebc6-4f81-882e-e2cc2157496c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942987 Oct 04 17:57:32.782738 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1237/2032] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:32.793879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.803105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:32.846211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.847616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.850597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.852848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.854310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.856867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.414258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.426227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51d368d5-91c0-46af-bdd2-fbfa704eb084 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1478 microversion: 2.1 time: 0.642117 Oct 04 17:57:33.430919 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1238/2033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1478 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:33.442841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "name": "network-vif-plugged", "status": "completed", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:33.458236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.459294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.460000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.493823 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] Creating event network-vif-plugged:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:57:33.504693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-93487780-37b9-467e-a764-ea26952ef943 req-5333577c-b6f9-43ee-9e0c-c3548f7ac446 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070411 Oct 04 17:57:33.511266 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1239/2034] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:33.519158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e1ed9b9f-cdff-41dd-b86a-4b4a5723b18a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341827310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.589014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e1ed9b9f-cdff-41dd-b86a-4b4a5723b18a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.075559 Oct 04 17:57:33.591152 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1240/2035] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:33.597345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c826720f-d74c-485a-ba0e-8c24d1fa74e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.598414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c826720f-d74c-485a-ba0e-8c24d1fa74e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:33.900142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c826720f-d74c-485a-ba0e-8c24d1fa74e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.921234 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c826720f-d74c-485a-ba0e-8c24d1fa74e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1215 microversion: 2.1 time: 0.328552 Oct 04 17:57:33.926627 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1241/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:34.458505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.460552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:34.498510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.504451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.505319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.510914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.515553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.516857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.867006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:34.888993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89f11bde-9a2d-4582-a35c-90e56d1b9674 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1478 microversion: 2.1 time: 0.436291 Oct 04 17:57:34.890319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1242/2037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1478 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:34.924891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4b0fe93-de45-47ce-851d-7393762c67bd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63418be430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.008182 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4b0fe93-de45-47ce-851d-7393762c67bd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1413 microversion: 2.1 time: 0.115731 Oct 04 17:57:35.009991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1243/2038] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.021187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.023829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.039439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.041841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.043680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.045264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.046375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.047586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.192890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:35.205570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d542f5a3-8024-49b2-8156-1095cb58a801 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1267 microversion: 2.1 time: 0.194256 Oct 04 17:57:35.206405 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1244/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.924855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.924855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.931932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.932535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.932987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.933700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.934151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.934735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.363915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:36.373449 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e960e64f-8cf9-4acb-abbe-c9e02fc52a42 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1463 microversion: 2.1 time: 0.458483 Oct 04 17:57:36.391460 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1245/2040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1463 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:36.406507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-328c56bb-5134-4a0a-b0d8-55b9e7497fae tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341a15ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.465129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-328c56bb-5134-4a0a-b0d8-55b9e7497fae tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1422 microversion: 2.1 time: 0.072171 Oct 04 17:57:36.480215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1246/2041] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:36.485451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.487902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:36.502561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.503444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.504230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.505157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.506502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.507226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.598449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:36.607778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0c6396e-3240-4653-8d56-2727a3e1d168 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1273 microversion: 2.1 time: 0.126323 Oct 04 17:57:36.610120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1247/2042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:36.616311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:36.618688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:36.626997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.627852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.628469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.629732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.630356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.631844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.775799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-60c504a0-6405-4145-bf7d-d35501f35d60 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 0 microversion: 2.1 time: 0.163759 Oct 04 17:57:36.777087 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1248/2043] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:36 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:36.783069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6d183fa-def4-4c01-8321-7d21cbafb4e9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63418be160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.848718 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6d183fa-def4-4c01-8321-7d21cbafb4e9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 200 len: 1422 microversion: 2.1 time: 0.070323 Oct 04 17:57:36.858100 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1249/2044] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:36.858100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.858100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:36.865604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.866434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.866580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.867734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.868258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.868718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.917687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.919933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.920734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.921216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lazy-loading 'fault' on Instance uuid b8a67720-d954-40a2-aae5-71ae42c6d9f9 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:37.268672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db63b278-ae0a-4ca9-b057-10134db62221 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1599 microversion: 2.1 time: 0.417558 Oct 04 17:57:37.273909 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1250/2045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1599 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:37.279018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7ee5bd8-289e-412a-ac0b-b878b80d10d0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345cd6d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:38.780927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7ee5bd8-289e-412a-ac0b-b878b80d10d0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 204 len: 0 microversion: 2.1 time: 1.505645 Oct 04 17:57:38.782316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1251/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:37 2022] DELETE /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 0 bytes in 1508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:39.208897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-630199582", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:39.306809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:39.307572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:39.308067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:39.308641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:39.309073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:39.334508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.335061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.335509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.336346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.337812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.339318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.391921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Getting quotas for project c6c14a72309845b087dd7a836938c79b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:39.403486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Getting quotas for user 3571343ed2c24d37bf9385ec6552da2c and project c6c14a72309845b087dd7a836938c79b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:39.420755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:39.423695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:39.529131 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-659a5e40-baad-480f-99e7-020617229c4e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.745536 Oct 04 17:57:39.533318 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1252/2047] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:57:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:57:39.544852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:39.548392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:39.558780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.562315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.562919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.565118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.566016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.566668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.690712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:39.725217 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28292431-3e9a-496a-99e7-3b728b414cd6 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action" status: 202 len: 0 microversion: 2.1 time: 0.188095 Oct 04 17:57:39.730606 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1253/2048] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:39 2022] POST /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:39.736912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:39.737935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:39.747345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.748100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.749051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.750569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.752988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.753677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.762996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:40.785108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07139e00-5bd6-4558-b74a-30c520090b83 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1315 microversion: 2.1 time: 1.052996 Oct 04 17:57:40.790900 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1254/2049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:39 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:40.806929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37b94009-456c-4684-a9b6-018aad209261 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6342021c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:40.916037 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37b94009-456c-4684-a9b6-018aad209261 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd" status: 200 len: 637 microversion: 2.1 time: 0.121583 Oct 04 17:57:40.917059 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1255/2050] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:57:40 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd => generated 637 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:40.936971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:40.937522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:40.965421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.967834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.969480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.973901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.975978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.976726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.075956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:41.330617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90605b0e-f9f0-4116-aeb6-f4d7bcd0ef29 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 204 len: 0 microversion: 2.1 time: 0.408594 Oct 04 17:57:41.331441 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1256/2051] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:40 2022] DELETE /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:41.354367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd", "tag": "883ae1db-2a78-4889-8a05-a9984cc418ab"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:41.386041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.388846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.389366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.416903 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] Creating event network-changed:883ae1db-2a78-4889-8a05-a9984cc418ab for instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd on n-h1-831193-17 Oct 04 17:57:41.430256 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bfe88093-6485-48d9-9e9c-c283652888f5 req-48fde80e-4c31-48df-9abe-7d4ca61531c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097579 Oct 04 17:57:41.434819 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1257/2052] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:41.445687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:41.446428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:41.467445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.468011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.468825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.469587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.472820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.473273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.672930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:41.686977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:41.688861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:41.695171 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f115d5b0-4f01-497c-bb9b-06c673d87acf tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1504 microversion: 2.91 time: 0.257572 Oct 04 17:57:41.708131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1258/2053] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:41 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:41.727062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:41.727914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:41.735186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.735839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.736288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.738313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.738986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.739857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:42.038730 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50fc9886-6a9e-49b6-ac3c-ab960a1a31c9 tempest-ServersAdminTestJSON-1084508618 tempest-ServersAdminTestJSON-1084508618-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1616 microversion: 2.1 time: 0.317524 Oct 04 17:57:42.040390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1259/2054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:41 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1616 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:42.045331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf2603f-013e-44ee-af43-849d98b3f91b", "name": "network-vif-unplugged", "status": "completed", "tag": "194d7870-4128-4b1c-8c84-713d1eed2d1c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:42.070170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:42.070840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:42.072177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:42.087219 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] Creating event network-vif-unplugged:194d7870-4128-4b1c-8c84-713d1eed2d1c for instance ddf2603f-013e-44ee-af43-849d98b3f91b on n-h2-831193-17 Oct 04 17:57:42.095386 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3a03dc1e-6c00-43b0-9cce-721d3134539c req-7bec470d-c01d-45e8-9b73-2df9b05b60f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052856 Oct 04 17:57:42.096759 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1260/2055] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:42.118366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f43ea2f8-9720-4353-86f2-544f29dd9eae tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345ca7e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:42.205055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f43ea2f8-9720-4353-86f2-544f29dd9eae tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:42.214382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f43ea2f8-9720-4353-86f2-544f29dd9eae tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:42.738128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f43ea2f8-9720-4353-86f2-544f29dd9eae tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.638857 Oct 04 17:57:42.743864 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1261/2056] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:57:42 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:43.105476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1015912238", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:43.195017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:43.622247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:43.622684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:43.623201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:43.623805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:43.624383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:43.629623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:43.651398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.652190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.654359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:43.658792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.659651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.662190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:43.729052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Getting quotas for project 8d201338e18f45c0ac7bebc2af097235. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:43.744142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Getting quotas for user 1fc5857887b54fe9b45c11d7542a42f9 and project 8d201338e18f45c0ac7bebc2af097235. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:43.777551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:43.780523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:43.872451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e71c66d-12d6-4e8b-a90e-7bb5a37f13a8 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126285 Oct 04 17:57:43.880203 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1262/2057] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:43.891582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1880586207", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:44.022910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] validate_networks() for [('c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:45.234744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:45.235936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:45.236901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:45.237488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:45.238153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:45.268162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.269019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.269623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.271544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.272543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.273520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.299268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:45.307231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for user 242be122e02f4be3abdd0e7a989764b4 and project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:45.324255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:45.326884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:45.416478 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57223574-881a-4ae1-89cb-cd61c9dd0280 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534123 Oct 04 17:57:45.417664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1263/2058] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:45.427986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:45.428711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:45.436921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.437903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.438736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.440522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.441589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.442113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.943760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:45.955017 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2f60483-05c2-4664-9e9a-3b2aeca37ffc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1315 microversion: 2.1 time: 0.536025 Oct 04 17:57:45.972804 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1264/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:45 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:45.987307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:45.996680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:46.037839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.042356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.042966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.047016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.047557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.055325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.148200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:46.373390 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-632c9182-45ec-4ffb-b78d-d1885a5802b4 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "DELETE /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 204 len: 0 microversion: 2.1 time: 0.396743 Oct 04 17:57:46.377938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1265/2060] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:45 2022] DELETE /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:46.392738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:46.393452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:46.412572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.414274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.414760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.416866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.417871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.418827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.557068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:46.571615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:46.574339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:46.583354 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a0918e7-ce32-4761-b2c2-bb253aa675c1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1531 microversion: 2.91 time: 0.202221 Oct 04 17:57:46.596147 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1266/2061] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:46 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1531 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:46.615012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7f343af-635b-4b47-bd00-3a29606faa21 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f63418275e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:47.088713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7f343af-635b-4b47-bd00-3a29606faa21 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "DELETE /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.490867 Oct 04 17:57:47.094689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1267/2062] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 17:57:46 2022] DELETE /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_version => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:47.102816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:47.103787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:47.114760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.115994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.116829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.117733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.118199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.118635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.275054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:47.304846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23d5f005-fe00-4325-9675-0ac5f41d5fdc tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1281 microversion: 2.1 time: 0.206053 Oct 04 17:57:47.304846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1268/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:47 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:47.342116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:47.343153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:47.353609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.354399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.355064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.356062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.356748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.357405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.516373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:47.529642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd65a9f0-66fe-4455-9fef-a7358b5fe5fd tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1204 microversion: 2.1 time: 0.206819 Oct 04 17:57:47.543319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1269/2064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:47 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1204 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:47.548552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf2603f-013e-44ee-af43-849d98b3f91b", "name": "network-vif-deleted", "tag": "194d7870-4128-4b1c-8c84-713d1eed2d1c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:47.569848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.570256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.570688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.602882 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] Creating event network-vif-deleted:194d7870-4128-4b1c-8c84-713d1eed2d1c for instance ddf2603f-013e-44ee-af43-849d98b3f91b on n-h2-831193-17 Oct 04 17:57:47.613837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5976c457-4035-41da-917e-3e7b708be13c req-b63092c5-d347-47a7-b163-dc7989c4d45e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076870 Oct 04 17:57:47.632937 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1270/2065] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:47.640161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:47.640872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:47.678524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.679088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.680099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:47.680231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:47.680684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:47.681118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:48.140808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:48.160276 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1852d3fd-cc61-47db-86b8-e5f5a17f1ca0 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1470 microversion: 2.1 time: 0.525897 Oct 04 17:57:48.160871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1271/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:47 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1470 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:48.481824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:48.482232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:48.496121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:48.496635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:48.497077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:48.497808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:48.498269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:48.498702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.145807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lazy-loading 'services' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:49.150798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:49.200247 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-870a15a5-08ef-449e-95db-197b50a7f3fd tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1938 microversion: 2.91 time: 1.037479 Oct 04 17:57:49.201358 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1272/2067] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:48 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1938 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:49.206439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:49.207313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:49.221725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.223650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.224320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.230648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.231397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.232022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.768504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:49.780176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c99f8a2-72dc-409d-8aa4-651ae318539f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1315 microversion: 2.1 time: 0.577597 Oct 04 17:57:49.781415 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1273/2068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:49 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:49.793538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14b6733c-431a-4bd5-86ac-a0b662bb3822 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6345ca74c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:49.870114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14b6733c-431a-4bd5-86ac-a0b662bb3822 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 37 microversion: 2.1 time: 0.085961 Oct 04 17:57:49.872654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1274/2069] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:57:49 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 37 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:49.889824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:49.890821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:49.905886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.906827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.907499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.908592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.909304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.909955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.312030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:50.325008 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44a61490-7883-4a42-9b31-648a3cd9367f tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1323 microversion: 2.1 time: 0.439019 Oct 04 17:57:50.345000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1275/2070] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:49 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:50.345000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:50.345614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:50.358384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.385058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.385439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.387966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.394378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.395314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.523949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:50.536361 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49d14217-ddb7-4550-8b9c-bd1dc918d2d9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1266 microversion: 2.1 time: 0.200276 Oct 04 17:57:50.540340 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1276/2071] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:50 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:50.560764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:50.563943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:50.583868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.587426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.588405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.601828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.603185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.603740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.670847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.671484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.672040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.672609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lazy-loading 'fault' on Instance uuid 730cb606-e8a8-4990-81fa-1909b721fa96 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:50.758706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:50.774617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6d29051-56e4-4d7e-b897-a893d1c92010 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 200 len: 1304 microversion: 2.1 time: 0.232826 Oct 04 17:57:50.785011 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1277/2072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:50 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:50.801238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:50.806906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:50.837188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.838042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.838699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.839666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.840292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.840878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:51.002442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lazy-loading 'services' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:51.045765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74d23c47-5e80-4bf3-be31-a2e407579595 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1938 microversion: 2.91 time: 0.242442 Oct 04 17:57:51.083884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1278/2073] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:50 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1938 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:51.090946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ccf0112f-bf04-49e3-908c-83306f4972cb tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345c95f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:51.191374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ccf0112f-bf04-49e3-908c-83306f4972cb tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:51.209244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ccf0112f-bf04-49e3-908c-83306f4972cb tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:51.880398 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ccf0112f-bf04-49e3-908c-83306f4972cb tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.795033 Oct 04 17:57:51.881207 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1279/2074] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:57:51 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:51.990036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f172975-5a2b-4fea-a832-029bc22f4219 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Action: 'create', calling method: .version_select at 0x7f6345c95c10>, body: {"keypair": {"name": "tempest-keypair-868230454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi1yjTYuYIMnMknS0iIh8tAW4M4jn4DnsoEmmWY4AC+VGf11Z8woXNySO7wJ/MABzh8j2J/8dxFGdy2FLJW9SoKaEmBtlCy4fOHkMkAuKwIJbRuKwT7LiQbdOgTPfiCsg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:52.038235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9f172975-5a2b-4fea-a832-029bc22f4219 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Getting quotas for project bcde371fdf6c404f8cfbac695be38cb5. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:52.053699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9f172975-5a2b-4fea-a832-029bc22f4219 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Getting quotas for user d3085832f1aa4500a42a57537d1e376b and project bcde371fdf6c404f8cfbac695be38cb5. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:52.109859 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f172975-5a2b-4fea-a832-029bc22f4219 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.226801 Oct 04 17:57:52.111594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1280/2075] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:57:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:52.125766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd", "name": "network-vif-plugged", "status": "completed", "tag": "883ae1db-2a78-4889-8a05-a9984cc418ab"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:52.158025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.158746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.159350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.188302 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] Creating event network-vif-plugged:883ae1db-2a78-4889-8a05-a9984cc418ab for instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd on n-h1-831193-17 Oct 04 17:57:52.203736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-45ad8b69-08c9-4d4c-92b8-0951d4fa8a7f req-337e1572-fa95-45a1-9377-170b7cdf7c68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082671 Oct 04 17:57:52.204778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1281/2076] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:52.218602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730cb606-e8a8-4990-81fa-1909b721fa96", "name": "network-vif-deleted", "tag": "31876ec8-28a9-4594-ba89-50fc196c5992"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:52.238596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.239004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.240057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.301465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] Creating event network-vif-deleted:31876ec8-28a9-4594-ba89-50fc196c5992 for instance 730cb606-e8a8-4990-81fa-1909b721fa96 on n-h1-831193-17 Oct 04 17:57:52.321333 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5708b7ad-5618-4f5a-a181-9a54748bc7a0 req-bf295fc0-b260-4553-b288-73c785000ed4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115111 Oct 04 17:57:52.321951 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1282/2077] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:52.327702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b04e653-a129-4d2c-8631-1f35ed8dc568", "tag": "8d6dc45b-9a2e-4f3c-8eac-569766e3c1be"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:52.346767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.350221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.351714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.387909 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] Creating event network-changed:8d6dc45b-9a2e-4f3c-8eac-569766e3c1be for instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 on n-h2-831193-17 Oct 04 17:57:52.402474 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e173eca0-8ffe-4812-8683-db784aec010b req-f441e76a-e254-44bc-aa78-146755f1ef94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077224 Oct 04 17:57:52.403186 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1283/2078] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:52.416133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:52.416837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:52.425841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.426408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.426920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.428706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.429331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.429816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.805621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:52.821824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db686822-58e2-47ab-9289-540684caeab9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1315 microversion: 2.1 time: 0.411552 Oct 04 17:57:52.833591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1284/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:52 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:52.839617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:52.845095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.845590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.846024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.846794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.847278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.847702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.859838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=18 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:52.871604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:52.890321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64d820a0-b5bb-4d53-bb24-d83ddb072814 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.055265 Oct 04 17:57:52.895397 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1285/2080] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 17:57:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:52.904048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:52.905033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:52.913354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.914164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.914837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.915899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.916525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.917116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.270682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:53.280176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6c4270d-1f6b-41c2-86ff-3f6902454017 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1323 microversion: 2.1 time: 0.382823 Oct 04 17:57:53.280998 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1286/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:52 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:53.286130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:53.290359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:53.312706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.313256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.313703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.314500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.315171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.315974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.609079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:53.618772 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d4f9cd7-6364-45aa-90af-cb729f009f3e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1308 microversion: 2.1 time: 0.336473 Oct 04 17:57:53.622268 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1287/2082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:53 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:53.628443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:53.629076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: 730cb606-e8a8-4990-81fa-1909b721fa96] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:53.648563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.651766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.653650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.654620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.656817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.657549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.692227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] HTTP exception thrown: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Request method failure captured: Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 HTTP/1.1 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN1Xoxz3v8EOZe6EeLoOEAkD-nSGpxDINXE_5zR7K8StMv-EOWEQhSvS1vPycpkerdMM787y_HX5Cy-6vC3qz74uvW2v8bfGJjxOBLvumv-hHqsYkw3lJ-kLu00ccGEtaA4faHMIsepebfyLc0z9dYPt_kAHNGC_BGPfpS-VIMCDvc Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 05c694e9eeb548fea9e2ec8a311c8485 Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '730cb606-e8a8-4990-81fa-1909b721fa96'} Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:53.694533 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:57:53.700413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Returning 404 to user: Instance 730cb606-e8a8-4990-81fa-1909b721fa96 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:53.708026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8bc12a9a-8cb5-4c48-8335-5be4ac1b416c tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96" status: 404 len: 111 microversion: 2.1 time: 0.083669 Oct 04 17:57:53.711825 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1288/2083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:53 2022] GET /compute/v2.1/servers/730cb606-e8a8-4990-81fa-1909b721fa96 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:53.717223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4875233c-d1c5-47bf-92b3-df28511775bc tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6345d1fa60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:53.797668 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4875233c-d1c5-47bf-92b3-df28511775bc tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.084313 Oct 04 17:57:53.803666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1289/2084] 10.222.0.33 () {58 vars in 1290 bytes} [Tue Oct 4 17:57:53 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_distro => generated 33 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:53.818960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:53.819893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:53.843440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.846539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.847947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.850635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.855289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.855952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.918942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lazy-loading 'flavor' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:54.389053 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-331f8554-b522-4e2b-b376-7be8b00ea2e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action" status: 202 len: 0 microversion: 2.91 time: 0.580057 Oct 04 17:57:54.401036 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1290/2085] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:57:53 2022] POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:54.527772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-23851212", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "dd2515c9-7124-48d1-ac9d-0adbd3cbee6d"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:54.607160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] validate_networks() for [('dd2515c9-7124-48d1-ac9d-0adbd3cbee6d', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:55.485015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:55.485622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:55.485911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:55.488178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:55.488653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:55.516082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=65 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:55.520653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:55.527096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:55.528076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:55.528929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:55.532792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:55.533548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:55.569810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Getting quotas for project 3cb93ab4b64b462c9cd15c7755873adb. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:55.585747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Getting quotas for user 3041a7e2557d4c0ab0ceb4ebe4260543 and project 3cb93ab4b64b462c9cd15c7755873adb. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:55.603731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:55.607986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:55.665405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70f39303-f4bf-4300-aeae-d8167849bbc8 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261920 Oct 04 17:57:55.666765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1291/2086] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:55.671773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:55.672272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:55.680235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:55.680823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:55.681333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:55.682121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:55.682647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:55.683390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:55.719912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:55.843798 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1028f9d4-0fc7-4b13-92e9-dc23e602e583 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 204 len: 0 microversion: 2.1 time: 0.174983 Oct 04 17:57:55.844372 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1292/2087] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:55 2022] DELETE /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:55.855299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab663d76-11f4-4485-b0ec-7b3a55f8f3f7 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345e2c700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:55.950712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ab663d76-11f4-4485-b0ec-7b3a55f8f3f7 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:55.960389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ab663d76-11f4-4485-b0ec-7b3a55f8f3f7 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:56.268133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab663d76-11f4-4485-b0ec-7b3a55f8f3f7 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.418766 Oct 04 17:57:56.274322 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1293/2088] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:57:55 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:56.281782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:56.283783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:56.300688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.301441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.302587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.305497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.306164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.307837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.316988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:56.543209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:56.554232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-efbb7365-46ad-4206-8c47-8e17fcf3ecfa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1502 microversion: 2.1 time: 0.278021 Oct 04 17:57:56.567062 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1294/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:56 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:56.567062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:56.567062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:56.571287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.571626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.573570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.573570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.573570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.574826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.792389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:56.805065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c315899-bcd3-4e8a-a02d-c005b67dda4c tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1323 microversion: 2.1 time: 0.248191 Oct 04 17:57:56.816704 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1295/2090] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:56 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:56.834849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f697c6-a0a9-4b57-84d2-901ee9d33a75", "tag": "86187b11-5875-4c36-a06f-08b870787b51"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:56.850430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.850430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.850817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.866022 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] Creating event network-changed:86187b11-5875-4c36-a06f-08b870787b51 for instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 on n-h2-831193-17 Oct 04 17:57:56.872466 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-86da8891-53d7-4113-a823-1ee11d78ada0 req-ed2562bd-87de-47c9-824d-7b9fce99bf27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047293 Oct 04 17:57:56.873408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1296/2091] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:56.880356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:56.881241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:56.891174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.891684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.892641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.892853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.893314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.893745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.034141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:57.043682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:57.045488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:57.050933 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-359776de-7674-4100-be9e-f06ff8eeee3f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.176656 Oct 04 17:57:57.051569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1297/2092] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:56 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:57.057602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:57.058092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:57.064563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:57.065336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:57.065779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.066477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:57.066931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:57.067892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.315333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:57.326309 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ebc067d2-dba2-4e04-a35c-09b6f12c97a2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1308 microversion: 2.1 time: 0.273377 Oct 04 17:57:57.328435 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1298/2093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:57 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:57.340294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "56ee365f-3ced-4663-b98c-8437cd1625ef"}], "security_groups": [{"name": "tempest-securitygroup--2005947312"}], "key_name": "tempest-keypair-868230454", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:57.871963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] validate_networks() for [('56ee365f-3ced-4663-b98c-8437cd1625ef', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:58.964054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:58.964633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:58.965108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:58.965522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:58.966225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:58.980553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.984155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.987245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:58.990174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.996660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.997068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.034088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Getting quotas for project bcde371fdf6c404f8cfbac695be38cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:59.040947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Getting quotas for user d3085832f1aa4500a42a57537d1e376b and project bcde371fdf6c404f8cfbac695be38cb5. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:59.060275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:59.063049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:59.131447 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de6dfb57-a703-4756-892c-31d6e880dd68 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.800667 Oct 04 17:57:59.132103 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1299/2094] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:59.137841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.139258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.150297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.152443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.153238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.154437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.155493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.156246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.412496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:59.420785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd3e958a-4ea5-4e29-a1fd-b148833f7f98 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.287091 Oct 04 17:57:59.425258 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1300/2095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:59.435672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.441635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.457176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.463632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.464322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.465065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.465516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.465940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.518363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.519538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.520231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.521366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lazy-loading 'fault' on Instance uuid f0eb8fff-2237-43d4-9e47-14ebd914088d {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:59.585925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:59.594735 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4940c6f-8e3d-4881-a329-4f0d67d37421 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 200 len: 1303 microversion: 2.1 time: 0.162672 Oct 04 17:57:59.595581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1301/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:59.601345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33deb890-ac23-449a-91db-ca101e2ba9b5 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6340ef53a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.652009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33deb890-ac23-449a-91db-ca101e2ba9b5 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055145 Oct 04 17:57:59.653217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1302/2097] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:59.660853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:59.661760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.670697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.671245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.671855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.672818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.673430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.674074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.760160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae9d961d-72e2-4a28-b98e-7e77ad67d705 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd/action" status: 202 len: 0 microversion: 2.1 time: 0.104356 Oct 04 17:57:59.764881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1303/2098] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:59 2022] POST /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:59.775908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.776929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.785244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.785244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.785244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.786333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.786947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.787500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.000454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.018584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cab41e7a-6ef0-4ff3-aebd-08a437e9f9da tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1323 microversion: 2.1 time: 0.256331 Oct 04 17:58:00.038667 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1304/2099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:00.045197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:00.046102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:00.057933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.058643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.059279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.060277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.060783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.061266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.200209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.225557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.227683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.237299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17887cb8-4f0d-4462-abe2-e4516cad0dac tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.196197 Oct 04 17:58:00.240345 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1305/2100] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:00 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:00.248242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b04e653-a129-4d2c-8631-1f35ed8dc568", "name": "network-vif-plugged", "status": "completed", "tag": "8d6dc45b-9a2e-4f3c-8eac-569766e3c1be"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:00.260563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.261269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.261863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.276011 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] Creating event network-vif-plugged:8d6dc45b-9a2e-4f3c-8eac-569766e3c1be for instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 on n-h2-831193-17 Oct 04 17:58:00.281342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-394f04c6-f719-4f17-918d-7208533993a3 req-d44cbe2c-fc9a-41e3-affb-7ba177f258f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038353 Oct 04 17:58:00.282148 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1306/2101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:00.288646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:00.289525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:00.296368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.297354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.297949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.299521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.300142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.300736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.599255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.607607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a2db3f7-c5de-4473-aaf0-e5d08bca4159 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1308 microversion: 2.1 time: 0.324019 Oct 04 17:58:00.608192 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1307/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:00 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:00.615641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eb8fff-2237-43d4-9e47-14ebd914088d", "name": "network-vif-deleted", "tag": "8be6f217-129a-4ce3-a1c9-41769d091d4c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:00.627320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.627812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.628253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.641825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] Creating event network-vif-deleted:8be6f217-129a-4ce3-a1c9-41769d091d4c for instance f0eb8fff-2237-43d4-9e47-14ebd914088d on n-h2-831193-17 Oct 04 17:58:00.648195 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3ca27e00-0925-4cb2-9052-8b6be6af6036 req-042187d0-f135-4248-aea8-ff8129e175f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038624 Oct 04 17:58:00.648906 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1308/2103] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:00.660662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:00.661625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:00.671158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.671582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.672275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.673387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.674058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.674895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.780057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.790535 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85314202-02b2-4fb3-820f-41231c11d314 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1277 microversion: 2.1 time: 0.140115 Oct 04 17:58:00.806358 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1309/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:00 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:00.806358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7001bdf2-d351-4ea4-a375-f686d31a401e tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345c95550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:00.866893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7001bdf2-d351-4ea4-a375-f686d31a401e tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:00.873534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7001bdf2-d351-4ea4-a375-f686d31a401e tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:00.887224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:01.073426 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7001bdf2-d351-4ea4-a375-f686d31a401e tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.280237 Oct 04 17:58:01.078271 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1310/2105] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:58:00 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:01.083276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:01.083931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:01.090584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.091324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.091930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.092662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.093127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.093557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.292963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:01.300940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63fa9223-3a76-4e2d-8e86-9a5944a4ccce tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1487 microversion: 2.1 time: 0.221479 Oct 04 17:58:01.301523 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1311/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:01 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1487 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:01.306731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:01.307262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:01.313734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.313734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.314257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.314972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.315478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.315905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.459999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:01.468029 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c42ffd94-86c7-477f-9fb2-1282172d0811 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.164800 Oct 04 17:58:01.468527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1312/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:01 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:01.473254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:01.474575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: f0eb8fff-2237-43d4-9e47-14ebd914088d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:01.481080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.481570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.482254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.483437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.484070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.484502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.499298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] HTTP exception thrown: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Request method failure captured: Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d HTTP/1.1 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN1Xoxz3v8EOZe6EeLoOEAkD-nSGpxDINXE_5zR7K8StMv-EOWEQhSvS1vPycpkerdMM787y_HX5Cy-6vC3qz74uvW2v8bfGJjxOBLvumv-hHqsYkw3lJ-kLu00ccGEtaA4faHMIsepebfyLc0z9dYPt_kAHNGC_BGPfpS-VIMCDvc Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 05c694e9eeb548fea9e2ec8a311c8485 Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f0eb8fff-2237-43d4-9e47-14ebd914088d'} Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:01.500962 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Returning 404 to user: Instance f0eb8fff-2237-43d4-9e47-14ebd914088d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d65e42b8-4e5c-4004-aa32-e2f2ca5cdd91 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d" status: 404 len: 111 microversion: 2.1 time: 0.032763 Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1313/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:01 2022] GET /compute/v2.1/servers/f0eb8fff-2237-43d4-9e47-14ebd914088d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:01.507934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:01.508533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:01.515105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.515621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.516054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.516886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.517362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.517780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.679366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:01.681806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:01.691226 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b843fe54-bba0-4ceb-82ce-bfdb51814b96 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1323 microversion: 2.1 time: 0.185639 Oct 04 17:58:01.695448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1314/2109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:01 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:01.700801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66ec18e1-ef9c-4921-9b89-3670a0d81260 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345d1f5e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:01.758630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-66ec18e1-ef9c-4921-9b89-3670a0d81260 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:01.764889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-66ec18e1-ef9c-4921-9b89-3670a0d81260 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:02.090495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66ec18e1-ef9c-4921-9b89-3670a0d81260 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.393838 Oct 04 17:58:02.091114 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1315/2110] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:58:01 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 64 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:02.096369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.096984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.103989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.104478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.104916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.105620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.106076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.106505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.173323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.182261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.183745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.189014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d5794f2-79b0-4af3-93fe-2a1f8cb6fae3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.096882 Oct 04 17:58:02.189593 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1316/2111] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:02.194673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.195199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.201389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.201878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.202312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.203008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.203488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.203913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.232926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:02.322269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db77c778-5eec-47fd-9c10-5b43f92e5582 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 204 len: 0 microversion: 2.1 time: 0.131341 Oct 04 17:58:02.323119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1317/2112] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:02 2022] DELETE /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:02.328580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.329338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.336165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.336662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.337106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.337812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.338268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.338696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.365552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:02.451655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b184fc0-9818-41d0-b759-43c9b3be9149 tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 204 len: 0 microversion: 2.1 time: 0.126867 Oct 04 17:58:02.452235 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1318/2113] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:02 2022] DELETE /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:02.457674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.458954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.467720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.468214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.468650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.469355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.469815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.470240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.615143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.623378 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b668dcd-3235-472d-a558-93ec21a9c4e0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1308 microversion: 2.1 time: 0.169879 Oct 04 17:58:02.631226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1319/2114] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:02.631226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.631226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.636284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.636780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.637216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.637926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.638383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.638811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.777319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.786801 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2df1418-9b36-4141-8d3b-a06682858541 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.161378 Oct 04 17:58:02.787942 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1320/2115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:02.794750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29972f36-4efa-4692-a45a-e1aedbf7f54d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6340f26ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.840627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29972f36-4efa-4692-a45a-e1aedbf7f54d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.051166 Oct 04 17:58:02.842874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1321/2116] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 64 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:02.848818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f697c6-a0a9-4b57-84d2-901ee9d33a75", "name": "network-vif-plugged", "status": "completed", "tag": "86187b11-5875-4c36-a06f-08b870787b51"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:02.858688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.859271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.859769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.871949 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] Creating event network-vif-plugged:86187b11-5875-4c36-a06f-08b870787b51 for instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 on n-h2-831193-17 Oct 04 17:58:02.877086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9f7044bd-a522-47dd-88ee-ca82ecf30cac req-e1845da3-ebf1-426a-8d6a-409ed92673e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Oct 04 17:58:02.878115 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1322/2117] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:02.886470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.887242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.893953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.894460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.894897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.895729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.896183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.896629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.100237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.108440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8ecb3147-49fa-46b3-b9a9-a11d3e9d68a6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1493 microversion: 2.1 time: 0.229183 Oct 04 17:58:03.109001 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1323/2118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.113598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.114275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:03.120711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.121198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.121844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.122323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.122807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.123277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.216797 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 17:58:03.217326 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 17:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 17:58:03.260440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.268311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d42cffb-b5d5-4627-a863-e687feb198db tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1469 microversion: 2.1 time: 0.158304 Oct 04 17:58:03.268910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1324/2119] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.274566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.275686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:03.283614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.284104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.284535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.285230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.285706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.286733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.420894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.428956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e85c94e-b15f-4e0f-94f1-d4241b584326 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.159038 Oct 04 17:58:03.429565 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1325/2120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.434115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4fab68-ba79-4973-9de3-596bdd192859", "tag": "07cf5d94-9d54-4b86-b045-a01b354989a0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:03.444280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.444780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.445191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.456472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] Creating event network-changed:07cf5d94-9d54-4b86-b045-a01b354989a0 for instance 3d4fab68-ba79-4973-9de3-596bdd192859 on n-h1-831193-17 Oct 04 17:58:03.462074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e9992387-9615-42f3-aa8f-bce9a9f6c620 req-3e902c12-4ddb-46d4-b4a9-7f2cef22e8dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Oct 04 17:58:03.462668 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1326/2121] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:03.467608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.468289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:03.475831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.476189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.476622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.477311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.477761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.478176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.625796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.634788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a46ac3a3-7244-4bcc-819d-824425c96b27 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1472 microversion: 2.1 time: 0.170668 Oct 04 17:58:03.635417 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1327/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.641043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf38e861-d994-4240-b61b-25c32d1a0d17 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6340f26ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:03.694158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bf38e861-d994-4240-b61b-25c32d1a0d17 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:03.699968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-bf38e861-d994-4240-b61b-25c32d1a0d17 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:04.018850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf38e861-d994-4240-b61b-25c32d1a0d17 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.382249 Oct 04 17:58:04.019515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1328/2123] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:58:03 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:04.024847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5940395-039b-4cc9-8177-e90bf81140bf", "tag": "084cf59a-af00-484a-acc7-67bfcda33a09"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:04.034694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.035212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.035646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.047443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] Creating event network-changed:084cf59a-af00-484a-acc7-67bfcda33a09 for instance f5940395-039b-4cc9-8177-e90bf81140bf on n-h1-831193-17 Oct 04 17:58:04.052753 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7ebfface-7852-4b39-bf92-4812b472c1c4 req-7ab5ffa3-3a1d-418c-84ce-32a0e27b36a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031970 Oct 04 17:58:04.053358 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1329/2124] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:04.058521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.059231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.065368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.065860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.066289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.066987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.068198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.068630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.141148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.151242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.153492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.163434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-192ca91e-b469-4b5a-8a94-e41becf1ff7f tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.108260 Oct 04 17:58:04.165204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1330/2125] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:04.172535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.173644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.185636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.186418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.187212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.188450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.189259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.190016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.337994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.345875 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5d8c293-2b78-4df5-97ea-ab7f7c12413b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1308 microversion: 2.1 time: 0.179990 Oct 04 17:58:04.346449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1331/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:04.351015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.351531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.357501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.357986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.358423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.359144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.359601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.360028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.386138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Request method failure captured: Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568/diagnostics HTTP/1.1 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQTT42YjONtcrag0OCL96ueD-c52BBwU7QNMljY4yqkH3LRgtchBOyjZ9PACles9nVfyIiC3w9ey8XCwSi_cxYa7pyv0SmSZ3dlRqS5kCG4hAXpzlvRFQS9oTmRhRBGXaiVFWjMrd8DWLS_zzNQlMMrR3Zjk8H4GN_KBVvVtCOtTuk Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8d201338e18f45c0ac7bebc2af097235 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8d201338e18f45c0ac7bebc2af097235 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerDiagnosticsNegativeTest-2075010644-project Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1fc5857887b54fe9b45c11d7542a42f9 Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2075010644-project Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '2b04e653-a129-4d2c-8631-1f35ed8dc568'} Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:04.392881 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e35a7d3d-63ca-4126-91ba-22ab85e01d18 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.046926 Oct 04 17:58:04.396934 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1332/2127] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568/diagnostics => generated 117 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:04.400060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.400060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.406101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.406590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.407075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.407755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.408209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.408639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.425223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:04.550682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.559135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c703cbc-21f7-4824-8f20-7f8952226027 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.163232 Oct 04 17:58:04.559728 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1333/2128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:04.564335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74bb78ee-ee0a-4f28-80ed-4448bce1f49d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update', calling method: .version_select at 0x7f6345e2c310>, body: {"meta": {"os_version": "alt"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:04.615773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-74bb78ee-ee0a-4f28-80ed-4448bce1f49d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:04.621794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-74bb78ee-ee0a-4f28-80ed-4448bce1f49d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:04.885969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74bb78ee-ee0a-4f28-80ed-4448bce1f49d tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.325115 Oct 04 17:58:04.886601 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1334/2129] 10.222.0.33 () {60 vars in 1313 bytes} [Tue Oct 4 17:58:04 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata/os_version => generated 31 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:04.892182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.896134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.900416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.901461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.902109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.902890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.903426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.903851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.141042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.150569 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce5657ee-5290-4005-8bbd-32f1936c218c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1493 microversion: 2.1 time: 0.262734 Oct 04 17:58:05.154824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1335/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:05.162858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.163726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.170498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.171496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.171611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.172366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.173485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.173933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.377336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c694e9eeb548fea9e2ec8a311c8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd740fd379d8f4d3ca498d2ae25f383af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.388667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4927077f-0477-40d1-a9cd-c2421eebad5b tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 200 len: 1469 microversion: 2.1 time: 0.232293 Oct 04 17:58:05.403063 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1336/2131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:05.403063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.403063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.403846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.404353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.404797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.406088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.406088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.406413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.436137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:05.551009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19be4674-d709-4c35-b4ce-5f1c75661b0b tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 204 len: 0 microversion: 2.1 time: 0.159792 Oct 04 17:58:05.553398 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1337/2132] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:05 2022] DELETE /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:05.565441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.566326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.579467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.580205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.580849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.581763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.582412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.583061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.742754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.751740 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2c669fe-1aae-441a-a8c4-07b0db015336 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.196461 Oct 04 17:58:05.758280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1338/2133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:05.763632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76ce4f04-4f27-4de5-a1a6-46d709ea7140 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f63417efaf0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.805491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76ce4f04-4f27-4de5-a1a6-46d709ea7140 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 58 microversion: 2.1 time: 0.045832 Oct 04 17:58:05.806064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1339/2134] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 58 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:05.814453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.814453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.821188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.821815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.822266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.823161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.823462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.823896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.900537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.910041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.911585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.917270 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6fa0eabc-10f0-4add-b631-2c52f338db51 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.110151 Oct 04 17:58:05.917851 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1340/2135] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:05.924652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.926670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.933879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:05.950263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.950767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.951244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.951976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.952444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.952879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.119496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:06.128645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bcc2098-2dd4-4192-a16b-6ba02ea57830 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1488 microversion: 2.1 time: 0.208319 Oct 04 17:58:06.130106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1341/2136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.153398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:06.154059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:06.161716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.161962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.162615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.163477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.164049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.164691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.467173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc5857887b54fe9b45c11d7542a42f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d201338e18f45c0ac7bebc2af097235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:06.478261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19b9dc4c-e4e5-4bc1-9f25-5f3a75b38927 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 200 len: 1478 microversion: 2.1 time: 0.337751 Oct 04 17:58:06.478881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1342/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:06 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 1478 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.501738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:06.502350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:06.510277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.511067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.511501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.512213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.512664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.513243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.756750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:06.768438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc18f1dc-d574-4c1a-adea-ab221f88fa46 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.272453 Oct 04 17:58:06.769520 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1343/2138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:06 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.788503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be38e683-98e7-4da4-a1c9-5ec091805f02 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'update_all', calling method: .version_select at 0x7f6345d77820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:06.962157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-be38e683-98e7-4da4-a1c9-5ec091805f02 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:06.967565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-be38e683-98e7-4da4-a1c9-5ec091805f02 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:07.319377 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be38e683-98e7-4da4-a1c9-5ec091805f02 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.542639 Oct 04 17:58:07.320227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1344/2139] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:58:06 2022] PUT /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 61 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:07.325837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:07.326959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:07.334652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.335190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.335640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.336360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.336817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.337250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.366980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lazy-loading 'flavor' on Instance uuid 23f697c6-a0a9-4b57-84d2-901ee9d33a75 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:07.447862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf534817-1cbc-4b35-b713-a2925b2be7e1 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75/action" status: 202 len: 0 microversion: 2.1 time: 0.126111 Oct 04 17:58:07.448511 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1345/2140] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:07 2022] POST /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:07.459387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:07.460100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:07.469834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.470334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.470841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.471975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.472533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.473061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.524822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.525292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.525736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.526195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'fault' on Instance uuid 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:07.587286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:07.600003 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f911940-be59-4b85-89cd-890c2af6b663 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 200 len: 1305 microversion: 2.1 time: 0.148711 Oct 04 17:58:07.603497 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1346/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:07 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:07.621429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a67720-d954-40a2-aae5-71ae42c6d9f9", "name": "network-vif-deleted", "tag": "af081468-10da-42a1-8b48-d1ad096eea6a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:07.640086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.640897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.641327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.659865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] Creating event network-vif-deleted:af081468-10da-42a1-8b48-d1ad096eea6a for instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 on n-h1-831193-17 Oct 04 17:58:07.666795 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c874f2e1-47a1-4808-93fe-a73d4d281662 req-251407c9-42d1-4564-9174-08175df59a95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060065 Oct 04 17:58:07.668073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1347/2142] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:07.675728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:07.677413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] [instance: b8a67720-d954-40a2-aae5-71ae42c6d9f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:07.687561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.688476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.689390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.690301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.690785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.691419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.707222 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] HTTP exception thrown: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Request method failure captured: Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 HTTP/1.1 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN1Xoxz3v8EOZe6EeLoOEAkD-nSGpxDINXE_5zR7K8StMv-EOWEQhSvS1vPycpkerdMM787y_HX5Cy-6vC3qz74uvW2v8bfGJjxOBLvumv-hHqsYkw3lJ-kLu00ccGEtaA4faHMIsepebfyLc0z9dYPt_kAHNGC_BGPfpS-VIMCDvc Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d740fd379d8f4d3ca498d2ae25f383af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d740fd379d8f4d3ca498d2ae25f383af Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminTestJSON-1417727964 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 05c694e9eeb548fea9e2ec8a311c8485 Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminTestJSON-1417727964-project Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b8a67720-d954-40a2-aae5-71ae42c6d9f9'} Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:07.709615 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] Returning 404 to user: Instance b8a67720-d954-40a2-aae5-71ae42c6d9f9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d365a5e-5b92-41e1-b9e5-b23ff5ef213a tempest-ServersAdminTestJSON-1417727964 tempest-ServersAdminTestJSON-1417727964-project] 10.222.0.33 "GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9" status: 404 len: 111 microversion: 2.1 time: 0.041366 Oct 04 17:58:07.717571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1348/2143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:07 2022] GET /compute/v2.1/servers/b8a67720-d954-40a2-aae5-71ae42c6d9f9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:07.724111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:07.724666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:07.732223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.732223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.732699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:07.733922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:07.735297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:07.735297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.030633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:08.042598 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28c16da9-df3f-4f6f-a967-850b0caaa969 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.328755 Oct 04 17:58:08.043470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1349/2144] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:07 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:08.048060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:08.048676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:08.056708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.057229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.057680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.058406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.059270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.059713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.188005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:08.191012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:08.202305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:08.204136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:08.212364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb58a3a1-3a4a-4e0a-9f8e-0c36b40a6243 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.167908 Oct 04 17:58:08.215653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1350/2145] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:08 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:08.224816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f71bb7e8-b058-42c6-90b9-727782318251 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Action: 'create', calling method: .version_select at 0x7f6340f26280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:08.286549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f71bb7e8-b058-42c6-90b9-727782318251 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:08.293787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f71bb7e8-b058-42c6-90b9-727782318251 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Getting quotas for user ca70729c98eb48cc9788840665d0a096 and project 11f5eb21d7d84d7e8863c1d45d07a31b. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:08.634068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f71bb7e8-b058-42c6-90b9-727782318251 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "POST /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.416997 Oct 04 17:58:08.639345 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1351/2146] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 17:58:08 2022] POST /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 85 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:08.649202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:08.660146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:08.667775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.668266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.668700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.669412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.669861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.670283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.838293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:08.846832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7c09db8-bd3c-4f21-bd96-6fc614ae7922 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 200 len: 1479 microversion: 2.1 time: 0.204711 Oct 04 17:58:08.859244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1352/2147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:08 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 1479 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:08.859244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:08.859244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] [instance: 2b04e653-a129-4d2c-8631-1f35ed8dc568] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:08.864658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.865150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.866176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.866296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.866850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.867320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.882060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] HTTP exception thrown: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Request method failure captured: Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 HTTP/1.1 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQTT42YjONtcrag0OCL96ueD-c52BBwU7QNMljY4yqkH3LRgtchBOyjZ9PACles9nVfyIiC3w9ey8XCwSi_cxYa7pyv0SmSZ3dlRqS5kCG4hAXpzlvRFQS9oTmRhRBGXaiVFWjMrd8DWLS_zzNQlMMrR3Zjk8H4GN_KBVvVtCOtTuk Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8d201338e18f45c0ac7bebc2af097235 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d201338e18f45c0ac7bebc2af097235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8d201338e18f45c0ac7bebc2af097235 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2075010644 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerDiagnosticsNegativeTest-2075010644-project Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1fc5857887b54fe9b45c11d7542a42f9 Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2075010644-project Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2b04e653-a129-4d2c-8631-1f35ed8dc568'} Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:08.884162 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] Returning 404 to user: Instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5577dd8c-4846-4290-9ae8-073c4f8af967 tempest-ServerDiagnosticsNegativeTest-2075010644 tempest-ServerDiagnosticsNegativeTest-2075010644-project] 10.222.0.33 "GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568" status: 404 len: 111 microversion: 2.1 time: 0.033187 Oct 04 17:58:08.891428 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1353/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:08 2022] GET /compute/v2.1/servers/2b04e653-a129-4d2c-8631-1f35ed8dc568 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:08.892451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4fab68-ba79-4973-9de3-596bdd192859", "name": "network-vif-plugged", "status": "completed", "tag": "07cf5d94-9d54-4b86-b045-a01b354989a0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:08.904319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.904806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.905235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.917658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] Creating event network-vif-plugged:07cf5d94-9d54-4b86-b045-a01b354989a0 for instance 3d4fab68-ba79-4973-9de3-596bdd192859 on n-h1-831193-17 Oct 04 17:58:08.923157 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a397d8a8-b147-4b37-b6b3-a0bc3016e279 req-f0b43ea0-2c58-40c0-8a10-e1d06541ddda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Oct 04 17:58:08.923753 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1354/2149] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:08.929245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:08.929945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:08.937745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.938237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.938671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.939420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.939873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.940295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.014331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=5 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:09.171069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:09.180973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9552612b-7c94-4d2a-b897-ab6cae31c7d5 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.255994 Oct 04 17:58:09.182083 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1355/2150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:08 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:09.193732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b04e653-a129-4d2c-8631-1f35ed8dc568", "name": "network-vif-deleted", "tag": "8d6dc45b-9a2e-4f3c-8eac-569766e3c1be"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:09.205366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.205800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.206236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.220166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] Creating event network-vif-deleted:8d6dc45b-9a2e-4f3c-8eac-569766e3c1be for instance 2b04e653-a129-4d2c-8631-1f35ed8dc568 on n-h2-831193-17 Oct 04 17:58:09.225937 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bf3733f2-82cf-464a-bdff-e99452646a93 req-1d41a500-7be4-41c8-90ae-afabca208f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042305 Oct 04 17:58:09.226819 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1356/2151] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:09.231894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:09.232587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:09.243801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.244447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.244894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.245780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.246258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.246672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.272121 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd HTTP/1.1 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd'} Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:09.274949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-388f7a62-ab65-4c09-b12b-8a959fb0b13b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 404 len: 111 microversion: 2.1 time: 0.048601 Oct 04 17:58:09.279167 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1357/2152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:09.284089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9be7bd54-8563-4b3b-84d9-7cd1644d5a07 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] Calling method '.version_select at 0x7f6340ea39d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:09.344372 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9be7bd54-8563-4b3b-84d9-7cd1644d5a07 tempest-ImagesMetadataTestJSON-1240694651 tempest-ImagesMetadataTestJSON-1240694651-project] 10.222.0.33 "GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.065213 Oct 04 17:58:09.344776 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1358/2153] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/images/d9d1eddb-9418-43cd-b084-5c2f606480bd/metadata => generated 85 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:09.362970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-135799287"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:09.367654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:09.379359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.380710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.381273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.382148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.382770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.385028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.685856 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed1aa52f-2c8c-4d63-91a8-7decbfd57ce5 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75/action" status: 202 len: 0 microversion: 2.1 time: 0.339406 Oct 04 17:58:09.687746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1359/2154] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:09 2022] POST /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:58:09.695661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:09.697357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:09.709127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.709895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.716484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.718325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.718814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.720268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.982020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:09.998703 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9484d01-af90-4649-a16a-e9b86193a3f7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1326 microversion: 2.1 time: 0.308284 Oct 04 17:58:09.999719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1360/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1326 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:10.006378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:10.007134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:10.027256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.028075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.028526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.030137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.032154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.032700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.123177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:10.136126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:10.137586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:10.143809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-09380c82-9a99-4841-918f-a97c6c227953 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.142816 Oct 04 17:58:10.144912 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1361/2156] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:10.159369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-609342478", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:10.230715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:10.740516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:10.742293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:10.742841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:10.743948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:10.744876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:10.758854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.759894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.760478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.761396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.762665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.763131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.787313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:10.794173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:10.810181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:10.817996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:10.876736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b08c0e1-9df7-4ebc-9954-bccf36e6379b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730174 Oct 04 17:58:10.884103 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1362/2157] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:10.896605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd", "name": "network-vif-deleted", "tag": "883ae1db-2a78-4889-8a05-a9984cc418ab"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:10.923460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.924584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.925035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.937430 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] Creating event network-vif-deleted:883ae1db-2a78-4889-8a05-a9984cc418ab for instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd on n-h1-831193-17 Oct 04 17:58:10.942564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7537894a-2d41-40d3-b3b3-f91d259eb3d1 req-1ee6dfad-a592-4bfd-9b4f-8d29fab19421 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061995 Oct 04 17:58:10.943090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1363/2158] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:10.948414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e232b9ea-d41c-4a56-ac86-e492faf88585 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340edc280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.014108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e232b9ea-d41c-4a56-ac86-e492faf88585 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 200 len: 1439 microversion: 2.1 time: 0.069704 Oct 04 17:58:11.023145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1364/2159] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:10 2022] GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 1439 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.029065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.030502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.043249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.043756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.044195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.046071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.047273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.047903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.252201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.261237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8cbf0de-9b95-4f31-8af5-0434ccdcd95f tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.243766 Oct 04 17:58:11.261743 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1365/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.267709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b4600fb-c757-4d40-9718-4dab4a5b9f02 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.268375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b4600fb-c757-4d40-9718-4dab4a5b9f02 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.331586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b4600fb-c757-4d40-9718-4dab4a5b9f02 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.340524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b4600fb-c757-4d40-9718-4dab4a5b9f02 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1214 microversion: 2.1 time: 0.077719 Oct 04 17:58:11.341530 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1366/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.346449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5940395-039b-4cc9-8177-e90bf81140bf", "name": "network-vif-plugged", "status": "completed", "tag": "084cf59a-af00-484a-acc7-67bfcda33a09"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:11.360001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.360744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.361325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.375351 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] Creating event network-vif-plugged:084cf59a-af00-484a-acc7-67bfcda33a09 for instance f5940395-039b-4cc9-8177-e90bf81140bf on n-h1-831193-17 Oct 04 17:58:11.382012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5558a32a-fff0-4b27-993e-8b0268521964 req-721f5652-b462-4770-ba52-f7a75af08c3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038762 Oct 04 17:58:11.388500 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1367/2162] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:11.395884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.396899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.404475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.405210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.405649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.406349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.406977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.407608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.653340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.679372 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c134259b-26ea-45be-a5a5-ddca66773ca7 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1527 microversion: 2.1 time: 0.288460 Oct 04 17:58:11.683850 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1368/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1527 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.698237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.700133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.711080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.712140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.712842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.713834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.714452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.715409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.798911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.808853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.810299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.821314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f19f9ba-1b9c-415c-baf6-6456d733c239 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.135359 Oct 04 17:58:11.835419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1369/2164] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:11.854996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.855678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.863491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.864769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.865370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.866431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.867052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.867634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.084637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:12.097441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-356df209-ba9d-49f4-8207-bff3082b125e tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1527 microversion: 2.1 time: 0.257728 Oct 04 17:58:12.098035 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1370/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1527 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:12.106755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5eb98fe4-5ac8-4f98-949b-767355917b8b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345ca7790>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.190494 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5eb98fe4-5ac8-4f98-949b-767355917b8b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 200 len: 1439 microversion: 2.1 time: 0.090172 Oct 04 17:58:12.191568 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1371/2166] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:12.616947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.617520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:12.647229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.652057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.654671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.661488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.661995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.670022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.722704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] HTTP exception thrown: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Request method failure captured: Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 HTTP/1.1 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQgJJLwTC8iWVFTDSMUpJ7PodR8zNM-hZdi3vgCc1ipsW7bg52jw9bgUSjQZDLi-KsPC795HwIElmKsJ7tnJP8LBXX_hVHXV2eOkg3dNeavWozxVhhbaHeEoI-xOFBLFiM8fUImz17Ewj3BPHWUX5X4s4jJ9NNwqGf1fMs8PBkD5bQ Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 106415ecd31d401bb2c3a26aadd356ed Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 106415ecd31d401bb2c3a26aadd356ed Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2051376250-project Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c40363d6397b462eb1d14bf45f03dc7b Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250-project Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3d4fab68-ba79-4973-9de3-596bdd192859'} Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:12.734673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Returning 404 to user: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:12.738185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f06b4921-71ef-492d-a90e-aad68b8185d8 tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 404 len: 111 microversion: 2.1 time: 0.532932 Oct 04 17:58:12.746633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1372/2167] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:12 2022] DELETE /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 111 bytes in 542 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:12.758382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.759048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:12.775011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.775159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.776019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.780197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.780866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.781455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.072887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:13.088727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2d3985e-04b8-4e57-8670-e7f02e6754f4 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1351 microversion: 2.1 time: 0.339731 Oct 04 17:58:13.089944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1373/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1351 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.096498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:13.097401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:13.106953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.107658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.108180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.109535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.110182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.110770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.252532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:13.264590 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d94302cb-eb0e-4a2c-9abb-9b37f3db84cb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1272 microversion: 2.1 time: 0.171094 Oct 04 17:58:13.265439 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1374/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:13 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.275948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:13.280658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:13.302550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.303755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.304717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.309771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.310626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.311537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.527893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:13.537186 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7753c050-5a69-40ad-bd78-37ce13cc2059 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1527 microversion: 2.1 time: 0.269787 Oct 04 17:58:13.555995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1375/2170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:13 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.975227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-66727134", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:13.995227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:14.121393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:14.635719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:14.636398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:14.638437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:14.639824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:14.642129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:14.673261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.675221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.676437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.678164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.680217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.680864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.751117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Getting quotas for project 052401edcabb46d78e878aa781b3f08f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:14.761352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Getting quotas for user 4b936beef28441d4925ee73ce2f4fd37 and project 052401edcabb46d78e878aa781b3f08f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:14.791440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:14.811613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:14.900535 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61bf9863-1ec8-4cb9-837f-4547af2ee11f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338971 Oct 04 17:58:14.904833 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1376/2171] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:14.912792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:14.913730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:14.927070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.927581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.928201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.928934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.929396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.929831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.933765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:15.088912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:15.102786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:15.123868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:15.158326 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7ffa2ed8-059c-49b3-a776-1281ed14fa28 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1558 microversion: 2.91 time: 0.249248 Oct 04 17:58:15.159159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1377/2172] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:14 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:15.179230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4b20768-09e7-4cd7-9156-1dd924174c0d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340e3b1f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:15.257457 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4b20768-09e7-4cd7-9156-1dd924174c0d tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 200 len: 1439 microversion: 2.1 time: 0.093167 Oct 04 17:58:15.270907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1378/2173] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:15.278404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Action: 'update', calling method: >, body: {"server": {"name": "3d4fab68-ba79-4973-9de3-596bdd192859_new"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:15.287213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:15.320936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.321448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.322094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.325125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.325643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.326091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.380664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] HTTP exception thrown: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Request method failure captured: Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: request: PUT /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 HTTP/1.1 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 64 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQgJJLwTC8iWVFTDSMUpJ7PodR8zNM-hZdi3vgCc1ipsW7bg52jw9bgUSjQZDLi-KsPC795HwIElmKsJ7tnJP8LBXX_hVHXV2eOkg3dNeavWozxVhhbaHeEoI-xOFBLFiM8fUImz17Ewj3BPHWUX5X4s4jJ9NNwqGf1fMs8PBkD5bQ Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 106415ecd31d401bb2c3a26aadd356ed Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/106415ecd31d401bb2c3a26aadd356ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 106415ecd31d401bb2c3a26aadd356ed Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250 Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2051376250-project Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c40363d6397b462eb1d14bf45f03dc7b Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2051376250-project Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "3d4fab68-ba79-4973-9de3-596bdd192859_new"}} Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3d4fab68-ba79-4973-9de3-596bdd192859', 'body': {'server': {'name': '3d4fab68-ba79-4973-9de3-596bdd192859_new'}}} Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:15.386519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] Returning 404 to user: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd0fcd73-dd30-4bec-8286-19fc6ff20a9b tempest-ServersNegativeTestMultiTenantJSON-2051376250 tempest-ServersNegativeTestMultiTenantJSON-2051376250-project] 10.222.0.33 "PUT /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 404 len: 111 microversion: 2.1 time: 0.123604 Oct 04 17:58:15.391096 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1379/2174] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 17:58:15 2022] PUT /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:15.408088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:15.408709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:15.430095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.443259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.443802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.448780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.449485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.450077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.083160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:16.100010 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1b12d922-314c-4889-acbc-7e0663f6829b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1541 microversion: 2.1 time: 0.699463 Oct 04 17:58:16.101509 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1380/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1541 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:16.115239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:16.122454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:16.143275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:16.144422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:16.145631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.149830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:16.150715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:16.151411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.789465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:16.813639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11462a4a-f3a3-43db-b158-fd9f811dfd9b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1314 microversion: 2.1 time: 0.709449 Oct 04 17:58:16.815839 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1381/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:16 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:17.140956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-372542602", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:24.731398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:24.784182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=53 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:26.806621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:27.169406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:29.071981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:29.323354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:29.324010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:29.327516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:29.328554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:29.329170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:29.342811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.343689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.344357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.345170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.345927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.346577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.375443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Getting quotas for project 5f663155c2d742ffa26c0ae9f21d16b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:29.382408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Getting quotas for user b3497205033d4abb8f2ae82eb4a602e1 and project 5f663155c2d742ffa26c0ae9f21d16b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:29.399502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:29.402612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:29.476945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a228a8a-be27-46a3-ae68-745dc0b6935a tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.659658 Oct 04 17:58:29.478028 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1382/2177] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 12661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:29.485319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f697c6-a0a9-4b57-84d2-901ee9d33a75", "name": "network-vif-plugged", "status": "completed", "tag": "86187b11-5875-4c36-a06f-08b870787b51"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:29.500661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.501986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.502660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.531605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] Creating event network-vif-plugged:86187b11-5875-4c36-a06f-08b870787b51 for instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 on n-h2-831193-17 Oct 04 17:58:29.544742 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-edf3a505-49d7-4a7c-b1a3-354cc8b40700 req-05439951-e3cd-4b70-9098-2dd80895bc74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064273 Oct 04 17:58:29.545944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1383/2178] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:29.553823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:29.554780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:29.562125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.562673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.563161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.564107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.564608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.565193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.782793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:29.791623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4d88288-d5f5-4552-b8fb-0102543984ba tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1320 microversion: 2.1 time: 0.244063 Oct 04 17:58:29.805490 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1384/2179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:29 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:29.809899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:29.810715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:29.822999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.825689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.827281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.828254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.829474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.829821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.869964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:29.985004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84e1c711-628b-41aa-8cfd-8e8e5a33bf5c tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 204 len: 0 microversion: 2.1 time: 0.191080 Oct 04 17:58:29.989311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1385/2180] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:29 2022] DELETE /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:29.992740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad57d438-4577-4e0b-8c7b-e64363fa45ed", "tag": "94f36338-3334-4661-a4fe-bc4a53a5e4bd"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:30.002907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.003426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.003896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.018061 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] Creating event network-changed:94f36338-3334-4661-a4fe-bc4a53a5e4bd for instance ad57d438-4577-4e0b-8c7b-e64363fa45ed on n-h2-831193-17 Oct 04 17:58:30.023733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2df1b4b9-d8c6-433e-b924-9fb7fa267d9d req-0ca16f71-bc79-42b9-b4de-1d494f406b86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035983 Oct 04 17:58:30.024496 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1386/2181] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:30.031227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.032065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.040501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.041118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.041492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.042377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.042888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.046783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.202820 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-271c87a6-9cb8-4d04-a9bc-eb8b71dc153c tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176944 Oct 04 17:58:30.203461 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1387/2182] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:30.213686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.214840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.244181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.244558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.246809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.247768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.250907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.252231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.414052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:30.435840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:30.438749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:30.456883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4bae690-462b-4127-8d0a-407c17be4f35 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.250333 Oct 04 17:58:30.469116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1388/2183] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:30.488659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6215046-3dd9-4418-9101-140f670cdec0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340f19b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.590258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6215046-3dd9-4418-9101-140f670cdec0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 200 len: 1448 microversion: 2.1 time: 0.119923 Oct 04 17:58:30.603961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1389/2184] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 1448 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:30.609265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.609992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.620150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.620810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.621540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.622416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.623825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.624928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:31.222042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:31.237249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd0f86ea-978a-46dc-87f9-c41865bc23f0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1314 microversion: 2.1 time: 0.631806 Oct 04 17:58:31.237853 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1390/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:31.355755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1474619407", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "5bf2de9a-2781-4717-8578-9e8974e08641"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:31.477295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] validate_networks() for [('5bf2de9a-2781-4717-8578-9e8974e08641', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:32.520377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:32.522267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:32.522849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:32.523408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:32.524072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:32.544531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.545187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.547368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.550099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.551011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.551555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.577081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Getting quotas for project ca7ac3ee69de40c6992886d1cadc8acd. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:32.584472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Getting quotas for user 2dd1673e2bd84981b22a3c6ee643630e and project ca7ac3ee69de40c6992886d1cadc8acd. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:32.600372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:32.607294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:32.752657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c991ed6-49a9-484f-ab89-8a75cd09d42f tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.510482 Oct 04 17:58:32.760740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1391/2186] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 17:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:58:32.766150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.767194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:32.777413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.778269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.778903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.779856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.780505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.781123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.873358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:32.883273 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37208ba0-532c-4d37-85c7-f06e8df4fad2 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1271 microversion: 2.1 time: 0.120985 Oct 04 17:58:32.885471 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1392/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:32.890619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.891635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:32.915304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.916476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.918747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.921446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.922698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.924414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.076199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3041a7e2557d4c0ab0ceb4ebe4260543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb93ab4b64b462c9cd15c7755873adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.093633 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-929e5cfe-8f23-4b4a-a35f-7b3c68f44f32 tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 200 len: 1311 microversion: 2.1 time: 0.206197 Oct 04 17:58:33.113223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1393/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:33.121788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cbc08ae-1f82-4d7e-a269-f3ba71c2e71a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340e9fdc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:33.236306 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cbc08ae-1f82-4d7e-a269-f3ba71c2e71a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 200 len: 1448 microversion: 2.1 time: 0.120849 Oct 04 17:58:33.237269 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1394/2189] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:33 2022] GET /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 1448 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:33.265177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:33.271420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:33.292827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:33.293577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:33.294021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.294765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:33.295430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:33.297704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.594967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.606420 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9d5df08-7f4b-421f-b815-c919cbfaf1d6 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1320 microversion: 2.1 time: 0.362322 Oct 04 17:58:33.619104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1395/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:33 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:33.620729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:33.640240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:33.649482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:33.649984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:33.650430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.664822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:33.665690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:33.666073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.885714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.896512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.897962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.903680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79a66d8c-12a8-4a41-ae6e-f7d5c6c194b9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.292029 Oct 04 17:58:33.915689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1396/2191] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:33 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:33.928296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad57d438-4577-4e0b-8c7b-e64363fa45ed", "name": "network-vif-plugged", "status": "completed", "tag": "94f36338-3334-4661-a4fe-bc4a53a5e4bd"}, {"server_uuid": "f552ec9b-209b-45ba-a715-07a36b85fb90", "name": "network-vif-plugged", "status": "completed", "tag": "73743b1f-c59e-412d-b122-023b8e1c0c8b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:33.942528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:33.943193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:33.943848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:33.964942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Creating event network-vif-plugged:94f36338-3334-4661-a4fe-bc4a53a5e4bd for instance ad57d438-4577-4e0b-8c7b-e64363fa45ed on n-h2-831193-17 Oct 04 17:58:33.965815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] Creating event network-vif-plugged:73743b1f-c59e-412d-b122-023b8e1c0c8b for instance f552ec9b-209b-45ba-a715-07a36b85fb90 on n-h1-831193-17 Oct 04 17:58:33.980053 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-655a149d-0bf2-455f-85af-7b23138797ab req-8db5075e-000b-455b-8a53-924a6b3e8b38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060919 Oct 04 17:58:33.980928 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1397/2192] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:34.057377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552ec9b-209b-45ba-a715-07a36b85fb90", "tag": "73743b1f-c59e-412d-b122-023b8e1c0c8b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:34.072133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.073145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.073796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.088687 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] Creating event network-changed:73743b1f-c59e-412d-b122-023b8e1c0c8b for instance f552ec9b-209b-45ba-a715-07a36b85fb90 on n-h1-831193-17 Oct 04 17:58:34.094442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-125335d6-c8ec-416d-9a71-3e84c44ac705 req-1bc82a2f-2e8c-4b6d-b2e4-b20e37d1cfe8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111919 Oct 04 17:58:34.095438 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1398/2193] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:34.102085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:34.103180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:34.117434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.118075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.118685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.119691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.120161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.120697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.476942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:34.488863 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9c4b5455-65ea-49b6-b82f-af4ad0187cd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1314 microversion: 2.1 time: 0.391951 Oct 04 17:58:34.489485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1399/2194] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:34 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:34.496378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:34.497249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:34.506041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.506821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.507572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.508610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.509651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.510283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.654676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:34.666299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:34.669912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:34.671826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78e0d93d-8663-4e37-a106-f81f50bd7807 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1311 microversion: 2.21 time: 0.181367 Oct 04 17:58:34.673273 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1400/2195] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:34 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:34.745321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5940395-039b-4cc9-8177-e90bf81140bf", "tag": "084cf59a-af00-484a-acc7-67bfcda33a09"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:34.758920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.758920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.758920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.771121 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] Creating event network-changed:084cf59a-af00-484a-acc7-67bfcda33a09 for instance f5940395-039b-4cc9-8177-e90bf81140bf on n-h1-831193-17 Oct 04 17:58:34.776364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-75e1e789-6fa7-41b5-801a-4e461bf5d9c4 req-266afc56-f786-4b87-a72f-e6a09d19bc5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101707 Oct 04 17:58:34.776981 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1401/2196] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:34.782404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc647331-5bda-4fcc-b6c3-f6797f9cc6a0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340e3b9d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.358322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc647331-5bda-4fcc-b6c3-f6797f9cc6a0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 204 len: 0 microversion: 2.1 time: 0.579852 Oct 04 17:58:35.358963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1402/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:34 2022] DELETE /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:35.366607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.367371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:35.380490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.381243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.381829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.383000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.386308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.387270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.620110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:35.631864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5ae0a56-5fce-4745-ade6-adcbd2f4bd84 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.271347 Oct 04 17:58:35.632749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1403/2198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:35 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:35.638367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.639299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] [instance: 3d4fab68-ba79-4973-9de3-596bdd192859] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:35.653392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.654653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.655425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.657143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.658010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.658684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.678893 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] HTTP exception thrown: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Request method failure captured: Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 HTTP/1.1 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQQdANgG0QSTWQOPzB_ErVSe1bEpwB4k9tyiVYznGf0VbXoMa3Dw_y0YL9_zfRJKAcHF-rG5wtibgQl9BBt49OqrHc62B6hCWHaNS5s7g-AuFGeHFzNh0HPyPmvP1gL27qBcAWAPKQurjEIGot_OOAs3fg2tmH5-C5P1bK5NOYjOO0 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3cb93ab4b64b462c9cd15c7755873adb Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-458995482 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3cb93ab4b64b462c9cd15c7755873adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3cb93ab4b64b462c9cd15c7755873adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3cb93ab4b64b462c9cd15c7755873adb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3cb93ab4b64b462c9cd15c7755873adb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-458995482 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3cb93ab4b64b462c9cd15c7755873adb Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-458995482 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestMultiTenantJSON-458995482-project Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3041a7e2557d4c0ab0ceb4ebe4260543 Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-458995482-project Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3d4fab68-ba79-4973-9de3-596bdd192859'} Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:35.681741 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. Oct 04 17:58:35.687787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:35.689867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] Returning 404 to user: Instance 3d4fab68-ba79-4973-9de3-596bdd192859 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:35.691075 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc7b4559-72ed-48c7-96e6-b8de7f1d4bfc tempest-ServersNegativeTestMultiTenantJSON-458995482 tempest-ServersNegativeTestMultiTenantJSON-458995482-project] 10.222.0.33 "GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859" status: 404 len: 111 microversion: 2.1 time: 0.056975 Oct 04 17:58:35.692054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1404/2199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:35 2022] GET /compute/v2.1/servers/3d4fab68-ba79-4973-9de3-596bdd192859 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:35.697797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.699790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:35.707475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.708266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.708950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.709908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.710713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.711471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.740887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:35.959828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:35.970068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9448f2aa-9ec3-4620-bfbf-1d1408bb3de7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1320 microversion: 2.1 time: 0.276685 Oct 04 17:58:35.987342 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1405/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:35 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:35.992580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.993200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:35.999880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.000383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.000823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.001537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.001993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.002416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.086284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.097079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.098943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.106467 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-486e28fd-79da-42da-b092-c99b9067ca67 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1535 microversion: 2.91 time: 0.117699 Oct 04 17:58:36.120335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1406/2201] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:35 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1535 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:36.120335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:36.120335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:36.120335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.120801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.121076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.121974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.122593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.123215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.153782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:36.242405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eecff90a-554f-49c6-b25b-cca26e8e61a3 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 204 len: 0 microversion: 2.1 time: 0.133661 Oct 04 17:58:36.243004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1407/2202] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:36 2022] DELETE /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:36.251013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:36.251013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:36.266263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.267653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.268265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.269125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.269879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.270308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.457584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.467127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c18e521-a228-47a5-94b4-748faceddd22 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1314 microversion: 2.1 time: 0.221929 Oct 04 17:58:36.468030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1408/2203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:36 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:36.473276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:36.473888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:36.481617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.482436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.483274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.484270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.484741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.485178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.562477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.572401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.573857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.574997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51aab74a-c959-4abe-9a50-e7e9b8a20736 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1317 microversion: 2.21 time: 0.105850 Oct 04 17:58:36.575591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1409/2204] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:36 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1317 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:36.580095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f697c6-a0a9-4b57-84d2-901ee9d33a75", "name": "network-vif-unplugged", "status": "completed", "tag": "86187b11-5875-4c36-a06f-08b870787b51"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:36.591243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.591789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.592218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.604339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] Creating event network-vif-unplugged:86187b11-5875-4c36-a06f-08b870787b51 for instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 on n-h2-831193-17 Oct 04 17:58:36.609456 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f4874e0d-31f0-4a00-b427-e92c05fba012 req-1e7a54e0-7114-4fe3-9cbc-f3e87faf4d2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032650 Oct 04 17:58:36.610000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1410/2205] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:36.615643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4fab68-ba79-4973-9de3-596bdd192859", "name": "network-vif-deleted", "tag": "07cf5d94-9d54-4b86-b045-a01b354989a0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:36.625921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:36.626400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:36.629317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.639408 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] Creating event network-vif-deleted:07cf5d94-9d54-4b86-b045-a01b354989a0 for instance 3d4fab68-ba79-4973-9de3-596bdd192859 on n-h1-831193-17 Oct 04 17:58:36.644942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-379b64e1-4878-47e6-8e6d-a21fb9f714b1 req-e5b6cad2-9fb7-4c71-aecf-cf00ed07df4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Oct 04 17:58:36.645870 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1411/2206] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:36.651417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-951873018", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:36.662058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:36.720285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] validate_networks() for [('c7abe4b4-2dad-4d6c-aef6-c5e8ccfca1da', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:37.127318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:37.127749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:37.128232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:37.128677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:37.129092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:37.139881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.140384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.140829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.141573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.142036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.142470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.166427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:37.172828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Getting quotas for user 242be122e02f4be3abdd0e7a989764b4 and project 5f9be8d91b134e13b685ed263b5abf71. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:37.194205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:37.197675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:37.256158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e5e962a-d56f-45d6-8dc3-0a02c4602ef9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609022 Oct 04 17:58:37.263160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1412/2207] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:37.263160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.263669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:37.271940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.272453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.273191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.273635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.274142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.274587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.463151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.474879 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9944991-c4ed-4f81-b590-28de45af45fc tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.216629 Oct 04 17:58:37.475768 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1413/2208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:37.486795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622dc990-b4fe-49f9-afc9-688439573a16", "tag": "beb6d673-a250-4b78-adb5-4c66f0ec3859"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:37.499014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.499708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.500472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.517800 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] Creating event network-changed:beb6d673-a250-4b78-adb5-4c66f0ec3859 for instance 622dc990-b4fe-49f9-afc9-688439573a16 on n-h2-831193-17 Oct 04 17:58:37.527207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-59d8137d-6467-4f4a-8195-98065db0e29a req-36f81d06-7f5c-4d58-9688-b07a8f3ee3f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049901 Oct 04 17:58:37.528167 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1414/2209] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:37.534506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.535497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:37.546487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.547072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.547781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.549261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.550018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.550648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.731926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.742077 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5879766c-fa2c-4185-b572-7f91fe42d492 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1470 microversion: 2.1 time: 0.212479 Oct 04 17:58:37.742774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1415/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:37.767734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.768574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:37.781689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.782383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.782821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.783891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.784506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.785679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.963971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.975174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.976614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.982682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c799746d-8ab0-4142-bed0-0c0711d8f997 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1535 microversion: 2.91 time: 0.222051 Oct 04 17:58:37.984772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1416/2211] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1535 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:37.997840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.999590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:38.021666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.022153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.022661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.024061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.024691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.025178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.133992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.147906 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-932f6be2-a314-4bd9-942c-624d4c1e2e28 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1211 microversion: 2.1 time: 0.161656 Oct 04 17:58:38.149123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1417/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:38.163907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:38.165074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:38.174531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.176009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.177187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.178492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.179548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.180184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.565096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.582670 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6375ee40-d72c-463d-8db9-afb7cec1e863 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1501 microversion: 2.1 time: 0.432174 Oct 04 17:58:38.583494 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1418/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:38 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1501 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:38.589021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:38.589854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:38.611624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.612149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.612600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.613858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.614317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.618259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.862181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.876938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.879411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.880820 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a408938-a796-4092-b508-57ed083ec6a0 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1359 microversion: 2.21 time: 0.295652 Oct 04 17:58:38.886816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1419/2214] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:38 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:39.108062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:39.108637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] [instance: 87922667-1728-42f1-8e64-9d6cb2dedb7f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.123313 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] HTTP exception thrown: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Request method failure captured: Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/87922667-1728-42f1-8e64-9d6cb2dedb7f/action HTTP/1.1 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ0sA4vfgiaESUlTxWN5tODClRaiRVrHfGy8a683xHkwsnH-RQ1XF7VixuSF3vCcYeeyID1ZTiHE5oULbZDKYVay-0oVPG0hUBZgZGu3y9bsU6B1nXCF6Hjssugl0wxnt9FxQGUMaEdSybK1Rb_GTJP-88XhrV4s4D0iLgabbF4MRA Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 721bb159de9649288716347b8e045cdd Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: {"migrate": {}} Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '87922667-1728-42f1-8e64-9d6cb2dedb7f', 'body': {'migrate': {}}} Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:39.128013 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. Oct 04 17:58:39.132546 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:39.140827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Returning 404 to user: Instance 87922667-1728-42f1-8e64-9d6cb2dedb7f could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:39.142322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0bce3c9b-1e6e-434d-964d-ece496014804 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/87922667-1728-42f1-8e64-9d6cb2dedb7f/action" status: 404 len: 111 microversion: 2.1 time: 0.253891 Oct 04 17:58:39.153997 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1420/2215] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:38 2022] POST /compute/v2.1/servers/87922667-1728-42f1-8e64-9d6cb2dedb7f/action => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:39.167303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:39.167768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.193361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.196311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.197858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.201660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.202825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.204818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.439881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:39.448491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6f8ed7d-2162-41cf-8a6c-07f61bb59c42 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.294225 Oct 04 17:58:39.452769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1421/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:39 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:39.458671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:39.459523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.466214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.476728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.479479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.481039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.481658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.482209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.521736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'flavor' on Instance uuid ad57d438-4577-4e0b-8c7b-e64363fa45ed {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:39.625765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:39.856642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86a60074-4584-4189-9b85-10f69be13220 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed/action" status: 202 len: 0 microversion: 2.1 time: 0.402438 Oct 04 17:58:39.857260 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1422/2217] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:39 2022] POST /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:39.872602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:39.875631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.898207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.901232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.904699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.907448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.908000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.908386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.226071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.237532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.239877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.249932 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d52c01a-762a-4c72-93af-a65ac6044d6e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1478 microversion: 2.91 time: 0.389918 Oct 04 17:58:40.251576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1423/2218] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:39 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:40.265528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f697c6-a0a9-4b57-84d2-901ee9d33a75", "name": "network-vif-deleted", "tag": "86187b11-5875-4c36-a06f-08b870787b51"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:40.285845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.286390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.287273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.305383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] Creating event network-vif-deleted:86187b11-5875-4c36-a06f-08b870787b51 for instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 on n-h2-831193-17 Oct 04 17:58:40.311287 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-565754f0-9837-4ee2-97f4-4606a1d2697f req-757ec345-cd5e-47ac-925f-4f8ea2f1861f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057889 Oct 04 17:58:40.312061 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1424/2219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:40.318782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:40.319686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:40.326825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.327517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.328123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.328998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.329467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.329896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.093949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:41.103369 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b710c078-9d40-4e5f-9c00-a5d5f32150f0 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.789862 Oct 04 17:58:41.104360 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1425/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:40 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:41.110216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1599688334", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:41.178861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:41.703077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:41.703500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:41.703977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:41.704388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:41.704803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:41.714126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.714611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.715079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.715802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.716254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.716674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.739491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Getting quotas for project 052401edcabb46d78e878aa781b3f08f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:41.747602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Getting quotas for user 4b936beef28441d4925ee73ce2f4fd37 and project 052401edcabb46d78e878aa781b3f08f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:41.765198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:41.767760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:41.826056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31d2ddcb-b161-402b-80b3-3b626c8eabe5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719875 Oct 04 17:58:41.826902 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1426/2221] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:41.833020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:41.833643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:41.841180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.841688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.842250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.843014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.843518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.843942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.126470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.139883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d260129b-6f6d-4c89-9ebd-c5ea5686d7a2 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.311450 Oct 04 17:58:42.141622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1427/2222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:41 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:42.148022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:42.149094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:42.162212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.164604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.166256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.168738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.170435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.189975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.589846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.603111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.603111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.611822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4bfbdc9e-7d4b-494d-afb1-fe88a515402d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1359 microversion: 2.21 time: 0.460025 Oct 04 17:58:42.614120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1428/2223] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:42 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:42.620911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca33a59-82f4-401f-93c2-fbdf8f90bb5d", "tag": "249a248b-195c-4e5b-9944-9cbbaf4455c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:42.640307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.640976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.641513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.680567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] Creating event network-changed:249a248b-195c-4e5b-9944-9cbbaf4455c3 for instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d on n-h1-831193-17 Oct 04 17:58:42.708103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b0102ded-5bda-44a3-b457-24827f87c1b5 req-3ec1c33c-c2d9-43c1-af8d-d65532db7573 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071704 Oct 04 17:58:42.709262 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1429/2224] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:42.733378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:42.737655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:42.745453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.745958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.746393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.747366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.747886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.748313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.870483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-831193-17". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 17:58:43.015983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e63f1be6-f385-493b-afb5-0564f41a6aff tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action" status: 202 len: 0 microversion: 2.91 time: 0.304555 Oct 04 17:58:43.016457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1430/2225] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:58:42 2022] POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:43.022997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:43.023793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:43.030974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.031758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.032818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.033441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.034019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.034524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.275857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:43.285461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbf909cc-0232-4d4b-aabe-6c5032cc08e4 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.267675 Oct 04 17:58:43.286055 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1431/2226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:43 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.292772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:43.293603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:43.318049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.318541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.319800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.320618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.321183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.321685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.463688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:43.476924 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e3bc134-79fa-4f02-8061-b45827ed2f34 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1282 microversion: 2.1 time: 0.187691 Oct 04 17:58:43.478346 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1432/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:43 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.483496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:43.484584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:43.491736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.493351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.494013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.494914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.495538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.495960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.356467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.366738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-daa3d34a-d2e8-4633-b745-43d36a9b6459 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.886995 Oct 04 17:58:44.367961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1433/2228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:43 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:44.373967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.374906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.382173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.382998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.383671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.384900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.385828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.386458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.483308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.499681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.502456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.512451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2e50670-32c4-48b5-bb47-39f087871891 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1488 microversion: 2.91 time: 0.141999 Oct 04 17:58:44.514017 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1434/2229] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1488 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:44.521222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.522408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.529484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.530321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.531232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.532588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.533289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.533902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.805680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.814072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9dd87893-7c61-4306-bd59-2e4c0ba29985 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.298663 Oct 04 17:58:44.815233 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1435/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:44.824712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eac3a1f-12db-464c-bfa1-eb2c121d3ff0", "tag": "acb3b4ee-9d93-40f4-8708-c7c53ec02dde"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:44.846894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.851956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.852402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.865339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] Creating event network-changed:acb3b4ee-9d93-40f4-8708-c7c53ec02dde for instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 on n-h1-831193-17 Oct 04 17:58:44.870766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-50e71b2b-302a-4557-b116-6c0c6a3c3aa1 req-8799e7af-d59f-4f79-aa98-62dba1254cd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053429 Oct 04 17:58:44.871751 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1436/2231] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:44.877225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.877938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.885479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.885974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.886408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.887330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.887786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.888243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.105551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.115361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.117204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.118479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92d865db-63f9-431a-9ba3-9024bfd47a7d tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1359 microversion: 2.21 time: 0.245772 Oct 04 17:58:45.131945 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1437/2232] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:45.143898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:45.144618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:45.151018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.152213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.152745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.153553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.154214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.154626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.251575 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 17:58:45.260068 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 17:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 17:58:45.419882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.428754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a618d49-2375-48f2-9a88-28e1d99142ea tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.295473 Oct 04 17:58:45.430053 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1438/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:45 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:45.435384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:45.436316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:45.446313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.446970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.447555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.448386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.448963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.449488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.335353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:46.354189 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61fa6a05-d278-4496-ac13-cc472b14c1cf tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.922776 Oct 04 17:58:46.361519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1439/2234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:45 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:46.395330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622dc990-b4fe-49f9-afc9-688439573a16", "name": "network-vif-plugged", "status": "completed", "tag": "beb6d673-a250-4b78-adb5-4c66f0ec3859"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:46.411627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.412518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.413104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.425285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:46.429134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] Creating event network-vif-plugged:beb6d673-a250-4b78-adb5-4c66f0ec3859 for instance 622dc990-b4fe-49f9-afc9-688439573a16 on n-h2-831193-17 Oct 04 17:58:46.436908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-17fab7f6-1a5c-43d7-ae2e-941970ef021a req-0b879d5a-03c6-4874-8ffa-ae7100ae0ff6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072469 Oct 04 17:58:46.438907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1440/2235] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:46.446602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:46.447567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:46.463448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.473776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.474407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.477625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.481571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.482177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.998518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:47.024594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cbf7227-052e-4c4c-a324-17e9710fd667 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.584209 Oct 04 17:58:47.030439 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1441/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:46 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:47.036594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:47.037532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:47.061478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:47.063739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:47.064466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:47.065806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:47.066537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:47.067510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:47.530675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:47.541982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:47.547393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:47.565432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:47.573891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c816e1d6-de50-45f5-88b1-4ad52d48ad4d tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.541980 Oct 04 17:58:47.575818 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1442/2237] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:47 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:47.628926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:47.629665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:47.645778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:47.646372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:47.647338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:47.647807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:47.653002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:47.653508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:48.365114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:48.380078 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f9ffe02-53d4-46a2-8160-5dd118029d3d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.775758 Oct 04 17:58:48.400699 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1443/2238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:47 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:48.408105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:48.408738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:48.424887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:48.425356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:48.425828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:48.426623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:48.426992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:48.427458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:48.789131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:48.812940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:48.818685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:48.823653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b316987e-3fef-4862-8970-4e50bb9561ca tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1359 microversion: 2.21 time: 0.420380 Oct 04 17:58:48.823972 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1444/2239] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:48 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:48.833054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:48.838915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:48.864516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:48.865068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:48.865523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:48.870698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:48.871335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:48.871827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.164055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:49.173828 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38327f52-951f-46dd-b2df-fab6492b5118 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.344631 Oct 04 17:58:49.174403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1445/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:48 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:49.179905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:49.180682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:49.189166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.189903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.190634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.191659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.192417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.193023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.401699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:49.410467 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-883bc82b-7dc5-4751-9047-a66884b93cfa tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.234263 Oct 04 17:58:49.411739 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1446/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:49 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:49.416548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:49.417361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:49.426361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.427301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.427925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.428817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.429425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.430000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.667792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:49.687207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf88e970-df6c-4d37-a4e7-453630815221 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.273250 Oct 04 17:58:49.688750 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1447/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:49 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:49.713654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca33a59-82f4-401f-93c2-fbdf8f90bb5d", "name": "network-vif-plugged", "status": "completed", "tag": "249a248b-195c-4e5b-9944-9cbbaf4455c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:49.727525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.728297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.728908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.744492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] Creating event network-vif-plugged:249a248b-195c-4e5b-9944-9cbbaf4455c3 for instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d on n-h1-831193-17 Oct 04 17:58:49.757204 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1e282392-5fc3-4308-b7b0-983cf54365dd req-abaf2316-b371-49ce-99ab-71ffdc0ad1d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049771 Oct 04 17:58:49.758874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1448/2243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:49.772546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:49.773246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:49.794481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.797884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.800182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.801442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.804184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.805912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.018369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.038260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.040205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.049839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-570ad2c5-cb5d-40cc-9481-5b91408fe352 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.289296 Oct 04 17:58:50.052343 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1449/2244] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:49 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:50.071254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dedca2b-7eb5-4930-a617-2af42cdd7a63", "tag": "9b3b3089-3f11-4d34-9e9b-a87a659455c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:50.086204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.086695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.087191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.118620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] Creating event network-changed:9b3b3089-3f11-4d34-9e9b-a87a659455c6 for instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 on n-h2-831193-17 Oct 04 17:58:50.134902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fe164195-3ee2-49cd-bd31-181dd67ea8b5 req-3d5dc81c-9409-4c80-a5df-a8360a9e4a8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078541 Oct 04 17:58:50.138181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1450/2245] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:50.153571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:50.154502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.171158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.172117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.172770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.173662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.174468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.176076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.495273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.511293 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cfb2eef2-7b6a-439f-9fd5-591b49f58e69 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.370403 Oct 04 17:58:50.515569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1451/2246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:50 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:50.528317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:50.529883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.565669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.772506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.783259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.785214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.786753 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b824184-80c6-4a9a-a5fa-d76a58763118 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1359 microversion: 2.21 time: 0.268384 Oct 04 17:58:50.811893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1452/2247] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:50 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:50.821668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:50.822567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.836784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.837764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.838391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.839335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.839956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.840553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.071255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.082514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8aabf26-2f60-449a-90df-77d94df27b03 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.267217 Oct 04 17:58:51.084419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1453/2248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:50 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:51.093794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.094304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.106238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.106733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.107281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.108005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.108494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.108921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.172889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:51.287979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e1c5a24-aa04-4eb0-82e0-5001f4f0b868 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 204 len: 0 microversion: 2.1 time: 0.201002 Oct 04 17:58:51.288727 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1454/2249] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:51 2022] DELETE /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:51.298263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.299003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.305810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.306312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.306753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.307644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.308107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.308538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.610382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.630899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ba2a056-b54a-4794-98a5-5e9e0f4120d3 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.337590 Oct 04 17:58:51.631984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1455/2250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:51.637500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.638250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.654374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.654882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.655356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.656068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.656527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.656954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.725276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:51.756683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=24 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:51.924466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.938218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8555556-7439-4e14-aee4-2f81905d3a58 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.304784 Oct 04 17:58:51.954085 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1456/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:51.967237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.967835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.974594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.975131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.975583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.976287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.976807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.977156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.984225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:52.093752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.104659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.105894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.111741 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70d44dc3-5c32-4ea0-af8d-1241601d1132 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.148798 Oct 04 17:58:52.123220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1457/2252] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:52.135061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:52.135697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:52.141997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.142627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.143216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.144064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.144734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.145345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.343735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.364522 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3669aea9-63ff-465f-abc8-d1c6917e668b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1665 microversion: 2.1 time: 0.250443 Oct 04 17:58:52.365440 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1458/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1665 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:52.376432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:52.377215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:52.392379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.393030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.393927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.404138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.404995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.405550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.671817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.682688 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50dad49b-55fa-43d0-b67a-12f3b9e21011 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.316248 Oct 04 17:58:52.699437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1459/2254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:52.705408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eac3a1f-12db-464c-bfa1-eb2c121d3ff0", "name": "network-vif-plugged", "status": "completed", "tag": "acb3b4ee-9d93-40f4-8708-c7c53ec02dde"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:52.720370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.720972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.721613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.737277 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] Creating event network-vif-plugged:acb3b4ee-9d93-40f4-8708-c7c53ec02dde for instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 on n-h1-831193-17 Oct 04 17:58:52.748675 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3e070711-8493-42f4-b5af-4bbbdf9c0691 req-f8f39e37-8a03-4c1d-93d3-ac7aba906a7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047759 Oct 04 17:58:52.750113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1460/2255] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:52.756586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:52.759939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:52.766923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.767889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.768409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.769916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.770602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.771155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.973209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.986662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.988213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.994366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fe299b3a-a5d1-478d-b6f4-eb9a8fff47b7 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1552 microversion: 2.21 time: 0.242858 Oct 04 17:58:52.994978 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1461/2256] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1552 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:53.003575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:53.011220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:53.021212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.023701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.024354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.026973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.027667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.032025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.327669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:53.344094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f6773fa-7113-4650-84c8-44f09c1ac989 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1313 microversion: 2.1 time: 0.347637 Oct 04 17:58:53.345277 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1462/2257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:53.350802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:53.351518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:53.359194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.359700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.360137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.360908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.361381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.361954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.683723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:53.695603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-040d8c0e-2180-4b4d-8649-a9408d951010 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.348964 Oct 04 17:58:53.697194 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1463/2258] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:53 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:53.716112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:53.717061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:53.725395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.725899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.726342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.727099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.727550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.728590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.655760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.664718 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd3dc121-eea4-4879-a7db-11ad984380c2 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1307 microversion: 2.1 time: 0.966076 Oct 04 17:58:54.669859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1464/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:53 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1307 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:54.675465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.677406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.704659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.705172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.705625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.706565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.707198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.707638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.760874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:54.925394 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-253bdd3f-9e80-4eab-b650-42d28f31a95b tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 204 len: 0 microversion: 2.21 time: 0.252673 Oct 04 17:58:54.928472 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1465/2260] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:58:54 2022] DELETE /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:58:54.938666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.939482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.946591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.947456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.948105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.949324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.949970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.950982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.055831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.065022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.066821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.074544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cfa769a-eae6-4277-ab75-5a24021e7cb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.144470 Oct 04 17:58:55.076167 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1466/2261] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:54 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:55.083964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.085145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.093397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.094177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.094847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.096141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.097399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.098025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.134547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.135371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.136011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.137417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lazy-loading 'fault' on Instance uuid f5940395-039b-4cc9-8177-e90bf81140bf {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:55.243846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3085832f1aa4500a42a57537d1e376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcde371fdf6c404f8cfbac695be38cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.255532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c9b83334-9946-43b9-9cc6-a93c4ec92a35 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 200 len: 1315 microversion: 2.1 time: 0.177107 Oct 04 17:58:55.256614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1467/2262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.261889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.262504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.270558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.271481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.272096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.273015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.273468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.273902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.572103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.579652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee5c457c-cc1f-419a-940c-7d00b99bbd74 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.321691 Oct 04 17:58:55.580797 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1468/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.586812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.587733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.595116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.595783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.596317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.597178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.597740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.598605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.950053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.959207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b52894e4-c4e2-4d19-9634-10afef3d96ec tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1462 microversion: 2.1 time: 0.376538 Oct 04 17:58:55.977347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1469/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1462 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.982647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5940395-039b-4cc9-8177-e90bf81140bf", "name": "network-vif-deleted", "tag": "084cf59a-af00-484a-acc7-67bfcda33a09"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:55.996301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.996789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.997221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.016632 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] Creating event network-vif-deleted:084cf59a-af00-484a-acc7-67bfcda33a09 for instance f5940395-039b-4cc9-8177-e90bf81140bf on n-h1-831193-17 Oct 04 17:58:56.022739 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ab52a0a0-00cf-43c9-8776-e834eaca966d req-95fe33ce-6cbf-499a-bbdc-09fe2f4b919b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043871 Oct 04 17:58:56.023932 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1470/2265] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:56.029180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.030914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.047405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.048694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.049341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.050789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.051636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.052229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.922692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:56.931752 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f89c50ec-4fa8-42be-8cc3-1a3069de4d10 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.906531 Oct 04 17:58:56.933218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1471/2266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:56 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:56.944123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.944984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.951767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.953041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.953781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.954514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.954982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.955445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.628806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.652318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.658132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dd1673e2bd84981b22a3c6ee643630e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7ac3ee69de40c6992886d1cadc8acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.660974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12d88347-32d9-452d-b72c-b05c07651732 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 200 len: 1558 microversion: 2.21 time: 0.726217 Oct 04 17:58:57.662237 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1472/2267] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:56 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 1558 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:57.674532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:57.677327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:57.686001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.686974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.687454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.688818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.689302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.689735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.718390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:57.937022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.948830 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-370a3ef4-be75-4287-bf61-f22f5b257501 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1486 microversion: 2.1 time: 0.284829 Oct 04 17:58:57.962640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1473/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:57 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1486 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:58.290315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Calling method '.version_select at 0x7f6341a15820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.335024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.335741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.336203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.377323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.378577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.379969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.403985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa40da99-9ca3-4a9e-9bc7-ecb8fb5550f6 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/5f663155c2d742ffa26c0ae9f21d16b1?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543" status: 200 len: 693 microversion: 2.1 time: 0.453243 Oct 04 17:58:58.404669 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1474/2269] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 17:58:57 2022] GET /compute/v2.1/os-simple-tenant-usage/5f663155c2d742ffa26c0ae9f21d16b1?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543 => generated 693 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:58.410794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.412028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.421508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.422399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.423115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.424059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.424735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.425961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.506051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.514942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.516853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.523782 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07e1d885-dfcc-44be-a944-5ec3812781be tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.117811 Oct 04 17:58:58.535455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1475/2270] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:58.541789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.542430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] [instance: f5940395-039b-4cc9-8177-e90bf81140bf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.548797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.549303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.549776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.550650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.551508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.551719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.567638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] HTTP exception thrown: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Request method failure captured: Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf HTTP/1.1 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQeop_4UQxrBkvPzHN6hO3LJPlIsxQjJud49Q4uYCysy8Wn48R0zlOJli-5RC-SRy9cNx5p--GsRv6DnAMCX134x47rrnZml7USJIlCVt2aIeSyrpzGlIonq52jzz1U2u1DpaiPHGKKzqmB1NIDj6TQSiJ3ibzQR1EoXtTHKJ3ZE6c Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: bcde371fdf6c404f8cfbac695be38cb5 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestFqdnHostnames-1377020105 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bcde371fdf6c404f8cfbac695be38cb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bcde371fdf6c404f8cfbac695be38cb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bcde371fdf6c404f8cfbac695be38cb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bcde371fdf6c404f8cfbac695be38cb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestFqdnHostnames-1377020105 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: bcde371fdf6c404f8cfbac695be38cb5 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1377020105 Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestFqdnHostnames-1377020105-project Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d3085832f1aa4500a42a57537d1e376b Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestFqdnHostnames-1377020105-project Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f5940395-039b-4cc9-8177-e90bf81140bf'} Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:58.569544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. Oct 04 17:58:58.573860 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:58.575821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Returning 404 to user: Instance f5940395-039b-4cc9-8177-e90bf81140bf could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:58.576913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e903cb38-d7cd-4da6-a089-2369c7ddeb5b tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf" status: 404 len: 111 microversion: 2.1 time: 0.040142 Oct 04 17:58:58.577995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1476/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/f5940395-039b-4cc9-8177-e90bf81140bf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:58.585066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.585951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.592567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.593366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.593966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.594830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.595958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.596551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.889289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.900593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cab9baf7-a9c2-42f1-a4b9-7da5f44fe2e3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.321263 Oct 04 17:58:58.902837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1477/2272] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:58.920654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.921776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.931630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.932141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.932584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.933306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.933765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.934195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.211706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.227575 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a430c7e-752a-4fc1-973a-5599f7a9158e tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.317050 Oct 04 17:58:59.228139 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1478/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:59.234189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1347364603"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:59.238964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.253090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.256014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.256752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.258346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.258990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.260396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.578501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ce5be3a-4016-435e-8bec-a286fe312b61 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "POST /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0/action" status: 202 len: 0 microversion: 2.1 time: 0.348551 Oct 04 17:58:59.579825 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1479/2274] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:59 2022] POST /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:58:59.586318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca33a59-82f4-401f-93c2-fbdf8f90bb5d", "name": "network-vif-deleted", "tag": "249a248b-195c-4e5b-9944-9cbbaf4455c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:59.598160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.598927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.599549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.615301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] Creating event network-vif-deleted:249a248b-195c-4e5b-9944-9cbbaf4455c3 for instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d on n-h1-831193-17 Oct 04 17:58:59.622124 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b9ac6059-a98c-45ea-8dbb-e5b3c6989234 req-a2e574e9-2e82-4c2d-b496-76f158ae7ecd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040428 Oct 04 17:58:59.623365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1480/2275] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:59.629406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '.version_select at 0x7f63419ab550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.640567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:59.644041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.644733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.645360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.669227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.670118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.670595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.684362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b81ec0ad-27f3-40f3-b42e-5ea9ce9ee0e8 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/5f663155c2d742ffa26c0ae9f21d16b1?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543" status: 200 len: 694 microversion: 2.1 time: 0.059452 Oct 04 17:58:59.685422 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1481/2276] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/os-simple-tenant-usage/5f663155c2d742ffa26c0ae9f21d16b1?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543 => generated 694 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:59.689932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64098bfe-2584-4706-847d-ab471cd93de1 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] Calling method '.version_select at 0x7f6340f19820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.715303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64098bfe-2584-4706-847d-ab471cd93de1 tempest-ServersTestFqdnHostnames-1377020105 tempest-ServersTestFqdnHostnames-1377020105-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868230454" status: 202 len: 0 microversion: 2.1 time: 0.029065 Oct 04 17:58:59.716122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1482/2277] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 17:58:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868230454 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:59.726438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.727999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.739131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.740164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.740940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.742383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.743277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.744025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.771274 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] HTTP exception thrown: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Request method failure captured: Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d HTTP/1.1 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ-N57wYpZgYTgP_FwhlZN3FaA73mrniVKfJvEOfNhYSv_UrCQatLXfunEAXNfvsicHrvOVJrYkYx2g4dSbPDpvnAR2Stu0UVTQZagLK3n7RoNxIXF8iyDKXbF2HZ45mAzCA9KAGj0Xkb0wlj4Ti6Qa21K6Ei4Pd_iUVJjoVBB8sbs Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2dd1673e2bd84981b22a3c6ee643630e Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7ca33a59-82f4-401f-93c2-fbdf8f90bb5d'} Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:59.773436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Returning 404 to user: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e875daf7-bb90-448a-9404-ace6fce47ac3 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 404 len: 111 microversion: 2.21 time: 0.059258 Oct 04 17:58:59.777727 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1483/2278] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:58:59.783760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.785128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.791972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.792485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.793121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.793915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.794570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.795015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.913580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.925298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.927631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.935437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfeafe46-4654-4df9-85b6-d82db7256bff tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1531 microversion: 2.91 time: 0.157280 Oct 04 17:58:59.936026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1484/2279] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1531 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:59.976765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ed69b49-aa61-463d-b17b-09d61805bc75 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6340f19550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.058954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ed69b49-aa61-463d-b17b-09d61805bc75 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86" status: 200 len: 1414 microversion: 2.1 time: 0.109953 Oct 04 17:59:00.059701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1485/2280] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.076427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Calling method '.version_select at 0x7f6345d1f310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.088970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.089470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.089913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.108806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.109133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.109685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.242892 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2298071b-9e8a-4fc0-a3f0-5932c82bea92 tempest-TenantUsagesTestJSON-527804697 tempest-TenantUsagesTestJSON-527804697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543&detailed=1" status: 200 len: 29943 microversion: 2.1 time: 0.171690 Oct 04 17:59:00.243590 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1486/2281] 10.222.0.33 () {58 vars in 1335 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A58%3A55.975543&end=2022-10-05T17%3A58%3A55.975543&detailed=1 => generated 29943 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:00.249278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '.version_select at 0x7f63419be8b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.250057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.285917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.285917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.286500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.287301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.288559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.288559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.398941 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf24aa1e-7648-43ee-b8b4-6fe0af4c7b59 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.154266 Oct 04 17:59:00.400118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1487/2282] 10.222.0.33 () {60 vars in 1337 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d/os-instance-actions => generated 611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:00.405142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.405982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.413733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.414588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.415254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.417318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.418056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.418640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.602249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.611340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e34d5b56-9122-4d65-8f86-b5bdc99c54bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1507 microversion: 2.1 time: 0.209655 Oct 04 17:59:00.612905 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1488/2283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.632062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.632901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.640492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.641140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.641654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.642461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.642997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.644141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.742547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lazy-loading 'services' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:00.766144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9847a797-c3b2-40ce-8d64-a5ed4a963d73 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1938 microversion: 2.91 time: 0.152076 Oct 04 17:59:00.770141 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1489/2284] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1938 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:00.774414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07765c80-757f-47bc-bf0c-9b890087cd9a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63418be0d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.835605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07765c80-757f-47bc-bf0c-9b890087cd9a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86" status: 200 len: 1414 microversion: 2.1 time: 0.067427 Oct 04 17:59:00.836598 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1490/2285] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 => generated 1414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.841372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.841992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.850571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.851667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.851667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.852281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.853065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.853195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.068673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.077598 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4f66aae-5bc0-4b7c-a275-e07eb1df73ad tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 0.239823 Oct 04 17:59:01.078195 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1491/2286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:01.083758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.084306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.097315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.097832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.098588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.099443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.099923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.100364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.134570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:01.227642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7519088d-9749-4089-8895-ba65376d3112 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 204 len: 0 microversion: 2.1 time: 0.148128 Oct 04 17:59:01.231249 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1492/2287] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:01 2022] DELETE /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:01.234320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.235056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.242346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.242845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.243324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.244660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.245124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.245559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.261656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] HTTP exception thrown: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Request method failure captured: Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d HTTP/1.1 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ-N57wYpZgYTgP_FwhlZN3FaA73mrniVKfJvEOfNhYSv_UrCQatLXfunEAXNfvsicHrvOVJrYkYx2g4dSbPDpvnAR2Stu0UVTQZagLK3n7RoNxIXF8iyDKXbF2HZ45mAzCA9KAGj0Xkb0wlj4Ti6Qa21K6Ei4Pd_iUVJjoVBB8sbs Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2dd1673e2bd84981b22a3c6ee643630e Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7ca33a59-82f4-401f-93c2-fbdf8f90bb5d'} Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:01.263375 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Returning 404 to user: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-444ffe1d-ffb8-4e95-aa1a-dba28271f0fc tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 404 len: 111 microversion: 2.21 time: 0.035251 Oct 04 17:59:01.269640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1493/2288] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 17:59:01 2022] DELETE /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:01.275770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:01.276307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.282915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.283473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.283912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.285209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.285659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.286084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.290291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:01.312917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lazy-loading 'flavor' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:01.519795 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b2d6307-cda7-415f-87d5-a6bbde25ece2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action" status: 202 len: 0 microversion: 2.91 time: 0.252196 Oct 04 17:59:01.520432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1494/2289] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 17:59:01 2022] POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:01.525799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-451857a7-72ec-4df8-bb26-1f63a2b02c8e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63417c73a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.680144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-451857a7-72ec-4df8-bb26-1f63a2b02c8e tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86" status: 204 len: 0 microversion: 2.1 time: 0.158149 Oct 04 17:59:01.684106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1495/2290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] DELETE /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:01.761330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a26fb47-88cc-43ed-b566-9c458116fd2c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: .version_select at 0x7f6345cd6670>, body: {"keypair": {"name": "tempest-keypair-1739353653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFRTol1PIY1JRgulQs4Vf0vj+/yJZZ/TJfzLdM8Z78iCGtBVJTLv+Sz2m7ELzDOElfwbU4f0ESLKJifKBK8Dsh9DVKjiy08mB75iDdAcx0cOnW1HlZV+fExr4qRF9OY7g=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:01.793575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1a26fb47-88cc-43ed-b566-9c458116fd2c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:01.805989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1a26fb47-88cc-43ed-b566-9c458116fd2c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for user 552ac7eefa95467d9a4ba25125244af3 and project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:01.847322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a26fb47-88cc-43ed-b566-9c458116fd2c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163779 Oct 04 17:59:01.848967 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1496/2291] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:59:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:01.863313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.865058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.876758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.877648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.879505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.880402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.881319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.882118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.205534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.220235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c54a61b9-0851-4a2c-b9a0-9ea005f8df6e tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1468 microversion: 2.1 time: 0.369497 Oct 04 17:59:02.222544 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1497/2292] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1468 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:02.228482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.229309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] [instance: 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.239122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.240415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.241735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.242850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.243822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.246287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.289447 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] HTTP exception thrown: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Request method failure captured: Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d HTTP/1.1 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ-N57wYpZgYTgP_FwhlZN3FaA73mrniVKfJvEOfNhYSv_UrCQatLXfunEAXNfvsicHrvOVJrYkYx2g4dSbPDpvnAR2Stu0UVTQZagLK3n7RoNxIXF8iyDKXbF2HZ45mAzCA9KAGj0Xkb0wlj4Ti6Qa21K6Ei4Pd_iUVJjoVBB8sbs Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca7ac3ee69de40c6992886d1cadc8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ca7ac3ee69de40c6992886d1cadc8acd Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-627014331 Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2dd1673e2bd84981b22a3c6ee643630e Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsV221TestJSON-627014331-project Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7ca33a59-82f4-401f-93c2-fbdf8f90bb5d'} Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:02.295723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. Oct 04 17:59:02.299392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:02.302397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] Returning 404 to user: Instance 7ca33a59-82f4-401f-93c2-fbdf8f90bb5d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:02.304603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f6c9d8c-1e8c-4680-8e49-8d22842a8626 tempest-InstanceActionsV221TestJSON-627014331 tempest-InstanceActionsV221TestJSON-627014331-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d" status: 404 len: 111 microversion: 2.21 time: 0.080860 Oct 04 17:59:02.305697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1498/2293] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/7ca33a59-82f4-401f-93c2-fbdf8f90bb5d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:02.311024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.312075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.325335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.326144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.326669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.327788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.328462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.329630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.478390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.498318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.504514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.527444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a728a694-6652-42f0-ac72-79427531a843 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.219975 Oct 04 17:59:02.530425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1499/2294] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:02.540599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.541225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.559063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.559486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.559936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.560678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.561140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.561568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.641905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.654074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9a35fd3-4da4-4e7b-81f2-403b785e7e7e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1528 microversion: 2.1 time: 1.122389 Oct 04 17:59:03.664926 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1500/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1528 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:03.687408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-451dd927-b831-4650-b414-7980da15a5c9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6345dfaca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.734374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-451dd927-b831-4650-b414-7980da15a5c9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Image not found. Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-451dd927-b831-4650-b414-7980da15a5c9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 HTTP/1.1 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3baac27e-ca0c-4801-82a1-17e260c8aa86'} Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3baac27e-ca0c-4801-82a1-17e260c8aa86 Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:59:03.736639 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3baac27e-ca0c-4801-82a1-17e260c8aa86 could not be found. Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:03.741329 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.747536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-451dd927-b831-4650-b414-7980da15a5c9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:03.748680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-451dd927-b831-4650-b414-7980da15a5c9 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86" status: 404 len: 62 microversion: 2.1 time: 0.082558 Oct 04 17:59:03.749437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1501/2296] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:03.772471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.774483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.793197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.795681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.796175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.798399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.801256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.801744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.784800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.833801 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed73d989-10cd-4c22-b06b-e8aeae99e3b5 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1322 microversion: 2.1 time: 1.068875 Oct 04 17:59:04.838639 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1502/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1322 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:04.958416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dedca2b-7eb5-4930-a617-2af42cdd7a63", "name": "network-vif-plugged", "status": "completed", "tag": "9b3b3089-3f11-4d34-9e9b-a87a659455c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:04.977370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.978999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.980039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.017673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] Creating event network-vif-plugged:9b3b3089-3f11-4d34-9e9b-a87a659455c6 for instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 on n-h2-831193-17 Oct 04 17:59:05.040760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bb09ec21-5eaa-4f7f-a7fb-74bfd570804a req-c84c26e0-3581-4f2b-8db3-7b8f1bf26e85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196219 Oct 04 17:59:05.056284 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1503/2298] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:05.092795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.095322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.117127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.118256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.119909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.120849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.123975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.124642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.416579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3497205033d4abb8f2ae82eb4a602e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f663155c2d742ffa26c0ae9f21d16b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.427742 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf36e4a1-bc6a-470a-a8d0-d9b282fe7caa tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 200 len: 1426 microversion: 2.1 time: 0.369664 Oct 04 17:59:05.430157 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1504/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 1426 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:05.448083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.448723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.467298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.468005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.474099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.475456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.476315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.476940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.802589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.812580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.821462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.858533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6b0d212-4577-4dcb-8c71-6c7115b2e912 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.425694 Oct 04 17:59:05.871572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1505/2300] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:05.890235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.890838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.897948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.898699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.899366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.900281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.900918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.901507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.323624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '242be122e02f4be3abdd0e7a989764b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9be8d91b134e13b685ed263b5abf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.338889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3e055cd-d469-44ec-be35-9be084f05d3b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 200 len: 1486 microversion: 2.1 time: 0.465965 Oct 04 17:59:06.348103 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1506/2301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:06.363483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:06.367418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:06.378191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.380014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.380639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.381533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.382187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.382892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.203429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:07.237835 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64ea7556-a38f-43ae-a4a6-52476246375b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.882899 Oct 04 17:59:07.240957 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1507/2302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:06 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:07.273128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:07.279092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:07.327217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.332163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.333686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.334573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.338148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.340135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.051505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.072066 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c547628-2c0a-47b6-809c-d6be227e50ed tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1472 microversion: 2.1 time: 0.825529 Oct 04 17:59:08.083994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1508/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:07 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1472 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:08.092190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622dc990-b4fe-49f9-afc9-688439573a16", "name": "network-vif-deleted", "tag": "beb6d673-a250-4b78-adb5-4c66f0ec3859"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:08.114255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.114930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.115418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.146087 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] Creating event network-vif-deleted:beb6d673-a250-4b78-adb5-4c66f0ec3859 for instance 622dc990-b4fe-49f9-afc9-688439573a16 on n-h2-831193-17 Oct 04 17:59:08.158094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ffad5881-6454-4bd8-87e4-4970898fa687 req-cc7d033b-d6ee-4237-ac96-3c7c095dc89d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080984 Oct 04 17:59:08.162401 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1509/2304] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:08.174790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.175487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.189710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.190789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.194323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.195299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.197082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.198414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.305719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:08.555057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-377e8c9d-59da-4349-8652-d646efd1fc54 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 204 len: 0 microversion: 2.1 time: 0.390090 Oct 04 17:59:08.561215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1510/2305] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:08 2022] DELETE /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:08.582968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.587429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] [instance: 622dc990-b4fe-49f9-afc9-688439573a16] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.600771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.607262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.607993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.608915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.609535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.613129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.650653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] HTTP exception thrown: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Request method failure captured: Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 HTTP/1.1 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ1s8A97PEKpMBsqBReNgnpyPVP5B6hgvi3_ksdEvkhLlKn3v3Fc_9xb-q3Qxif2ggRRZ05NoO_up16mb6qANX_IAhBCqptCHV5ElTvFO0oYfVvwJfpXmXqrj9ERUA6MXm6Bcjx9AYBeYkHKWMZKkQwHxNv25DAEeLydT8uIh4JgmY Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f663155c2d742ffa26c0ae9f21d16b1 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TenantUsagesTestJSON-1569462081 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f663155c2d742ffa26c0ae9f21d16b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f663155c2d742ffa26c0ae9f21d16b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f663155c2d742ffa26c0ae9f21d16b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f663155c2d742ffa26c0ae9f21d16b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TenantUsagesTestJSON-1569462081 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f663155c2d742ffa26c0ae9f21d16b1 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1569462081 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TenantUsagesTestJSON-1569462081-project Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b3497205033d4abb8f2ae82eb4a602e1 Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TenantUsagesTestJSON-1569462081-project Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '622dc990-b4fe-49f9-afc9-688439573a16'} Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:08.656738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. Oct 04 17:59:08.661046 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:08.662401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] Returning 404 to user: Instance 622dc990-b4fe-49f9-afc9-688439573a16 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:08.667533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5a556a1-f86b-4206-9a38-d60072b6a354 tempest-TenantUsagesTestJSON-1569462081 tempest-TenantUsagesTestJSON-1569462081-project] 10.222.0.33 "GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16" status: 404 len: 111 microversion: 2.1 time: 0.103457 Oct 04 17:59:08.669312 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1511/2306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/servers/622dc990-b4fe-49f9-afc9-688439573a16 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:08.693506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1540497030", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e7eb701-da0d-4e1f-8568-c130a1a6f34f"}], "security_groups": [{"name": "tempest-securitygroup--638207915"}], "key_name": "tempest-keypair-1739353653", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:09.067173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] validate_networks() for [('1e7eb701-da0d-4e1f-8568-c130a1a6f34f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:09.841717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:09.843060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:09.844157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:09.844850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:09.845398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:09.858434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.859390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.859963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.860919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.861554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.862922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.890570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:09.899908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for user 552ac7eefa95467d9a4ba25125244af3 and project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:09.942177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:09.945416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:09.958657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:10.029284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba1b0e3a-b557-4147-8897-9d6c3447c3ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.356194 Oct 04 17:59:10.030709 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1512/2307] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:10.049659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.050314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.069707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.070693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.071265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.072284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.073178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.073869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.123480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:10.332497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.348703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.351566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.365651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76173d0d-d57a-4b1c-b3b7-f60dd8554f32 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.333389 Oct 04 17:59:10.367247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1513/2308] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:10 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:10.376407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad57d438-4577-4e0b-8c7b-e64363fa45ed", "name": "network-vif-plugged", "status": "completed", "tag": "94f36338-3334-4661-a4fe-bc4a53a5e4bd"}, {"server_uuid": "0eac3a1f-12db-464c-bfa1-eb2c121d3ff0", "name": "network-vif-plugged", "status": "completed", "tag": "acb3b4ee-9d93-40f4-8708-c7c53ec02dde"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:10.411443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.411443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.411443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.432072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Creating event network-vif-plugged:94f36338-3334-4661-a4fe-bc4a53a5e4bd for instance ad57d438-4577-4e0b-8c7b-e64363fa45ed on n-h2-831193-17 Oct 04 17:59:10.433878 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] Creating event network-vif-plugged:acb3b4ee-9d93-40f4-8708-c7c53ec02dde for instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 on n-h1-831193-17 Oct 04 17:59:10.452959 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-94e0c84b-b586-41e5-8b86-52fda0665ae4 req-ad7d80e8-044b-40bd-9cda-ed5a34e96bc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082503 Oct 04 17:59:10.453997 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1514/2309] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:10.460416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:10.461130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.474082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.474625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.477246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.478016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.478660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.481320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.539599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lazy-loading 'flavor' on Instance uuid 6dedca2b-7eb5-4930-a617-2af42cdd7a63 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:10.720191 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3befc55f-65ad-444f-b020-c761acf4e7be tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63/action" status: 202 len: 0 microversion: 2.1 time: 0.262786 Oct 04 17:59:10.723130 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1515/2310] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:10 2022] POST /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:59:10.736689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.738446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.762955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.764060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.764853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.765832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.783696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.785340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.324595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.334373 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a405b4e0-8ddc-416c-b4b4-edb1bf9ba5e9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.609632 Oct 04 17:59:11.366769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1516/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:10 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.409630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c85d840c-56c4-498f-960e-29def113a06b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63419a8ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.473154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c85d840c-56c4-498f-960e-29def113a06b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Image not found. Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c85d840c-56c4-498f-960e-29def113a06b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 HTTP/1.1 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '3baac27e-ca0c-4801-82a1-17e260c8aa86'} Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3baac27e-ca0c-4801-82a1-17e260c8aa86 to delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3baac27e-ca0c-4801-82a1-17e260c8aa86 could not be found. Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.476019 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:11.479837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.486763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c85d840c-56c4-498f-960e-29def113a06b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:11.486763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c85d840c-56c4-498f-960e-29def113a06b tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86" status: 404 len: 62 microversion: 2.1 time: 0.113908 Oct 04 17:59:11.490253 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1517/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:11 2022] DELETE /compute/v2.1/images/3baac27e-ca0c-4801-82a1-17e260c8aa86 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:11.496356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.497539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.506299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.510611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.511542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.516383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.517786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.519130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.673180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.716743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ea22808-eb65-4c89-a8d6-d929dc2a2f3c tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1234 microversion: 2.1 time: 0.224485 Oct 04 17:59:11.724917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1518/2313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1234 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.732415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.742097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.759228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.761129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.762876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.787644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.791910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.794893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.203423 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b3c8de91-b9cf-4f52-990b-38378a8fccf8 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1616 microversion: 2.1 time: 1.476593 Oct 04 17:59:13.226390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1519/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1616 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:13.234324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.234944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.257496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.258042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.258512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.259253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.260077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.260839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.430743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.441914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.452087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.458088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38955470-85d4-4f70-91ab-baa2587b58d7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.229939 Oct 04 17:59:13.474986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1520/2315] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:13.489492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.490162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.497142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.501884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.504715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.505667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.506290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.507686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.538830 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 HTTP/1.1 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0eac3a1f-12db-464c-bfa1-eb2c121d3ff0'} Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:13.542114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:13.546269 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.552817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:13.553914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24f85f97-93ce-4382-87ba-1ea95dc59e95 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 404 len: 111 microversion: 2.1 time: 0.077667 Oct 04 17:59:13.556824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1521/2316] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:13 2022] DELETE /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:13.563620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eac3a1f-12db-464c-bfa1-eb2c121d3ff0", "name": "network-vif-deleted", "tag": "acb3b4ee-9d93-40f4-8708-c7c53ec02dde"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:13.609233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.610053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.610758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.638401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] Creating event network-vif-deleted:acb3b4ee-9d93-40f4-8708-c7c53ec02dde for instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 on n-h1-831193-17 Oct 04 17:59:13.647172 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1a7ef4bb-f579-41af-a853-9e6323d89f4d req-9d190518-9d54-4dfd-9fff-8cab8a83b484 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087014 Oct 04 17:59:13.648939 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1522/2317] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:13.668670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.669527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.696564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.697069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.697508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.698241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.698699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.704144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.372072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.389723 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fffa5cf8-f255-4333-ae92-d85e8371cecb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.732758 Oct 04 17:59:14.390422 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1523/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:14.400933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eac3a1f-12db-464c-bfa1-eb2c121d3ff0", "name": "network-vif-unplugged", "status": "completed", "tag": "acb3b4ee-9d93-40f4-8708-c7c53ec02dde"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:14.435091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.435582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.436211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.455613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] Creating event network-vif-unplugged:acb3b4ee-9d93-40f4-8708-c7c53ec02dde for instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 on n-h1-831193-17 Oct 04 17:59:14.467376 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-580e0a91-8904-4dd8-9889-9566da6bfbcb req-72f729f3-3831-4bf1-a280-80455ae47a67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074795 Oct 04 17:59:14.483962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1524/2319] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:14.493121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.494554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.510467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.512009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.512722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.515337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.517089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.519351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.664403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.681307 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-512cf950-104b-439c-9275-469d383192f1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1296 microversion: 2.1 time: 0.194987 Oct 04 17:59:14.682148 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1525/2320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1296 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:14.728556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:14.733756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.746301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.749370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.751281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.753513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.755843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.757315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.879083 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 while it is in vm_state suspended Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Request method failure captured: Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63/action HTTP/1.1 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ0sA4vfgiaESUlTxWN5tODClRaiRVrHfGy8a683xHkwsnH-RQ1XF7VixuSF3vCcYeeyID1ZTiHE5oULbZDKYVay-0oVPG0hUBZgZGu3y9bsU6B1nXCF6Hjssugl0wxnt9FxQGUMaEdSybK1Rb_GTJP-88XhrV4s4D0iLgabbF4MRA Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 721bb159de9649288716347b8e045cdd Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: {"migrate": {}} Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'migrate' instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 while it is in vm_state suspended Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6dedca2b-7eb5-4930-a617-2af42cdd7a63', 'body': {'migrate': {}}} Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:14.880773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 while it is in vm_state suspended Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 while it is in vm_state suspended Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Returning 409 to user: Cannot 'migrate' instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 while it is in vm_state suspended {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4121cf2c-4e35-4669-8f9d-547995ab218b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63/action" status: 409 len: 148 microversion: 2.1 time: 0.198888 Oct 04 17:59:14.886594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1526/2321] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:14 2022] POST /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63/action => generated 148 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:14.894213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.894833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.908206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.913986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.914641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.918275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.923494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.924636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.948758 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 HTTP/1.1 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0eac3a1f-12db-464c-bfa1-eb2c121d3ff0'} Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.961458 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. Oct 04 17:59:14.965660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:14.975417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:14.979285 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb117422-7e25-46a1-8a1f-e97db27b82ef tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0" status: 404 len: 111 microversion: 2.1 time: 0.089339 Oct 04 17:59:14.985644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1527/2322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/0eac3a1f-12db-464c-bfa1-eb2c121d3ff0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:15.003376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.007426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.023107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.029647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.034391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.034391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.034793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.040287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.206197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.219188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.228146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.245472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6fbb595e-eaaf-4177-a179-f10f31a3ccd5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.257096 Oct 04 17:59:15.260826 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1528/2323] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:15.279498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-071e3747-7d98-4f6d-9cab-8a80bb9004f1 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-071e3747-7d98-4f6d-9cab-8a80bb9004f1 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Request method failure captured: Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action HTTP/1.1 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 39 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ0sA4vfgiaESUlTxWN5tODClRaiRVrHfGy8a683xHkwsnH-RQ1XF7VixuSF3vCcYeeyID1ZTiHE5oULbZDKYVay-0oVPG0hUBZgZGu3y9bsU6B1nXCF6Hjssugl0wxnt9FxQGUMaEdSybK1Rb_GTJP-88XhrV4s4D0iLgabbF4MRA Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 721bb159de9649288716347b8e045cdd Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: {"os-resetState": {"state": "invalid"}} Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f552ec9b-209b-45ba-a715-07a36b85fb90', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:15.285077 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:59:15.289210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.291739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-071e3747-7d98-4f6d-9cab-8a80bb9004f1 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:15.293834 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-071e3747-7d98-4f6d-9cab-8a80bb9004f1 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action" status: 400 len: 144 microversion: 2.1 time: 0.030338 Oct 04 17:59:15.299467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1529/2324] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:15 2022] POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action => generated 144 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:15.306155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abeae9db-d2c7-4aab-a732-29555af73263 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341a4fe50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.355473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-abeae9db-d2c7-4aab-a732-29555af73263 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Image not found. Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abeae9db-d2c7-4aab-a732-29555af73263 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab HTTP/1.1 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9ab546ed-f06d-4d68-a847-e06d8b06aeab'} Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9ab546ed-f06d-4d68-a847-e06d8b06aeab to delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ab546ed-f06d-4d68-a847-e06d8b06aeab could not be found. Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.357719 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:15.361387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.365922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abeae9db-d2c7-4aab-a732-29555af73263 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:15.367889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abeae9db-d2c7-4aab-a732-29555af73263 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab" status: 404 len: 62 microversion: 2.1 time: 0.066297 Oct 04 17:59:15.368680 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1530/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:15 2022] DELETE /compute/v2.1/images/9ab546ed-f06d-4d68-a847-e06d8b06aeab => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:15.381603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b64fd71-1e38-461a-ab0a-8f0d41d62692 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b64fd71-1e38-461a-ab0a-8f0d41d62692 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Request method failure captured: Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action HTTP/1.1 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 31 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ0sA4vfgiaESUlTxWN5tODClRaiRVrHfGy8a683xHkwsnH-RQ1XF7VixuSF3vCcYeeyID1ZTiHE5oULbZDKYVay-0oVPG0hUBZgZGu3y9bsU6B1nXCF6Hjssugl0wxnt9FxQGUMaEdSybK1Rb_GTJP-88XhrV4s4D0iLgabbF4MRA Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 721bb159de9649288716347b8e045cdd Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: {"os-resetState": {"state": 1}} Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f552ec9b-209b-45ba-a715-07a36b85fb90', 'body': {'os-resetState': {'state': 1}}} Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 1 Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:59:15.389837 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:59:15.394093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.396856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b64fd71-1e38-461a-ab0a-8f0d41d62692 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:15.398138 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b64fd71-1e38-461a-ab0a-8f0d41d62692 tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action" status: 400 len: 120 microversion: 2.1 time: 0.028057 Oct 04 17:59:15.410698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1531/2326] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:15 2022] POST /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:15.441270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.444411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.473931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.474911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.478545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.479628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.480470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.483640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.519851 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 HTTP/1.1 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '23f697c6-a0a9-4b57-84d2-901ee9d33a75'} Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:15.527117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:15.531356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.534867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:15.536055 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d4f9ffe-a131-40e0-acbd-5bb931dc51ba tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 404 len: 111 microversion: 2.1 time: 0.117246 Oct 04 17:59:15.536939 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1532/2327] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:15 2022] DELETE /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:15.551358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.552357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.572672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.575430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.575879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.576639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.577098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.577528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.151413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.161771 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a5afa70-d43d-4eb8-bf1b-d2f0f67bcbd3 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.621490 Oct 04 17:59:16.164219 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1533/2328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:15 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:16.169582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:16.171945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Failed to fetch instance by id 999 {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 17:59:16.172533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Request method failure captured: Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 37 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQ0sA4vfgiaESUlTxWN5tODClRaiRVrHfGy8a683xHkwsnH-RQ1XF7VixuSF3vCcYeeyID1ZTiHE5oULbZDKYVay-0oVPG0hUBZgZGu3y9bsU6B1nXCF6Hjssugl0wxnt9FxQGUMaEdSybK1Rb_GTJP-88XhrV4s4D0iLgabbF4MRA Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa0d14278d8e4626b6334530aef93e10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa0d14278d8e4626b6334530aef93e10 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149013616 Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 721bb159de9649288716347b8e045cdd Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149013616-project-admin Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: {"os-resetState": {"state": "error"}} Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 999 could not be found. Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:16.181850 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a118624-6e20-464e-8696-0071443d3f0b tempest-ServersAdminNegativeTestJSON-149013616 tempest-ServersAdminNegativeTestJSON-149013616-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018271 Oct 04 17:59:16.189400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1534/2329] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Oct 4 17:59:16 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:16.194548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.195196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 23f697c6-a0a9-4b57-84d2-901ee9d33a75] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:16.203079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.204418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.205100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.207359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.208352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.209002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.230226 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 HTTP/1.1 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '23f697c6-a0a9-4b57-84d2-901ee9d33a75'} Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.232465 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. Oct 04 17:59:16.236242 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:16.238096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 23f697c6-a0a9-4b57-84d2-901ee9d33a75 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:16.240187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a094c0d-6175-4eb7-ade9-e117ba71e095 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75" status: 404 len: 111 microversion: 2.1 time: 0.054006 Oct 04 17:59:16.244917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1535/2330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/servers/23f697c6-a0a9-4b57-84d2-901ee9d33a75 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:16.250460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.251925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:16.259841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.260723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.261545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.262407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.262994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.263488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.588800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.600217 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-940bac63-458f-42c9-88df-e052c5260fed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.353845 Oct 04 17:59:16.600790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1536/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:17.171044 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-02192f4f-9bb4-430b-b908-4ee5c2436c98 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T17%3A59%3A15.874000&end=2022-10-05T17%3A59%3A15.874000" status: 404 len: 112 microversion: - time: 0.564884 Oct 04 17:59:17.171591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1537/2332] 10.222.0.33 () {58 vars in 1316 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T17%3A59%3A15.874000&end=2022-10-05T17%3A59%3A15.874000 => generated 112 bytes in 566 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:59:17.184268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.188656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.209891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.212290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.215428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.216460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.218216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.218948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.281888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:17.360290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:17.476228 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-757f6474-7f24-4e39-9993-a86c22393840 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 204 len: 0 microversion: 2.1 time: 0.302029 Oct 04 17:59:17.479335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1538/2333] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:17 2022] DELETE /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:17.489203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d924f61-3ff2-4f49-b131-9aa9d6011bb7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f63419a8c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.541318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2d924f61-3ff2-4f49-b131-9aa9d6011bb7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Image not found. Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d924f61-3ff2-4f49-b131-9aa9d6011bb7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d HTTP/1.1 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d'} Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d to delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d could not be found. Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.543236 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d924f61-3ff2-4f49-b131-9aa9d6011bb7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d924f61-3ff2-4f49-b131-9aa9d6011bb7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d" status: 404 len: 62 microversion: 2.1 time: 0.063978 Oct 04 17:59:17.547948 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1539/2334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:17 2022] DELETE /compute/v2.1/images/c2f9e37d-b596-4ef8-bfe3-a1c7deecfd3d => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:17.553251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.561687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.572834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.573631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.574229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.575155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.575758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.576341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.746862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.761543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.763003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.780000 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c65a1a0b-e39a-46b3-b21b-f097950be114 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.230592 Oct 04 17:59:17.784968 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1540/2335] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:17.792031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80618a1c-6322-48e3-9048-07264cb3a2b7 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] Calling method '.version_select at 0x7f63419a89d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.798024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-80618a1c-6322-48e3-9048-07264cb3a2b7 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80618a1c-6322-48e3-9048-07264cb3a2b7 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] Request method failure captured: Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-simple-tenant-usage/50dffe4a5c54404abd2cadfcbb84b43f?start=2022-10-05T17%3A59%3A15.874000&end=2022-10-03T17%3A59%3A15.874000 HTTP/1.1 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRz18o1EHtOwhajTkI6wjej-B_XZKqgD1Ww8H_cYGc8B69oMrQ2H-uTc87o8ynbpIHwTPd7yBCUti5H8UItCxgqHYdaLFxV1MWRkvnpc08Kph8aXKe5JTaBwCK58ThJRokUjABRTZ73ZnfApN0lRY8UQaLEgRPAtl1Kebo8V5_9qfY Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a847bb96d74ab4afc32bf11612f026 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1417620073 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a847bb96d74ab4afc32bf11612f026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a847bb96d74ab4afc32bf11612f026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a847bb96d74ab4afc32bf11612f026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a847bb96d74ab4afc32bf11612f026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1417620073 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a847bb96d74ab4afc32bf11612f026 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1417620073 Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4f3ae4b08c744a8d8e4e1a45a239ce8e Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '50dffe4a5c54404abd2cadfcbb84b43f'} Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 17:59:17.803726 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:17.808878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80618a1c-6322-48e3-9048-07264cb3a2b7 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:17.810710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80618a1c-6322-48e3-9048-07264cb3a2b7 tempest-TenantUsagesNegativeTestJSON-1417620073 tempest-TenantUsagesNegativeTestJSON-1417620073-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/50dffe4a5c54404abd2cadfcbb84b43f?start=2022-10-05T17%3A59%3A15.874000&end=2022-10-03T17%3A59%3A15.874000" status: 400 len: 111 microversion: 2.1 time: 0.024594 Oct 04 17:59:17.811824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1541/2336] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/os-simple-tenant-usage/50dffe4a5c54404abd2cadfcbb84b43f?start=2022-10-05T17%3A59%3A15.874000&end=2022-10-03T17%3A59%3A15.874000 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:17.820018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.821122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.840206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.840739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.841182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.842105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.843308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.843896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.213818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.229359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44270fec-41a9-40d7-98d1-901b53d8a1c0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.415943 Oct 04 17:59:18.245578 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1542/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:18.413108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12e09fdd-f875-43ed-be32-05ac98a6f121 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-205759571", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:18.416886 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-12e09fdd-f875-43ed-be32-05ac98a6f121 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] HTTP exception thrown: min_count must be <= max_count Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12e09fdd-f875-43ed-be32-05ac98a6f121 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Request method failure captured: Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 183 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR0NVBMAoB1Qmbj9eqNz3d7BbamyAqFiJArtnyvYZqyn4RnKBcJxmjJRNGlHbucpCBoow3Pe6MruuyYSgj24YJgAnSH0vSnq6QgwSvcIKsjCNoRZ4udKJAlUyrhlCOKrfuxSAvXm9rwLTJOHOZCAgYipcVG4wifjGVBOO2nnwLHZpI Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 627b0478667d4ba7bc9a6fd210781ad4 Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-205759571", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: exception: min_count must be <= max_count Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-205759571', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 17:59:18.418395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.422383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12e09fdd-f875-43ed-be32-05ac98a6f121 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Returning 400 to user: min_count must be <= max_count {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:18.422383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12e09fdd-f875-43ed-be32-05ac98a6f121 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.172831 Oct 04 17:59:18.422383 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1543/2338] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:18 2022] POST /compute/v2.1/servers => generated 74 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:59:18.432863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc6ddeb-263c-43aa-8c2e-87193a5c93a8", "tag": "8863052f-7da7-4088-a78e-404ba621335a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:18.454948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.456037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.456479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.485130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] Creating event network-changed:8863052f-7da7-4088-a78e-404ba621335a for instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 on n-h1-831193-17 Oct 04 17:59:18.490920 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eabc6578-91f4-4c99-9d94-318b4dd3b544 req-ae874010-9e6e-44c7-93aa-db9ba7525bcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068809 Oct 04 17:59:18.495613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1544/2339] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:18.505222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.505934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.525701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.526694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.528092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.563645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.563645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.563645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.714450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.723536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ef010bd-9928-4fe9-8ec2-160bb99b670a tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1469 microversion: 2.1 time: 0.226496 Oct 04 17:59:18.729887 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1545/2340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:18.735375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.735971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.743601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.744400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.745191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.746252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.746897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.748206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.769278 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b HTTP/1.1 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ddf2603f-013e-44ee-af43-849d98b3f91b'} Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:18.772111 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:18.776588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:18.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:18.779991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69aa321f-9f5a-47eb-8a79-8f57c80fb60a tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 404 len: 111 microversion: 2.1 time: 0.049068 Oct 04 17:59:18.780762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1546/2341] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:18 2022] DELETE /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:18.789648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.803651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.811623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.812276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.812823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.813645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.814208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.816485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.991159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.000761 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0561b66-6df7-48af-aff9-80fd3de2f6b0 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.218759 Oct 04 17:59:19.001712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1547/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:19.177765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61e07f80-88da-451c-9067-622aaa605229 tempest-TenantUsagesNegativeTestJSON-1603196710 tempest-TenantUsagesNegativeTestJSON-1603196710-project] Calling method '.version_select at 0x7f6341a4f1f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.181386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-61e07f80-88da-451c-9067-622aaa605229 tempest-TenantUsagesNegativeTestJSON-1603196710 tempest-TenantUsagesNegativeTestJSON-1603196710-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '957d65b0895141bc8ac635c6298a8888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50dffe4a5c54404abd2cadfcbb84b43f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61e07f80-88da-451c-9067-622aaa605229 tempest-TenantUsagesNegativeTestJSON-1603196710 tempest-TenantUsagesNegativeTestJSON-1603196710-project] Request method failure captured: Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A59%3A15.874000&end=2022-10-05T17%3A59%3A15.874000&detailed=1 HTTP/1.1 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRyCIVpao_IncPnlSxEadmcIb2EhG-DZxO2TXEdLgIPqaUTq2wWVWuLYO6yC_iIxihGIDm9Ip4kOqQZtOxmZEkHm1bX5Q9MsGEYFaJX2FevvYo6Q8YkhrVa2KSiIStUolyssvAaxokMOwTpwa7O79KDWJuBo0vn5ZOnuLHA0jh94l4 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 50dffe4a5c54404abd2cadfcbb84b43f Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1603196710 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50dffe4a5c54404abd2cadfcbb84b43f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50dffe4a5c54404abd2cadfcbb84b43f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50dffe4a5c54404abd2cadfcbb84b43f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50dffe4a5c54404abd2cadfcbb84b43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1603196710 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 50dffe4a5c54404abd2cadfcbb84b43f Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1603196710 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TenantUsagesNegativeTestJSON-1603196710-project Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 957d65b0895141bc8ac635c6298a8888 Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1603196710-project Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:59:19.183147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:59:19.187924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.194248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61e07f80-88da-451c-9067-622aaa605229 tempest-TenantUsagesNegativeTestJSON-1603196710 tempest-TenantUsagesNegativeTestJSON-1603196710-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:19.196303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61e07f80-88da-451c-9067-622aaa605229 tempest-TenantUsagesNegativeTestJSON-1603196710 tempest-TenantUsagesNegativeTestJSON-1603196710-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A59%3A15.874000&end=2022-10-05T17%3A59%3A15.874000&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.193515 Oct 04 17:59:19.211718 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1548/2343] 10.222.0.33 () {58 vars in 1335 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A59%3A15.874000&end=2022-10-05T17%3A59%3A15.874000&detailed=1 => generated 123 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:19.221236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a603dd0e-4686-4fd1-9951-4d4dae044343 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-20901793", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "max_count": 0}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a603dd0e-4686-4fd1-9951-4d4dae044343 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Request method failure captured: Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 166 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR0NVBMAoB1Qmbj9eqNz3d7BbamyAqFiJArtnyvYZqyn4RnKBcJxmjJRNGlHbucpCBoow3Pe6MruuyYSgj24YJgAnSH0vSnq6QgwSvcIKsjCNoRZ4udKJAlUyrhlCOKrfuxSAvXm9rwLTJOHOZCAgYipcVG4wifjGVBOO2nnwLHZpI Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 627b0478667d4ba7bc9a6fd210781ad4 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-20901793", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "max_count": 0}} Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-20901793', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'max_count': 0}}} Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 0 Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:19.232257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:19.237610 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.244628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a603dd0e-4686-4fd1-9951-4d4dae044343 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:19.245737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a603dd0e-4686-4fd1-9951-4d4dae044343 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031560 Oct 04 17:59:19.248391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1549/2344] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:19.273351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.275330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: ddf2603f-013e-44ee-af43-849d98b3f91b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.297866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.298833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.303581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.304810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.307597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.309814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.356234 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b HTTP/1.1 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ddf2603f-013e-44ee-af43-849d98b3f91b'} Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.360520 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. Oct 04 17:59:19.365937 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:19.368402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance ddf2603f-013e-44ee-af43-849d98b3f91b could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:19.369649 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-278b71c7-2a2d-4d94-92b0-72c24a8d2ab7 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b" status: 404 len: 111 microversion: 2.1 time: 0.120083 Oct 04 17:59:19.371707 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1550/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/ddf2603f-013e-44ee-af43-849d98b3f91b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:19.382310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.384805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.401559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.403748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.405694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.408219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.409932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.410891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.543957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.556176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.563096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.571109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-631d7646-e00c-46ed-82d3-10f98772b3f1 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.196567 Oct 04 17:59:19.588067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1551/2346] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:19.595769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.596734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.606700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.607188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.612605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.613427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.614285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.616300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.875379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:19.928787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:20.352698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.368097 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50ce9c80-4eac-4fb7-9dfc-7e9d5df330b4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.783324 Oct 04 17:59:20.393311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1552/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:20.400716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e55627ee-6777-4bb7-b798-f374af3d97e2 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-982802194", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "max_count": 2.5}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e55627ee-6777-4bb7-b798-f374af3d97e2 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Request method failure captured: Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 169 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR0NVBMAoB1Qmbj9eqNz3d7BbamyAqFiJArtnyvYZqyn4RnKBcJxmjJRNGlHbucpCBoow3Pe6MruuyYSgj24YJgAnSH0vSnq6QgwSvcIKsjCNoRZ4udKJAlUyrhlCOKrfuxSAvXm9rwLTJOHOZCAgYipcVG4wifjGVBOO2nnwLHZpI Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 627b0478667d4ba7bc9a6fd210781ad4 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-982802194", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "max_count": 2.5}} Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-982802194', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:20.405425 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:20.410754 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.413523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e55627ee-6777-4bb7-b798-f374af3d97e2 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:20.415106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e55627ee-6777-4bb7-b798-f374af3d97e2 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020215 Oct 04 17:59:20.416574 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1553/2348] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:20.423127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97a77e46-936b-4134-9fdb-5e818f3b1ffb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '.version_select at 0x7f6341e42c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.474898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-97a77e46-936b-4134-9fdb-5e818f3b1ffb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Image not found. Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97a77e46-936b-4134-9fdb-5e818f3b1ffb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 HTTP/1.1 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2ccb623d-4a01-449e-9c39-05244b0d2cd5'} Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ccb623d-4a01-449e-9c39-05244b0d2cd5 to delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ccb623d-4a01-449e-9c39-05244b0d2cd5 could not be found. Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.479885 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:20.484516 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:20.488686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97a77e46-936b-4134-9fdb-5e818f3b1ffb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:20.490427 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-97a77e46-936b-4134-9fdb-5e818f3b1ffb tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5" status: 404 len: 62 microversion: 2.1 time: 0.072179 Oct 04 17:59:20.494427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1554/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:20 2022] DELETE /compute/v2.1/images/2ccb623d-4a01-449e-9c39-05244b0d2cd5 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:20.505786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.512296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:20.535594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.537768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.540558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.541636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.542531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.545541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.656684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.659072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.662490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.663763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lazy-loading 'fault' on Instance uuid 6dedca2b-7eb5-4930-a617-2af42cdd7a63 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:20.790178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.805795 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4681d779-a52b-4bf7-9238-9065ff1c9a44 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 200 len: 1312 microversion: 2.1 time: 0.309882 Oct 04 17:59:20.837524 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1555/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:20.843721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.844824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:20.858036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.858665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.859328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.860318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.861005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.862764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.333080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.345923 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e30ab299-98b3-4314-ae9b-f01fce13c90b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.506496 Oct 04 17:59:21.347073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1556/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:21.352315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dedca2b-7eb5-4930-a617-2af42cdd7a63", "name": "network-vif-deleted", "tag": "9b3b3089-3f11-4d34-9e9b-a87a659455c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:21.371175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.371673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.372112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.395199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] Creating event network-vif-deleted:9b3b3089-3f11-4d34-9e9b-a87a659455c6 for instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 on n-h2-831193-17 Oct 04 17:59:21.402079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-968f00b5-8abf-4c9f-897e-8202b493c524 req-c7dedbc1-537c-452c-b1be-e5f72f9f601e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053123 Oct 04 17:59:21.404359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1557/2352] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:21.413205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.414132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.420863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.422002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.422781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.425360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.426055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.426640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.445819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 HTTP/1.1 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0763ff04-b85e-47e4-a9a9-76095d5b5fd1'} Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:21.447960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:21.455965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.458178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:21.459272 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7d05d09-ed78-454f-8278-bcaff7a409ed tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 404 len: 111 microversion: 2.1 time: 0.052540 Oct 04 17:59:21.460008 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1558/2353] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:21 2022] DELETE /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:21.472935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.474567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.483573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.484333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.484942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.491736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.492958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.493485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.590795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.605614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.607413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.615487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e622851-5f2d-48b8-83d7-56782535ccfe tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.150766 Oct 04 17:59:21.616747 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1559/2354] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:21.621978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bb3deb8-f7bc-4129-8a02-2ee7ae450ed7 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-325690338", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 0}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bb3deb8-f7bc-4129-8a02-2ee7ae450ed7 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Request method failure captured: Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 167 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR0NVBMAoB1Qmbj9eqNz3d7BbamyAqFiJArtnyvYZqyn4RnKBcJxmjJRNGlHbucpCBoow3Pe6MruuyYSgj24YJgAnSH0vSnq6QgwSvcIKsjCNoRZ4udKJAlUyrhlCOKrfuxSAvXm9rwLTJOHOZCAgYipcVG4wifjGVBOO2nnwLHZpI Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 627b0478667d4ba7bc9a6fd210781ad4 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-325690338", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 0}} Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-325690338', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'min_count': 0}}} Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 0 Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:21.626436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 17:59:21.631388 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:21.633483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bb3deb8-f7bc-4129-8a02-2ee7ae450ed7 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:21.636008 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7bb3deb8-f7bc-4129-8a02-2ee7ae450ed7 tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017350 Oct 04 17:59:21.637153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1560/2355] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:21.642396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.643685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.651270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.652114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.652782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.653860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.654704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.655386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.890100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.909267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8577db1d-b372-4c47-9f48-f98135f80bd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.268988 Oct 04 17:59:21.922827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1561/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:21.950473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.953904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] [instance: 0763ff04-b85e-47e4-a9a9-76095d5b5fd1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.973554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.974220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.977024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.977913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.981328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.981878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.030338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] HTTP exception thrown: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Request method failure captured: Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 HTTP/1.1 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHN-N0mhBRcWLZpJh012u3zcPExzelFlPKQaMK10efzFCfbbu0preOLym0_kM_ADGrJUGKkcZhnbsHNQV92Q9ahsOWwclWSfHBaRfh8qzrvqD6XXe95618fNkZrEHM_xJ0CIRjXGn0XrdEdwAHn6yK6LqMGoehOKUfEgQC34FFZlHhM Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f9be8d91b134e13b685ed263b5abf71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5f9be8d91b134e13b685ed263b5abf71 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesTestJSON-1831676925 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 242be122e02f4be3abdd0e7a989764b4 Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesTestJSON-1831676925-project Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0763ff04-b85e-47e4-a9a9-76095d5b5fd1'} Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.040428 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. Oct 04 17:59:22.045085 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.050858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] Returning 404 to user: Instance 0763ff04-b85e-47e4-a9a9-76095d5b5fd1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:22.053442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab795a0e-b1f5-4237-8707-5e78c5e62116 tempest-ImagesTestJSON-1831676925 tempest-ImagesTestJSON-1831676925-project] 10.222.0.33 "GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1" status: 404 len: 111 microversion: 2.1 time: 0.127633 Oct 04 17:59:22.056539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1562/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/0763ff04-b85e-47e4-a9a9-76095d5b5fd1 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:22.063115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.067786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: 6dedca2b-7eb5-4930-a617-2af42cdd7a63] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.082913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.088420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.089337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.091127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.097411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.098543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.121249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] HTTP exception thrown: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Request method failure captured: Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 HTTP/1.1 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQyTt1Fk_RlbIRC4I0pzmWNJOL9wy4Aq8X4KmXbl7j68T5jy41MOzKC3eOBVsbcYmlGHLy85Hbvdy3GYwpGwVBCqgafYiy21a4otGM6-YUQkbyFgBXBjOP0nz7JYS2BuxhhimfE7MaybkbyKYonhCsJKEQCAAWZVNuUhGow0SX6EA4 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 052401edcabb46d78e878aa781b3f08f Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_052401edcabb46d78e878aa781b3f08f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 052401edcabb46d78e878aa781b3f08f Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-752767059-project Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4b936beef28441d4925ee73ce2f4fd37 Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752767059-project Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6dedca2b-7eb5-4930-a617-2af42cdd7a63'} Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.125351 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. Oct 04 17:59:22.129165 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.131661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Returning 404 to user: Instance 6dedca2b-7eb5-4930-a617-2af42cdd7a63 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:22.137080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6bff3a07-7ecd-498b-bfb2-7917ecfc131f tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63" status: 404 len: 111 microversion: 2.1 time: 0.075000 Oct 04 17:59:22.138454 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1563/2358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/6dedca2b-7eb5-4930-a617-2af42cdd7a63 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:22.145961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2dd438d-5d5d-45a0-a609-019fe12a07aa tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2015203601", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 2.5}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2dd438d-5d5d-45a0-a609-019fe12a07aa tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Request method failure captured: Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 170 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR0NVBMAoB1Qmbj9eqNz3d7BbamyAqFiJArtnyvYZqyn4RnKBcJxmjJRNGlHbucpCBoow3Pe6MruuyYSgj24YJgAnSH0vSnq6QgwSvcIKsjCNoRZ4udKJAlUyrhlCOKrfuxSAvXm9rwLTJOHOZCAgYipcVG4wifjGVBOO2nnwLHZpI Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a66916d07e3741ccbfbf83f6cfcdf747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a66916d07e3741ccbfbf83f6cfcdf747 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-32359555 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 627b0478667d4ba7bc9a6fd210781ad4 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-32359555-project Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2015203601", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 2.5}} Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2015203601', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:22.157407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 17:59:22.161736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:22.167586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2dd438d-5d5d-45a0-a609-019fe12a07aa tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:22.170201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2dd438d-5d5d-45a0-a609-019fe12a07aa tempest-MultipleCreateNegativeTestJSON-32359555 tempest-MultipleCreateNegativeTestJSON-32359555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030455 Oct 04 17:59:22.188329 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1564/2359] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:22.190992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.191640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.201929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.202603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.203264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.204223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.204859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.206128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.252755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:22.413831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:22.467184 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-60f5d54e-0a08-4e38-942b-ca4d51015ca7 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 204 len: 0 microversion: 2.1 time: 0.281367 Oct 04 17:59:22.469314 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1565/2360] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:22 2022] DELETE /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:22.478328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.479790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.490905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.491849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.492890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.494198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.494984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.496336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.502765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:22.896502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.910394 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b353cbc-2c1f-40fc-9b36-8e25967f6052 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.439391 Oct 04 17:59:22.925821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1566/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:22.925821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.925821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.926794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.927772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.928239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.929233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.929708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.930147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.211410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.231983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-343bb3e9-3804-4563-9d63-4fced77505da tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1476 microversion: 2.1 time: 0.319329 Oct 04 17:59:23.233669 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1567/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:23.250266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.253649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.269308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.270165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.272775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.273750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.275624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.277913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.424130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.439377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.445400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.472636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8297a94d-a501-4995-9df8-7545809e60b5 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.236810 Oct 04 17:59:23.483068 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1568/2363] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:23.483068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.483068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.501391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.501391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.501863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.502703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.503229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.503795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.936564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.947814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24e65f97-4f36-45b5-9705-8b3cac295cfc tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.469262 Oct 04 17:59:23.948419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1569/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:23.953123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.953767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.976076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.978915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.979574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.981276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.983636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.985714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.641407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.654137 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7754fa22-38a9-401c-8bde-992849f2aa31 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.700547 Oct 04 17:59:24.669949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1570/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:24.693662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:24.694828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:24.709012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.709880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.711316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.712325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.716820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.717590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.031193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b936beef28441d4925ee73ce2f4fd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '052401edcabb46d78e878aa781b3f08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.043066 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a04229a9-8fd3-4f5e-ad9b-8c7e854b5e08 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 200 len: 1476 microversion: 2.1 time: 0.366228 Oct 04 17:59:25.043670 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1571/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:24 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:25.405721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5786b2b0-babf-4835-be67-ca426d1d358f tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.419781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5786b2b0-babf-4835-be67-ca426d1d358f tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.373984 Oct 04 17:59:25.420375 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1572/2367] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:25.452366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.476358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:25.512600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.515459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.517325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.519660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.520264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.521586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.721333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.739953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.744579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.757692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68c0e4b3-4cec-42d1-8b28-eceacb30b6fb tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.332378 Oct 04 17:59:25.770721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1573/2368] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:25.873756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a64894d3-f8f0-4368-a5c5-7f455196c534 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: .version_select at 0x7f6341e42dc0>, body: {"keypair": {"name": "tempest-keypair-1891977886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBYYNukJcbPVBPdw94HrqTpbbJHAqGcfuyFicmLmQs0lSLgdzN0C9Iqo/OR1l7NeWhvbqhcyw3AS75lHRgzeNfqymO8jXFCWn183AH6sVHXugrLdBJEuJ02QdV05ADrow=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:25.953275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a64894d3-f8f0-4368-a5c5-7f455196c534 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:25.981934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a64894d3-f8f0-4368-a5c5-7f455196c534 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:26.124665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a64894d3-f8f0-4368-a5c5-7f455196c534 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361581 Oct 04 17:59:26.139783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1574/2369] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 17:59:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:26.161828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:26.168026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:26.217645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.217916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.225828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.228770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.239153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.244857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.981050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:26.990402 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-60c04aef-8256-48c1-a205-1b6e08ce3107 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1523 microversion: 2.1 time: 0.847687 Oct 04 17:59:26.994178 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1575/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:26 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:27.054741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f552ec9b-209b-45ba-a715-07a36b85fb90", "name": "network-vif-deleted", "tag": "73743b1f-c59e-412d-b122-023b8e1c0c8b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:27.054741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.054741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.054741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.104656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] Creating event network-vif-deleted:73743b1f-c59e-412d-b122-023b8e1c0c8b for instance f552ec9b-209b-45ba-a715-07a36b85fb90 on n-h1-831193-17 Oct 04 17:59:27.194046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4d71d945-db6b-4279-a04b-c8b2916b8616 req-a7e25fe6-be7c-4851-a530-5a62d9c59fca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197036 Oct 04 17:59:27.195191 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1576/2371] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:27.213757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.214433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.253261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.260363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.262470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.264651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.265297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.274424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.635611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.651588 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65885a7f-4cf9-490b-83d1-18bc6628ddcf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1363 microversion: 2.1 time: 0.454978 Oct 04 17:59:27.656603 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1577/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1363 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:27.691295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.695360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] [instance: f552ec9b-209b-45ba-a715-07a36b85fb90] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.726089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.728358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.729091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.731850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.734258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.734978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.774425 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] HTTP exception thrown: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Request method failure captured: Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 HTTP/1.1 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQyTt1Fk_RlbIRC4I0pzmWNJOL9wy4Aq8X4KmXbl7j68T5jy41MOzKC3eOBVsbcYmlGHLy85Hbvdy3GYwpGwVBCqgafYiy21a4otGM6-YUQkbyFgBXBjOP0nz7JYS2BuxhhimfE7MaybkbyKYonhCsJKEQCAAWZVNuUhGow0SX6EA4 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 052401edcabb46d78e878aa781b3f08f Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_052401edcabb46d78e878aa781b3f08f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/052401edcabb46d78e878aa781b3f08f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 052401edcabb46d78e878aa781b3f08f Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752767059 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-752767059-project Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4b936beef28441d4925ee73ce2f4fd37 Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752767059-project Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f552ec9b-209b-45ba-a715-07a36b85fb90'} Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.798859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. Oct 04 17:59:27.803244 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.805136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] Returning 404 to user: Instance f552ec9b-209b-45ba-a715-07a36b85fb90 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:27.812800 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff4048d4-8dc5-4f66-8f71-7e324496c483 tempest-ServersAdminNegativeTestJSON-752767059 tempest-ServersAdminNegativeTestJSON-752767059-project] 10.222.0.33 "GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90" status: 404 len: 111 microversion: 2.1 time: 0.137707 Oct 04 17:59:27.820025 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1578/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/f552ec9b-209b-45ba-a715-07a36b85fb90 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:27.840214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc6ddeb-263c-43aa-8c2e-87193a5c93a8", "name": "network-vif-plugged", "status": "completed", "tag": "8863052f-7da7-4088-a78e-404ba621335a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:27.880078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.882040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.883542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.928768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] Creating event network-vif-plugged:8863052f-7da7-4088-a78e-404ba621335a for instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 on n-h1-831193-17 Oct 04 17:59:27.941104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d841091c-ea07-453a-8952-d8af3a32442d req-554689be-d88f-4729-b47b-dddcb5085cdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118037 Oct 04 17:59:27.947476 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1579/2374] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:27.964287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.967676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.989404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.994645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.994645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.995399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.996740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.003711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.812309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.828995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.832011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.841788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b8ae3cf-8286-4a09-bca2-e39c3d231864 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1558 microversion: 2.91 time: 0.892484 Oct 04 17:59:28.844691 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1580/2375] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1558 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:28.852469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1737581757", "imageRef": "abe413cd-bd12-4724-aa8b-1d90eeeca8e2", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:28.934134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:29.628493 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] Request method failure captured: Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 143 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR867UpkhgqLbQeDxlTganF9cbBj6x_Nb_Z-2rJGbEOBoe25M2fTfSIB_3JSECHa9bLRA5Ay2K1Z7I7X6CUi74IHTDmD6OUlgz6LeirmJvzmOlM9IC6atG4ElaAAvinnmw_-FOUMG6MLyZVYauwXngZLqdrryXOsHymagSvFjtDNLM Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f3817a4985ce47d5b7555f31071d32b4 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FlavorsV2NegativeTest-1889565579 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3817a4985ce47d5b7555f31071d32b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f3817a4985ce47d5b7555f31071d32b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3817a4985ce47d5b7555f31071d32b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f3817a4985ce47d5b7555f31071d32b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FlavorsV2NegativeTest-1889565579 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f3817a4985ce47d5b7555f31071d32b4 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1889565579 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FlavorsV2NegativeTest-1889565579-project Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3017be5f2fef45b2a40fd1679aedc1b1 Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FlavorsV2NegativeTest-1889565579-project Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1737581757", "imageRef": "abe413cd-bd12-4724-aa8b-1d90eeeca8e2", "flavorRef": "452"}} Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: exception: Flavor's memory is too small for requested image. Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1737581757', 'imageRef': 'abe413cd-bd12-4724-aa8b-1d90eeeca8e2', 'flavorRef': '452'}}} Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:29.632661 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 17:59:29.638378 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:29.641861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:29.643896 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-901b85f9-f5fa-4c81-bc06-a74660c0c8ae tempest-FlavorsV2NegativeTest-1889565579 tempest-FlavorsV2NegativeTest-1889565579-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.798168 Oct 04 17:59:29.645838 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1581/2376] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:28 2022] POST /compute/v2.1/servers => generated 93 bytes in 800 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:59:29.653773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.654659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:29.662630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.663550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.664069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.664896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.665361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.667274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.128857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.144964 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8c3f36b-ec36-4a53-88db-e1dd4a0009ee tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1505 microversion: 2.1 time: 0.497768 Oct 04 17:59:30.145566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1582/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:30.165662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.166591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.175534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.179821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.181151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.183914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.184600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.185642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.883022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.902397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18f1ee95-ba9f-4dc1-8862-443272dc6dd5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1548 microversion: 2.1 time: 0.755349 Oct 04 17:59:30.926198 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1583/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:30 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1548 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:30.933493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.944794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.960015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.968622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.969334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.972085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.972724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.974054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.189139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.202464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.204699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.234526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37159b1e-6026-445e-8853-5981a20badd9 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.305634 Oct 04 17:59:31.237929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1584/2379] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:30 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:31.264167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.265456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.276068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.278296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.280354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.281263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.287332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.287811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.590311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f7a6aee-212e-459d-af05-016f53b239a1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350910 Oct 04 17:59:31.590913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1585/2380] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:31.596048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.596823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.614764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.617853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.618305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.619150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.625995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.626530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.181631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.193324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e528a75d-be8d-4da4-9a9a-a558967d48c1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1505 microversion: 2.1 time: 0.600801 Oct 04 17:59:32.194212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1586/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.208449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-999265988", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89fe5a7e-7761-4d04-bb95-deb9053990c0"}], "security_groups": [{"name": "tempest-securitygroup--1125504968"}], "key_name": "tempest-keypair-1891977886", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:32.808584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] validate_networks() for [('89fe5a7e-7761-4d04-bb95-deb9053990c0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:34.444262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:34.446083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:34.447374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:34.447972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:34.449343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:34.485943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.488921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.490539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.493402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.495701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.497711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.574555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:34.598872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:34.668686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:34.677232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:34.946401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47f500f1-4747-4c5a-8316-2b21150233f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.750120 Oct 04 17:59:34.952527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1587/2382] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:34.975504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.979841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.997560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.998073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.998523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.004504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.005575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.006625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.700282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.706901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:35.715669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.718698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.726165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0add2b3c-675f-4d3c-a651-7fd80e65dfa0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.769198 Oct 04 17:59:35.750558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1588/2383] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:35.760442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.761592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.773322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.774833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.775577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.777298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.778126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.778778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.396508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.418927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec7a84f1-cce6-4333-bd97-9a0b74b39be6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 200 len: 1448 microversion: 2.1 time: 0.667018 Oct 04 17:59:36.421450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1589/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 1448 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:36.439154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad57d438-4577-4e0b-8c7b-e64363fa45ed", "name": "network-vif-unplugged", "status": "completed", "tag": "94f36338-3334-4661-a4fe-bc4a53a5e4bd"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:36.467629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.468402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.469063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.528276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_external_events [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] Unable to find a host for instance ad57d438-4577-4e0b-8c7b-e64363fa45ed. Dropping event network-vif-unplugged {{(pid=128770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 17:59:36.529259 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6f30ecbd-97f9-41db-a889-8ae6889d4943 req-1f8b7529-05aa-46f5-bb25-c8ec4f6f6cc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.105846 Oct 04 17:59:36.536840 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1590/2385] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 17:59:36.547308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc6ddeb-263c-43aa-8c2e-87193a5c93a8", "tag": "8863052f-7da7-4088-a78e-404ba621335a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:36.559520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.560272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.561009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.576277 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] Creating event network-changed:8863052f-7da7-4088-a78e-404ba621335a for instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 on n-h1-831193-17 Oct 04 17:59:36.590627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-42ce603c-9499-4896-b3bb-730cbb889b35 req-108a80d8-c378-49f8-a9ba-5bd387d5c981 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051976 Oct 04 17:59:36.591762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1591/2386] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:36.598161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:36.601252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:36.624788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.625730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.626408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.628222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.628869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.629667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.150774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:37.159548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e028666-400b-4a3d-acfe-8837ae9abd12 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1242 microversion: 2.1 time: 0.566229 Oct 04 17:59:37.170065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1592/2387] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:36 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1242 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:37.175619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.186991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.219367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.220194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.221763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.224147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.226057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.228093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.338052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:37.363581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Working on deleting snapshot 5f03fe3f-9a7f-422a-a706-a610fdda3acc from shelved instance... Oct 04 17:59:38.875489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Doing local delete in cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128770) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 17:59:38.876286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.877373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.877818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.878429 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 17:59:38.886132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] deallocate_for_instance() {{(pid=128770) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 17:59:43.159086 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 17:59:43.159710 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 17:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 17:59:44.553619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:44.569565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Updating instance_info_cache with network_info: [] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:59:44.641072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:45.120464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:45.552508 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39f0d6d9-1ea0-4445-b243-efc88ea6c140 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 204 len: 0 microversion: 2.1 time: 8.381144 Oct 04 17:59:45.561387 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1593/2388] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:37 2022] DELETE /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 0 bytes in 8388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:45.582164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:45.584838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:45.611119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.617389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.620021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.620804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.624756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.625227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.941042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.955972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.961728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.986689 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ead2bed0-62ed-4b08-923d-8839a24ce6e6 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.422770 Oct 04 17:59:45.989244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1594/2389] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:45.994185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.004546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.021266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.026377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.027142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.038503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.039319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.039958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.826840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:46.848392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c44b9b87-5a01-4fcc-a0f1-a300cf39d4ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.853404 Oct 04 17:59:46.849485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1595/2390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:46.883888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad57d438-4577-4e0b-8c7b-e64363fa45ed", "name": "network-vif-deleted", "tag": "94f36338-3334-4661-a4fe-bc4a53a5e4bd"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:46.911884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.912371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.919497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.935287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_external_events [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] Unable to find a host for instance ad57d438-4577-4e0b-8c7b-e64363fa45ed. Dropping event network-vif-deleted {{(pid=128770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 17:59:46.936543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-46be4e99-5b6e-415b-b068-a30e47520cea req-94a00ab9-c33b-42e9-99a7-0ca3a90bcfcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067998 Oct 04 17:59:46.937637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1596/2391] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 17:59:46.943499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.944325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.951685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.952444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.953098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.954020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.954752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.955446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.992350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed HTTP/1.1 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ad57d438-4577-4e0b-8c7b-e64363fa45ed'} Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:46.996402 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 17:59:47.001087 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 17:59:47.002784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:47.005071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89b3dc9a-a4d7-4020-8c23-051ef7e7817f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 404 len: 111 microversion: 2.1 time: 0.065114 Oct 04 17:59:47.012927 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1597/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:46 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:47.020893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:47.038827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.043784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.044624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.069114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] Creating event network-changed:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 17:59:47.076124 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-898af9e0-55d2-4fd5-9f7c-da8416db5147 req-5824619f-9468-4944-941f-b15c62fa6a73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060599 Oct 04 17:59:47.077518 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1598/2393] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:47.083132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:47.084488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:47.093150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.094167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.095019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.096184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.096897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.097760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.263594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.276502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.290175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.302013 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-781dd73a-2563-4e32-a890-d3ba57e2ec37 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.223058 Oct 04 17:59:47.307487 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1599/2394] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:47 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:47.320022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1976910058", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:47.431207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:49.209175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:49.210933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:49.211712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:49.212355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:49.213016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:49.240747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.244763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.245478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.246485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.248967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.249668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.289067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:49.295418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:49.311798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:49.323355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:49.401155 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35731917-4631-4b13-a194-d7d59dfc2bd5 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090984 Oct 04 17:59:49.406045 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1600/2395] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:49.412377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:49.435220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:49.447312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.448515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.449378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.450711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.451446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.452095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.916693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:49.933897 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c19c341a-d4d8-40ac-b82d-9c0eba5dd3b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.523772 Oct 04 17:59:49.948642 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1601/2396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:49 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:50.446425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-790499668", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "eac7d53c-de29-484a-a0ac-56cda8a6d2a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:50.644518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] validate_networks() for [('eac7d53c-de29-484a-a0ac-56cda8a6d2a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:53.339896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:53.342001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:53.342767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:53.343439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:53.344078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:53.379767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.380678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.381367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.382489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.383185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.384056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.448704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Getting quotas for project 6767fbec1426493f8371a0cc85ba0aea. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:53.468302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Getting quotas for user dca52f61a60d4d5e9844bae97112f5f2 and project 6767fbec1426493f8371a0cc85ba0aea. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:53.498724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:53.502500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:53.600833 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-523970c8-2072-40ed-93ee-ec423e90cb8f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.646007 Oct 04 17:59:53.608436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1602/2397] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:53.615966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.616880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.625481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.626281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.626912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.627833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.628458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.629879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.917649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.924626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:53.945050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.950478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.974934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1a205c5-7f51-449a-8010-c877a95f3b81 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.363606 Oct 04 17:59:53.978395 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1603/2398] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:53.990449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.991761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.050295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.055225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.056398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.058080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.067997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.070866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.404307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:54.420498 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b302cdf3-6a18-4522-9f51-725997c4edca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1273 microversion: 2.1 time: 0.440403 Oct 04 17:59:54.437395 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1604/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:54.449037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.451094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.459114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.459947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.460590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.461574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.462228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.462839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.136382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:55.154445 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8e821ea-371c-4ee8-be14-624e0811caf0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.710638 Oct 04 17:59:55.162891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1605/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:55.192783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.197121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.213345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.239799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.240816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.242549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.243439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.244867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.662744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:55.688585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c662d227-7ee0-4e7d-a633-b7ed5ec5acc9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1211 microversion: 2.1 time: 0.515567 Oct 04 17:59:55.715456 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1606/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1211 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:55.731345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.731980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.757918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.758806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.760067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.767546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.768552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.769295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.059550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.073260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.079910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.120951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6dbc076a-f393-4850-99d2-14fef87aa163 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.398716 Oct 04 17:59:56.123293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1607/2402] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:56.140483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.147063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.170801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.171579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.172253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.173966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.176957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.177683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.507792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.522596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-985dafd4-6899-401a-8762-3d77f0b76896 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.397952 Oct 04 17:59:56.523226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1608/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.547509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.549005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.562226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.563127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.568914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.569951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.570655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.571343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.299994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:57.309860 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8072cfc-2f34-487e-abdb-7f8098f73e3a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.770681 Oct 04 17:59:57.319120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1609/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:57.370492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:57.373330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:57.402231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.404158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.405027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.409174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.422433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.424576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.891924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:57.911232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6199bd5-66a1-4436-b683-f90028bca884 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1273 microversion: 2.1 time: 0.588681 Oct 04 17:59:57.915082 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1610/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:57 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1273 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:58.043480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-608943527", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:58.209185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] validate_networks() for [('2977e2cf-edcf-4e74-8108-2e16e8c22bd8', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:00.571854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:00.574232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:00.575143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:00.590800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:00.596584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:00.608872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.609742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.610407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.612085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.612783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.622939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.666513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Getting quotas for project d67466a0221b4f6cad9978a8f1b51432. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:00.683392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Getting quotas for user ef9b5baaf1b64847944bf2b3c855275c and project d67466a0221b4f6cad9978a8f1b51432. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:00.710883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:00.713448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:00.805807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a2a6274-814d-499f-81c5-e8896e1f43a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.875327 Oct 04 18:00:00.805807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1611/2406] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:00.805807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:00.805807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:00.814640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.815187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.815636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.816579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.818133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.818750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.974704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:00.992090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.014215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.042728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4a3fa7a-0823-4023-a668-c25dcbb2d759 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1553 microversion: 2.91 time: 0.245781 Oct 04 18:00:01.052700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1612/2407] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:00 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:01.061422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.062190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.072284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.073035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.073892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.074999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.076356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.076938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.419771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.428474 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8200fa5-1e5c-4ee9-bb4a-4bd3c22b6425 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.373108 Oct 04 18:00:01.434467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1613/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:01.442987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.445919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.461661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.462164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.462671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.463573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.464151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.467423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.796813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.806857 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76b469da-664a-4e37-9058-ed3703799833 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.371107 Oct 04 18:00:01.808012 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1614/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:01.813606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-plugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:01.825997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:01.828601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.829489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.830245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.850570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] Creating event network-vif-plugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:00:01.856016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6b8ad3aa-c4db-42e5-a902-ae1eb536ff41 req-b6e89f7b-b8e5-4463-99c5-22ebfad73fd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045837 Oct 04 18:00:01.857098 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1615/2410] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:01.863317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.864088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.870649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.871424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.872066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.872977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.874244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.875222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.143277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:02.155615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-334c68aa-4ea6-4614-a38c-a6383415e27c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.297275 Oct 04 18:00:02.156798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1616/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:02.163188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f340ec-eeba-4114-b93c-300fbcbf6431", "tag": "b92d5cf0-c7a0-40fc-ba22-c708506769e3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:02.174959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.176511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.177357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.190908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] Creating event network-changed:b92d5cf0-c7a0-40fc-ba22-c708506769e3 for instance 32f340ec-eeba-4114-b93c-300fbcbf6431 on n-h1-831193-17 Oct 04 18:00:02.199160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-24fedcb0-74a9-43d6-a08d-633bd141f76d req-e100229e-b765-47d7-b1ce-f039e68e8fe9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040318 Oct 04 18:00:02.204545 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1617/2412] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:02.334070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1409014057", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "9c1836be-320a-46ee-9b2a-6c7a09c1629b"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:02.465497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] validate_networks() for [('9c1836be-320a-46ee-9b2a-6c7a09c1629b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:03.217999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:03.220581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:03.221982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:03.222566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:03.223244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:03.246588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.247120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.252129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.253181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.253827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.254450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.298203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Getting quotas for project 0af872e452ba4bd8ba7fda0346576ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:03.309869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Getting quotas for user 1f40629f9eff4aeebf7694a7c33f0677 and project 0af872e452ba4bd8ba7fda0346576ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:03.339368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:03.352730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:03.421120 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a9b4af3-ccea-4e60-b3de-bad7e1085843 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214624 Oct 04 18:00:03.429237 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1618/2413] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:03.435531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:03.436616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:03.444371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.445204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.445712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.447084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.447924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.449952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.611842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:03.619970 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-95432e74-2939-4bcb-917f-26384a94c5ac tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1281 microversion: 2.1 time: 0.189066 Oct 04 18:00:03.620799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1619/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:03 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:03.625706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54057f0-038d-41cb-974e-44979b103ed4", "tag": "978bf9f1-3f19-4f53-bd79-4f1a47b45268"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:03.697334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.699074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.699788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.760087 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] Creating event network-changed:978bf9f1-3f19-4f53-bd79-4f1a47b45268 for instance b54057f0-038d-41cb-974e-44979b103ed4 on n-h2-831193-17 Oct 04 18:00:03.777674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8ad2127a-f936-4ba8-b3dc-37d859076dc3 req-37671092-6543-4929-9be1-b35376696d1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155447 Oct 04 18:00:03.783869 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1620/2415] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:03.957150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-827b51dc-ad29-4af2-97c9-da250555731b tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Calling method '.version_select at 0x7f63416ddca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.061055 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-827b51dc-ad29-4af2-97c9-da250555731b tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.270638 Oct 04 18:00:04.061692 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1621/2416] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 18:00:03 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:00:04.069041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.071670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.082262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.083477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.084743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.085946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.086860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.087591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.185765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.198487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.200087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.209799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bf9939b-ee1d-4fde-804f-e031c67b59fc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1535 microversion: 2.91 time: 0.145528 Oct 04 18:00:04.210307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1622/2417] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1535 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:04.215934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.217003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.223639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.224236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.225026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.225924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.226448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.227020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.416348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.428284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1af0349-32cc-4d11-a9b6-6ea1e8a6b00c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.216321 Oct 04 18:00:04.429262 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1623/2418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:04.434823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.435551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.442068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.442791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.443498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.444650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.445266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.445888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.656179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.660793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:04.677333 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d93be6f-c2f4-4589-8960-a3b7272f0a23 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1364 microversion: 2.1 time: 0.243019 Oct 04 18:00:04.680077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1624/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:04.692983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.693404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.707164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.707671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.708111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.708822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.709304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.709732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.995538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.007969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cdb111bc-d458-4665-8191-8a45ecb4c55f tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.326868 Oct 04 18:00:05.015188 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1625/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:05.034258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.034882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.042877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.043409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.043850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.044567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.045033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.045461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.213809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.228607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ebf2bf83-f85f-4f6f-afed-379cc57e3a8f tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1220 microversion: 2.1 time: 0.210416 Oct 04 18:00:05.229393 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1626/2421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1220 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:05.244683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b335d46-42e6-4c62-bd05-356bae34ca02 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Action: 'create', calling method: .version_select at 0x7f63424b83a0>, body: {"pool": "non_exist_pool"} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:05.356747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7b335d46-42e6-4c62-bd05-356bae34ca02 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] HTTP exception thrown: Floating IP pool not found. Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b335d46-42e6-4c62-bd05-356bae34ca02 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Request method failure captured: Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 26 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgdOPkN0IbN315CZresDCZEmzZXC-e4FfquHzWzDZmahyNntPjDNyRqpsIHu4LREOLGCi4YK6Q0279bDMux-nQbexRu7YBtbykAt5JXeikWXkLzYlMt-cYOgor5D85WJjgGbYARFfegRixDHrMAyiBwgZ7dsIXhqRa2rKLCqVFqSM Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f0c545ba5e0241d187952548cbd0d6df Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f0c545ba5e0241d187952548cbd0d6df Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsNegativeTestJSON-816453340-project Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: de53611fd36e4070aa1dc5e29d550678 Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-816453340-project Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: {"pool": "non_exist_pool"} Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP pool not found. Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:05.360191 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:05.365527 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 18:00:05.365527 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:05.365527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b335d46-42e6-4c62-bd05-356bae34ca02 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Returning 404 to user: Floating IP pool not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:05.365527 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b335d46-42e6-4c62-bd05-356bae34ca02 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.130765 Oct 04 18:00:05.365527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1627/2422] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:00:05 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:05.372267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.372878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.386481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.387905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.388717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.390540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.391406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.392266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.735618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.748640 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-244c78b5-7d10-426a-a992-f6a325113c1a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.384702 Oct 04 18:00:05.749231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1628/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:05.760025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.760858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.771867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.772734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.773340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.774233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.774847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.775460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.876859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.889909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.891676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.898744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cfaac44-1c35-4c3e-80ca-2f4abf903eb2 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1538 microversion: 2.91 time: 0.148158 Oct 04 18:00:05.915755 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1629/2424] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1538 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:05.938230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Calling method '.version_select at 0x7f63416bb160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.038179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 67f7ee44-432c-481e-8429-710c983b8bfe could not be found", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:00:06.038916 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] HTTP exception thrown: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Request method failure captured: Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-floating-ips/67f7ee44-432c-481e-8429-710c983b8bfe HTTP/1.1 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgdOPkN0IbN315CZresDCZEmzZXC-e4FfquHzWzDZmahyNntPjDNyRqpsIHu4LREOLGCi4YK6Q0279bDMux-nQbexRu7YBtbykAt5JXeikWXkLzYlMt-cYOgor5D85WJjgGbYARFfegRixDHrMAyiBwgZ7dsIXhqRa2rKLCqVFqSM Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: f0c545ba5e0241d187952548cbd0d6df Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0c545ba5e0241d187952548cbd0d6df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: f0c545ba5e0241d187952548cbd0d6df Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-816453340 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsNegativeTestJSON-816453340-project Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: de53611fd36e4070aa1dc5e29d550678 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-816453340-project Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '67f7ee44-432c-481e-8429-710c983b8bfe'} Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 67f7ee44-432c-481e-8429-710c983b8bfe could not be found Oct 04 18:00:06.040839 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93c013e6-3f4f-4e65-84fe-34d8b532f717'] Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe. Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] Returning 404 to user: Floating IP not found for ID 67f7ee44-432c-481e-8429-710c983b8bfe {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:06.045107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-afe38f78-573d-438a-9b3b-a9d932046240 tempest-FloatingIPsNegativeTestJSON-816453340 tempest-FloatingIPsNegativeTestJSON-816453340-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/67f7ee44-432c-481e-8429-710c983b8bfe" status: 404 len: 111 microversion: 2.1 time: 0.126720 Oct 04 18:00:06.047862 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1630/2425] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:00:05 2022] DELETE /compute/v2.1/os-floating-ips/67f7ee44-432c-481e-8429-710c983b8bfe => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:06.056445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.068933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.088780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.091989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.093726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.094588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.095638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.096073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.356500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.368537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31c928ff-675a-46fc-913d-3b3bada3fded tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.316026 Oct 04 18:00:06.370340 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1631/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:06.375354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.376399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.385596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.387442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.388413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.391293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.392719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.393669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.710243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.719825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ec3bb35-45b4-44b2-ae51-1b42a388f13d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1550 microversion: 2.1 time: 0.347949 Oct 04 18:00:06.720640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1632/2427] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1550 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:06.725027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:06.736942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.736942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.737316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.752081 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] Creating event network-changed:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:00:06.758474 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-59691ac7-f2a1-43cb-aad7-ddcf42e06c8d req-d08a1aef-d971-4e89-a3d4-65b0a98d50ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036117 Oct 04 18:00:06.759820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1633/2428] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:06.765464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:06.770415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.778205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.778569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.779006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.779793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.780249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.780673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.845854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-831193-17". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:00:06.950866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e09855b-0657-4369-bb34-fa188697e491 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action" status: 202 len: 0 microversion: 2.91 time: 0.189163 Oct 04 18:00:06.952055 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1634/2429] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:00:06 2022] POST /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:06.960250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.961306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.971011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.971818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.972511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.973504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.974297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.974750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.256913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:07.267158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b3fac79c-e432-4f4d-bb76-417de76dbcb9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.313537 Oct 04 18:00:07.267656 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1635/2430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.283858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.285023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.320860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.321650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.322178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.326572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.330603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.333682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.458879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:07.468862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ebca2e0-089b-40ee-9944-9cf3e516bc58 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1274 microversion: 2.1 time: 0.190835 Oct 04 18:00:07.469448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1636/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.484149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.484648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.495963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.499972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.500903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.504499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.505082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.505567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.613579 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96c67e21-01fe-4681-82e3-0bcbc7020f85 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133135 Oct 04 18:00:07.614472 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1637/2432] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:07.620011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.632339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.641206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.641765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.642367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.643163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.643626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.644058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.927421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:07.956134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24dd0a33-b16c-479b-ac69-ccde18a232c4 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.340486 Oct 04 18:00:07.959800 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1638/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.994557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.000034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.010081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.010711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.011229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.012332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.012794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.013557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.372803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.387631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.392196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.405463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3053909d-a11c-468a-b37d-dbbc4d6d624e tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1486 microversion: 2.91 time: 0.444307 Oct 04 18:00:08.426469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1639/2434] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1486 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:08.442838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.443477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.459164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.459700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.459927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.460827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.461444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.468187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.518615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3233029d-e4d3-4493-aace-be34484d9253 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/ips" status: 200 len: 145 microversion: 2.1 time: 0.090616 Oct 04 18:00:08.519280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1640/2435] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:08.528820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.529816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.552869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.553425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.553810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.554532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.554992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.555451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.469742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:09.482545 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6f83977-3210-4b1c-b1f7-c5c8f2113cd1 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.958042 Oct 04 18:00:09.483747 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1641/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:09.491490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.492167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.501803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.502366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.502869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.504868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.506253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.507252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.910070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:09.927158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24312fa8-e181-4997-b161-52dbd2fdca54 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.442179 Oct 04 18:00:09.928316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1642/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:09.934016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f340ec-eeba-4114-b93c-300fbcbf6431", "name": "network-vif-plugged", "status": "completed", "tag": "b92d5cf0-c7a0-40fc-ba22-c708506769e3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:09.956460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.957279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.957915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.981556 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] Creating event network-vif-plugged:b92d5cf0-c7a0-40fc-ba22-c708506769e3 for instance 32f340ec-eeba-4114-b93c-300fbcbf6431 on n-h1-831193-17 Oct 04 18:00:09.993096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-25e07ef8-2335-4d99-9802-6020f5e7fec6 req-289a1d8e-5525-4e4f-ad64-889ba32f0020 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063340 Oct 04 18:00:09.998373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1643/2438] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:10.007998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.008695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.016601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.017747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.019418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.020308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.020930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.021537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.028192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:10.284982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.295060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb05d0f3-fcc9-4502-a406-73cc5ebdbe90 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.294643 Oct 04 18:00:10.312636 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1644/2439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:10.325015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.327882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.366571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.368648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.369275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.370223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.370845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.371465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.688565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.701714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cde2264-e927-41aa-94ec-b89aa78bad88 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.386594 Oct 04 18:00:10.703515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1645/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:10.713732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.717969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.737526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.740106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.740915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.741831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.744124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.744732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.886190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.904580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.906302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.912644 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26e2fb01-8617-478c-b7e0-560edb75188a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.207316 Oct 04 18:00:10.913589 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1646/2441] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:10.918733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:10.947179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.947179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.947179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.997267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] Creating event network-changed:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:00:11.022085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e98b5f84-57b6-4095-87ac-8777a17d7a11 req-00dc065d-817c-49ee-ad5a-a0f97940ba3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104792 Oct 04 18:00:11.040234 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1647/2442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:11.077924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:11.078654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.114483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.115007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.115513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.116253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.116717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.127603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.669088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:11.678476 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8735dcbe-0a60-422e-90e5-72dc3db31614 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1315 microversion: 2.1 time: 0.636851 Oct 04 18:00:11.682173 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1648/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:11 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:11.690840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:11.693882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.710170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.710869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.712579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.715162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.717707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.718373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.343927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.359114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c0506c8-bd52-4ccb-b024-b285502592c2 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.675300 Oct 04 18:00:12.364289 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1649/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:11 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:12.374173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e441b5e2-f69e-4702-b094-fec87b05b784", "tag": "412bb6e9-814e-4166-a996-70571c674364"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:12.404825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.408228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.408685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.438643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] Creating event network-changed:412bb6e9-814e-4166-a996-70571c674364 for instance e441b5e2-f69e-4702-b094-fec87b05b784 on n-h2-831193-17 Oct 04 18:00:12.449424 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-84b5d9c8-1739-4611-a7ee-aa1c25b9080b req-12b5ee02-2b9b-4c89-bfc0-070b6292e19e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083390 Oct 04 18:00:12.450492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1650/2445] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:12.464711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.465534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.481165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.481834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.482446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.486578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.487351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.487898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.804574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.829777 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74eaab6d-7f4e-46af-8efa-8d071bb379d3 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.371011 Oct 04 18:00:12.830901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1651/2446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:12 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:12.838257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.840108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.860373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.862145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.863188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.865278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.866055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.866863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.200865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.211686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50844969-ad61-46f2-b160-8457e11237ef tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.377481 Oct 04 18:00:13.223069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1652/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:12 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:13.223069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71a3919b-7b92-4686-acf9-a745f18ec440"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:13.223069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:13.234138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.236127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.236796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.237582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.238055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.238501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.281092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:13.329914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=24 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:14.155179 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a0cfa9d-4036-427d-91d3-f3dc4e2eb044 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940948 Oct 04 18:00:14.174914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1653/2448] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:00:13 2022] POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:14.195125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:14.198823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:14.249427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.249955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.250412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.251182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.251642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.252068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.454272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:14.466033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:14.467709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:14.480710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:14.483193 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2deff4dd-b979-4b1e-a450-df9fd8a4a8cc tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.306535 Oct 04 18:00:14.483856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1654/2449] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:14 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:14.512940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54057f0-038d-41cb-974e-44979b103ed4", "name": "network-vif-plugged", "status": "completed", "tag": "978bf9f1-3f19-4f53-bd79-4f1a47b45268"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:14.557987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.558663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.559357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.611049 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] Creating event network-vif-plugged:978bf9f1-3f19-4f53-bd79-4f1a47b45268 for instance b54057f0-038d-41cb-974e-44979b103ed4 on n-h2-831193-17 Oct 04 18:00:14.633667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5714d0bc-a07d-4b76-9afd-e82c4f52a756 req-6e216e32-867e-44d3-b7d0-d32494f59783 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147601 Oct 04 18:00:14.642049 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1655/2450] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:14.665807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:14.671750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:14.690500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.691475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.692246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.693334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.694022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.694626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.605876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.618127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-998d35e4-c0b6-4252-9c32-0ef16856a141 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1503 microversion: 2.1 time: 0.971343 Oct 04 18:00:15.620756 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1656/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:14 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1503 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:15.630309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:15.633563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:15.652933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.653732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.655809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.660411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.661269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.661961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.976266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.988158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a918fb6c-3710-42fa-86bf-0b7b94c488c5 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1315 microversion: 2.1 time: 0.365628 Oct 04 18:00:15.994666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1657/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:15.999842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.000493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.009344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.010263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.010818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.011727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.012415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.012935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.348342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.362538 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c9c63d8f-8b83-4457-8292-bbb55083758d tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.366525 Oct 04 18:00:16.364873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1658/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:16.376723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.380331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.398341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.399144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.399700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.401858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.402502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.403559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.773659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.796221 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4774baa-4324-4fc0-8c20-fd64a9d509a5 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.428581 Oct 04 18:00:16.811138 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1659/2454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:16 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:16.811138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.811138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.843457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.843823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.844309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.846239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.846778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.847310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.971206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.984214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.984214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.993913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bb06107-a69a-44c5-823a-f023496bda3c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.189911 Oct 04 18:00:16.994828 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1660/2455] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:16 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:17.009160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:17.026603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.030606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.031191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.075510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:17.082926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:00:17.187809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-117d33a8-335e-49d9-941f-e7a0c60d4904 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431/action" status: 202 len: 0 microversion: 2.1 time: 0.191609 Oct 04 18:00:17.189096 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1661/2456] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:16 2022] POST /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:00:17.203025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "name": "network-vif-plugged", "status": "completed", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:17.236773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.237268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.237710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.256384 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] Creating event network-vif-plugged:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:00:17.274273 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-58748e8a-5547-4de1-b41f-c13f9d7ee6a8 req-eda6887a-9859-4968-8212-8232576c0ebc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075209 Oct 04 18:00:17.275574 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1662/2457] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:17.286146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.292479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.318750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.319762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.320448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.321184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.321654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.322090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.586461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.597113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e3183e0-b132-424e-a92f-9c77a8b97cac tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1503 microversion: 2.1 time: 0.319908 Oct 04 18:00:17.598664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1663/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:17.607637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.608471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.627554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.629224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.629764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.630614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.631248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.631966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.966466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.985604 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-555cce16-2133-45c6-a998-91a0aad0bd6b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.385117 Oct 04 18:00:17.989955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1664/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:18.001962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.009687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.029736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.031329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.042352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.045273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.046279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.047265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.274660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.283564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6571789-07b5-48ac-a8fb-0c1f493758dd tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.286916 Oct 04 18:00:18.298106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1665/2460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:18.305480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.306007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.312831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.314134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.314723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.315681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.316285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.316959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.402884 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c67ff771-661a-49f2-b3f5-680fcccab4e9 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.109280 Oct 04 18:00:18.403988 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1666/2461] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 18:00:18 2022] DELETE /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4/os-server-password => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:18.409702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.410895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.419230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.420289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.421137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.422108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.423375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.423964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.641753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.653128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7fc07df1-9d37-4d11-b57d-b96483b63762 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.247868 Oct 04 18:00:18.653891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1667/2462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:18 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:18.658835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.659564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.665805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.666207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.666655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.667450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.667870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.668307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.867024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.878923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.885988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.900056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-910b966e-c6cd-4ecc-9e91-c96bde2f1300 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.244910 Oct 04 18:00:18.925113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1668/2463] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:18 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:19.118366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-346be139-481c-42f9-a64c-57069c6c1b7a tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f63416ef940>, body: {"keypair": {"name": "tempest-keypair-592623863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUMnMQKh+WR5lJY7TA99CdRmHQ4l+eEUdfIu6MM6WCL4FW0qwi3yod5a/7Eus2WiT6kk2XIkVNyKPyt0qg6/4NKtSLDxBFIyBljddZ3I/Y60ZOVxUpdsZyaSlFTszhdzQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:19.158845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-346be139-481c-42f9-a64c-57069c6c1b7a tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:19.167564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-346be139-481c-42f9-a64c-57069c6c1b7a tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:19.207967 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-346be139-481c-42f9-a64c-57069c6c1b7a tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.280788 Oct 04 18:00:19.219675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1669/2464] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 293 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:19.249819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.250484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.283886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.284818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.285706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.288628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.293763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.297968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.357327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b939040-774f-4c13-a1c2-22fbd107746e tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.128412 Oct 04 18:00:19.358307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1670/2465] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4/os-server-password => generated 16 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:00:19.369485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.369485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.375255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.376362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.377498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.378564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.379096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.379768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.630647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.651762 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15963e0f-5d52-4410-a382-fc7d7e731242 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.292036 Oct 04 18:00:19.663062 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1671/2466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:19.663062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cf4dcc6-dbb6-4371-b97d-c7174fe2d958 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345d87e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.682192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cf4dcc6-dbb6-4371-b97d-c7174fe2d958 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-592623863" status: 200 len: 512 microversion: 2.2 time: 0.028588 Oct 04 18:00:19.691562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1672/2467] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-592623863 => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:19.695919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e441b5e2-f69e-4702-b094-fec87b05b784", "name": "network-vif-plugged", "status": "completed", "tag": "412bb6e9-814e-4166-a996-70571c674364"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:19.727350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.727859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.728346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.758951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] Creating event network-vif-plugged:412bb6e9-814e-4166-a996-70571c674364 for instance e441b5e2-f69e-4702-b094-fec87b05b784 on n-h2-831193-17 Oct 04 18:00:19.766506 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d728936d-3fca-4972-9aa7-9debd296602e req-1e6aef00-d0b4-4417-914b-baade78c3e19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079909 Oct 04 18:00:19.770526 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1673/2468] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:19.788960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.788960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.796260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.797016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.798392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.798820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.799947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.800204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.128616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.147332 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-98f55f24-4911-471f-979d-bb150652aa74 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.373273 Oct 04 18:00:20.157870 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1674/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:20.164752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.164752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.178645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.179203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.179648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.180392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.180849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.181281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.244254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:20.395524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-787715c8-e006-4266-9db0-1272e08f29dc tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 204 len: 0 microversion: 2.1 time: 0.246223 Oct 04 18:00:20.397545 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1675/2470] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:20 2022] DELETE /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:20.409023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.409904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.416909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.421691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.423306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.424364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.424988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.425592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.588578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.597555 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6384d1ac-f787-4d5b-a8f0-0532dd511259 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.194308 Oct 04 18:00:20.598209 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1676/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:20 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:20.602773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8d8ad1f-8faa-47b8-b76f-43fa873adb3f tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345ca4670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.632463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8d8ad1f-8faa-47b8-b76f-43fa873adb3f tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592623863" status: 204 len: 0 microversion: 2.2 time: 0.033243 Oct 04 18:00:20.633070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1677/2472] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592623863 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:20.638745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.639444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.646954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.647519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.647966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.648668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.649130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.649555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.726863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.731602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:20.739467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.741150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.756704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-411eb290-09c3-4bd1-a168-4d66179065a3 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.122346 Oct 04 18:00:20.767187 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1678/2473] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:20 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:20.767187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.767187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.778831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.005911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.014548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-efaaacae-d887-4503-a58a-303396d7a43c tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1509 microversion: 2.1 time: 0.255535 Oct 04 18:00:21.015199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1679/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:20 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:21.019979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7359d033-2c55-4ccf-8f1e-39a1465bd2b9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f6345ca7940>, body: {"keypair": {"name": "tempest-keypair-1256151533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA99fTFUaGHxa5pt11Eqo3m+vI1d5xjuSNkLZLzo0HQYNhDyWmUAG4Ic4ac2YH92qB47gwa7YFwDKfNWB0a2/gLUUyk35BBkp7jA6n1TXZ7WMY9r4848mcCOyUUMXRqObg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:21.036759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7359d033-2c55-4ccf-8f1e-39a1465bd2b9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:21.042196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7359d033-2c55-4ccf-8f1e-39a1465bd2b9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:21.080781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7359d033-2c55-4ccf-8f1e-39a1465bd2b9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.063939 Oct 04 18:00:21.083105 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1680/2475] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:21.087338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.087338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.093568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.094111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.095119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.095788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.096243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.096672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.251723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.260306 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c79a52c-5fcc-4513-906c-0f84a260066d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.177631 Oct 04 18:00:21.261117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1681/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:21.267166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-746128fa-ecfd-4a6f-b83c-c139579cad1d tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345ca74c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.289262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-746128fa-ecfd-4a6f-b83c-c139579cad1d tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256151533" status: 204 len: 0 microversion: 2.2 time: 0.027074 Oct 04 18:00:21.289858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1682/2477] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Oct 4 18:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256151533 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:21.294971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.295862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.302548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.303111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.303511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.304217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.304676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.305097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.448682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.457193 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-049f8c02-6f41-4ea2-894b-8c7628127fbb tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1316 microversion: 2.1 time: 0.166220 Oct 04 18:00:21.457841 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1683/2478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:21.463515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3d6f8b0-fb7f-4d38-9ba3-eee2d48a718c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f63416e41f0>, body: {"keypair": {"name": "tempest-keypair-596014978", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:21.483203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3d6f8b0-fb7f-4d38-9ba3-eee2d48a718c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:21.484829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:21.491043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3d6f8b0-fb7f-4d38-9ba3-eee2d48a718c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:21.521464 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3d6f8b0-fb7f-4d38-9ba3-eee2d48a718c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.062218 Oct 04 18:00:21.522895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1684/2479] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:21 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:21.534894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6dfa170b-6133-4797-8b23-3992219b1c0d tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340e6ed30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.557643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6dfa170b-6133-4797-8b23-3992219b1c0d tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596014978" status: 204 len: 0 microversion: 2.2 time: 0.026174 Oct 04 18:00:21.557643 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1685/2480] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596014978 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:00:21.571714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ce34e62-7d1f-4b2a-ac50-085ede070b8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f6340e62940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1438195497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANPErfI42S/7eNFJMrVq9meCGKHgNXBCcjOGd0vQeNvPkqvMxVdOklQR+IzmoY77xrRoLdbhwPdivWVx4RMk4BvE8uiVgfKGlA2ehFWQ6DgGzj6HvuZN3BWSTtXjeoqlg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:21.593800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ce34e62-7d1f-4b2a-ac50-085ede070b8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:21.599840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ce34e62-7d1f-4b2a-ac50-085ede070b8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:21.630948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ce34e62-7d1f-4b2a-ac50-085ede070b8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.063023 Oct 04 18:00:21.641701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1686/2481] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:00:21.641701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.641701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.647516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.648014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.648509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.649422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.649889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.650319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.814812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.829376 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-702285d4-be3a-4937-8fd5-cf9b8b5ff3b1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1323 microversion: 2.1 time: 0.195208 Oct 04 18:00:21.830161 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1687/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:21.834809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f045a98-0458-437e-a121-60f6f1a69a09 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f6345c843a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1724308688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEosJXwUne1qRdiC8G9+Ftx8LN/V/T/LcEQdbNhrjSgebMNHcgndOWSxmJcj7kRsZ6CE6obWoDhUADEKm+mrMH/MBlZCwzEF91sLLJxg48NnBoIcE98cdiBVwO+V5Lzseg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:21.852517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9f045a98-0458-437e-a121-60f6f1a69a09 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:21.857898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9f045a98-0458-437e-a121-60f6f1a69a09 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:21.883339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f045a98-0458-437e-a121-60f6f1a69a09 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.052209 Oct 04 18:00:21.884671 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1688/2483] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:21.889484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.890172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.897292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.897746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.898183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.898930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.899408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.899832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.988140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.998460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.000217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.007618 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74ee204e-f73f-4af3-884c-38484128938c tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.121896 Oct 04 18:00:22.012263 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1689/2484] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:22.018951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32ec87b4-8439-44be-926d-186c5c9cd965 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f6345d755e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1612206396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO85K6elocqza2wV5JTt1cCWVoB0Gwr/g5WOOJyUt46f4Z3jxLkSvHRinEWPRvI/mmbZ/pVvSyEse8VOSSU+5kxQvODl/0ElpbQ0UwHG47k02vhnKtEc6G49cUW9OnmDfg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:22.052926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-32ec87b4-8439-44be-926d-186c5c9cd965 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:22.061586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-32ec87b4-8439-44be-926d-186c5c9cd965 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:22.098965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32ec87b4-8439-44be-926d-186c5c9cd965 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.085291 Oct 04 18:00:22.105205 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1690/2485] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:22 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:22.106853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.107665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.119186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.120630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.121247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.123348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.123819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.124390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.374059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca52f61a60d4d5e9844bae97112f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6767fbec1426493f8371a0cc85ba0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.383559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-caea904d-2491-4f14-aac7-ed871241d465 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 200 len: 1509 microversion: 2.1 time: 0.281988 Oct 04 18:00:22.384885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1691/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.389598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b41ddfbc-452b-4633-a03d-a8578e41f891 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345cdfc10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.394337 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-b41ddfbc-452b-4633-a03d-a8578e41f891 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:22.400278 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b41ddfbc-452b-4633-a03d-a8578e41f891 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.014541 Oct 04 18:00:22.401212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1692/2487] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.405924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.406856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.413203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.413529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.413969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.414681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.415169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.415607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.601797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.609776 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af56d20d-2bc6-4af2-b429-73348b60ffcd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.207453 Oct 04 18:00:22.610566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1693/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.615009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e3156a5-4f08-4c29-b1ed-547e7c2c9c61 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345d773a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.640297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e3156a5-4f08-4c29-b1ed-547e7c2c9c61 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1612206396" status: 204 len: 0 microversion: 2.2 time: 0.028719 Oct 04 18:00:22.643563 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1694/2489] 10.222.0.33 () {60 vars in 1321 bytes} [Tue Oct 4 18:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1612206396 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:22.649865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.650601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.657592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.658184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.658701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.660119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.660119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.661375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.853404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.864276 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d843185-b048-4089-bb76-f37fd9e9a989 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1503 microversion: 2.1 time: 0.220829 Oct 04 18:00:22.865885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1695/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.872387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed1ea017-2e67-4490-a0b7-e028f82ba21f tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345c841f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.897942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed1ea017-2e67-4490-a0b7-e028f82ba21f tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1724308688" status: 204 len: 0 microversion: 2.2 time: 0.030231 Oct 04 18:00:22.898668 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1696/2491] 10.222.0.33 () {60 vars in 1321 bytes} [Tue Oct 4 18:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1724308688 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:22.904453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54057f0-038d-41cb-974e-44979b103ed4", "name": "network-vif-deleted", "tag": "978bf9f1-3f19-4f53-bd79-4f1a47b45268"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:22.918879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.919593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.920161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.934274 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] Creating event network-vif-deleted:978bf9f1-3f19-4f53-bd79-4f1a47b45268 for instance b54057f0-038d-41cb-974e-44979b103ed4 on n-h2-831193-17 Oct 04 18:00:22.941861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0d788096-ae59-42c7-a30b-66124b0f9900 req-f2df909a-df02-4541-9a5b-890c9da4e9cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041177 Oct 04 18:00:22.942874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1697/2492] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:22.951269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.952203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.960122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.960722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.961266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.962120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.962710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.963280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.123609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.132413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-046e13f9-d5dd-4669-a4a4-60cc470bea06 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1519 microversion: 2.1 time: 0.187795 Oct 04 18:00:23.133006 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1698/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:23.140052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.140052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.145107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.145901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.146388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.147189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.147746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.148361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.177552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:23.259183 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3704dcfc-282e-4bec-8cbd-3683e609da32 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 204 len: 0 microversion: 2.1 time: 0.124780 Oct 04 18:00:23.260698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1699/2494] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:23 2022] DELETE /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:23.266183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a6e721d-b277-4db8-b8c2-ca2b110b888c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340e6e550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.288785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a6e721d-b277-4db8-b8c2-ca2b110b888c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1438195497" status: 204 len: 0 microversion: 2.2 time: 0.026778 Oct 04 18:00:23.289682 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1700/2495] 10.222.0.33 () {60 vars in 1321 bytes} [Tue Oct 4 18:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1438195497 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:23.300546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.301697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.309511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.310014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.310458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.311211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.311674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.312103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.389265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.398327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.399913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.405154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41451e7b-7a60-4aea-831c-0eaaf1c8081b tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1544 microversion: 2.91 time: 0.114491 Oct 04 18:00:23.405732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1701/2496] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1544 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:23.413558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38e46bf6-1487-4f19-b102-4c837227d8cc tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'create', calling method: .version_select at 0x7f6345d5fee0>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:25.130523 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38e46bf6-1487-4f19-b102-4c837227d8cc tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.723590 Oct 04 18:00:25.131519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1702/2497] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:00:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:25.136578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.137659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.152703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.153542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.154236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.155399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.156212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.157413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.356468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40629f9eff4aeebf7694a7c33f0677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af872e452ba4bd8ba7fda0346576ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.364262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07cb6266-9736-4a42-9d4e-3ec548005967 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 200 len: 1509 microversion: 2.1 time: 0.231705 Oct 04 18:00:25.364845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1703/2498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:25.379281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e75d3d37-ca62-40b0-9969-b1dad970a017 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f63416efdc0>, body: {"keypair": {"name": "tempest-keypair-657643970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChAQ2bdG+O96kNMNOYql7mMf0+U7M+6/QnK04b5b3sdshcw48m1g6WYbOYXS2geJO+iYp+s/+uQhmW0QsLnas/SOsV9bkDmsxFO2LSQL/ofbN1+ZeyL1UDVvYy0w1ycsg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:25.390074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e75d3d37-ca62-40b0-9969-b1dad970a017 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:25.396266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e75d3d37-ca62-40b0-9969-b1dad970a017 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:25.405793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:25.426667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e75d3d37-ca62-40b0-9969-b1dad970a017 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.060017 Oct 04 18:00:25.427675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1704/2499] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:25.435701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.436672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] [instance: b54057f0-038d-41cb-974e-44979b103ed4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.443306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.443971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.444562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.445406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.446022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.446722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.470848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] HTTP exception thrown: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Request method failure captured: Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 HTTP/1.1 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSTLzsAWAgRX8Y5noZNPiJ5aN7KIvtQzV1aILrxJSUTHCAR5rcnhBofc4fviLG9odalQpfbPQVi-RmgRxOJ0Ih2lIi1j1dVxfr4yX2O-0lYtIf_9XmdUva3cqJk_A7l3rgeLu4fuoDPM04a28FYWGT_1WXyqwzX7S6vbM4nuY_VAYw Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 6767fbec1426493f8371a0cc85ba0aea Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerPasswordTestJSON-2021334607 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6767fbec1426493f8371a0cc85ba0aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6767fbec1426493f8371a0cc85ba0aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6767fbec1426493f8371a0cc85ba0aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6767fbec1426493f8371a0cc85ba0aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerPasswordTestJSON-2021334607 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 6767fbec1426493f8371a0cc85ba0aea Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2021334607 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerPasswordTestJSON-2021334607-project Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: dca52f61a60d4d5e9844bae97112f5f2 Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerPasswordTestJSON-2021334607-project Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b54057f0-038d-41cb-974e-44979b103ed4'} Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:25.472713 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.478098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] Returning 404 to user: Instance b54057f0-038d-41cb-974e-44979b103ed4 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:25.479069 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df4b60a0-5b59-402f-b337-16f41a0ac2d3 tempest-ServerPasswordTestJSON-2021334607 tempest-ServerPasswordTestJSON-2021334607-project] 10.222.0.33 "GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4" status: 404 len: 111 microversion: 2.1 time: 0.048955 Oct 04 18:00:25.480504 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1705/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/b54057f0-038d-41cb-974e-44979b103ed4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:25.485207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.485875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.492151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.492639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.493238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.494221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.494670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.495397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.651733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.669513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13885f5d-cbcb-4c4c-86be-bc3fefba321d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.187986 Oct 04 18:00:25.670397 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1706/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:25.680535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.681157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.691102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.692014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.692211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.693022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.693533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.693989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.772746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.781127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.783170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.788286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ace229f9-4e26-4e1d-880e-cb5a725572e0 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1531 microversion: 2.91 time: 0.116913 Oct 04 18:00:25.788847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1707/2502] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1531 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:25.793377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2081223766", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:25.859363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] validate_networks() for [('2977e2cf-edcf-4e74-8108-2e16e8c22bd8', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:26.378992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:26.379785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:26.379952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:26.380367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:26.380782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:26.390121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.393624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.393624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.393624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.394083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.394247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.403322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:26.418625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Getting quotas for project d67466a0221b4f6cad9978a8f1b51432. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:26.424360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Getting quotas for user ef9b5baaf1b64847944bf2b3c855275c and project d67466a0221b4f6cad9978a8f1b51432. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:26.437487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:26.440552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:26.489968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4875c957-bf78-4925-8d4a-2a7bb16763d6 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699829 Oct 04 18:00:26.490592 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1708/2503] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:26.495804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdb9847a-6334-4b7f-a86f-043aae62bd8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340e6e280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.506468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cdb9847a-6334-4b7f-a86f-043aae62bd8e tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-657643970" status: 200 len: 512 microversion: 2.2 time: 0.014534 Oct 04 18:00:26.507285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1709/2504] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-657643970 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:26.517163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e441b5e2-f69e-4702-b094-fec87b05b784", "name": "network-vif-deleted", "tag": "412bb6e9-814e-4166-a996-70571c674364"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:26.527652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.528219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.528855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.541261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] Creating event network-vif-deleted:412bb6e9-814e-4166-a996-70571c674364 for instance e441b5e2-f69e-4702-b094-fec87b05b784 on n-h2-831193-17 Oct 04 18:00:26.546460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9e68eb7d-df52-4bf3-99b3-fa0992498f6d req-5c51d92f-c950-44a6-96c2-517d1d0fdac9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Oct 04 18:00:26.548026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1710/2505] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:26.556630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.557566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.566079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.566826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.567492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.568386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.568851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.569285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.654459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] Lazy-loading 'services' on Instance uuid 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:26.675330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0fbc59d0-b125-4223-bf58-c0827ed69fa4 tempest-UnshelveToHostMultiNodesTest-845778731 tempest-UnshelveToHostMultiNodesTest-845778731-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1938 microversion: 2.91 time: 0.125950 Oct 04 18:00:26.676160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1711/2506] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1938 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:26.685333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.687403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.700995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.701575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.702138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.703254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.703790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.704287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.725185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 HTTP/1.1 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e441b5e2-f69e-4702-b094-fec87b05b784'} Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:26.727352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43203f42-7922-4413-b34e-d8a0830b0526 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 404 len: 111 microversion: 2.1 time: 0.048695 Oct 04 18:00:26.735831 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1712/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:26.738531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96963ac8-ce65-41a2-bc6a-3ff6a5ed9e24 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.738531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96963ac8-ce65-41a2-bc6a-3ff6a5ed9e24 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.807615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-96963ac8-ce65-41a2-bc6a-3ff6a5ed9e24 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.815744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96963ac8-ce65-41a2-bc6a-3ff6a5ed9e24 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1224 microversion: 2.1 time: 0.084687 Oct 04 18:00:26.827260 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1713/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:26.827260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e836be0f-8e31-4b04-8c3f-8506704a145c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345d5fee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.829542 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-e836be0f-8e31-4b04-8c3f-8506704a145c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:26.836754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e836be0f-8e31-4b04-8c3f-8506704a145c tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019412 Oct 04 18:00:26.837440 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1714/2509] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:26.841992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.842614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.849065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.849516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.850344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.850726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.851199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.851629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.025802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.034898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7733ff67-2384-4a56-a110-fdbf706f04ad tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.196342 Oct 04 18:00:27.037208 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1715/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:27.042226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.042746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.058596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.059139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.059591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.060309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.060772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.061206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.102410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:27.232819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12cd672d-ddbf-47ef-be5e-2c204c4734da tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 204 len: 0 microversion: 2.91 time: 0.193592 Oct 04 18:00:27.233827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1716/2511] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:00:27 2022] DELETE /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:00:27.244004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-754146237", "metadata": {"image_type": "test"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:27.247417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.256719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.257703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.258283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.260012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.261242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.261561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.288976 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784/action HTTP/1.1 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 111 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-754146237", "metadata": {"image_type": "test"}}} Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e441b5e2-f69e-4702-b094-fec87b05b784', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-754146237', 'metadata': {'image_type': 'test'}}}} Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:00:27.291454 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5362a64d-8ee3-4f58-a77b-32bbae3b29b4 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "POST /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784/action" status: 404 len: 111 microversion: 2.1 time: 0.058454 Oct 04 18:00:27.295986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1717/2512] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 18:00:27 2022] POST /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:27.307704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-575d1e62-0fd7-4139-9e98-26330b4afba9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340d870d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.327757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-575d1e62-0fd7-4139-9e98-26330b4afba9 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657643970" status: 204 len: 0 microversion: 2.2 time: 0.031737 Oct 04 18:00:27.328347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1718/2513] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657643970 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:27.333853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.334469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.342147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.342813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.343102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.343835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.344922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.345436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.426632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.436798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.439145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.444832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-220e7f65-1963-493b-9f0d-62c77a80608a tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.114939 Oct 04 18:00:27.445722 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1719/2514] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:27 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:27.450339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-172904777", "metadata": {"image_type": "test"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:27.452700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Failed to fetch instance by id tempest-invalid-58965824 {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:00:27.453316 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance tempest-invalid-58965824 could not be found. Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/tempest-invalid-58965824/action HTTP/1.1 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 111 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-172904777", "metadata": {"image_type": "test"}}} Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance tempest-invalid-58965824 could not be found. Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'tempest-invalid-58965824', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-172904777', 'metadata': {'image_type': 'test'}}}} Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-58965824 could not be found. Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:27.455408 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-58965824 could not be found. Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-58965824 could not be found. Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance tempest-invalid-58965824 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:27.459878 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0eee5449-7dcb-4dc7-81bc-094b980767f8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-58965824/action" status: 404 len: 99 microversion: 2.1 time: 0.010226 Oct 04 18:00:27.461628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1720/2515] 10.222.0.33 () {60 vars in 1243 bytes} [Tue Oct 4 18:00:27 2022] POST /compute/v2.1/servers/tempest-invalid-58965824/action => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:27.467574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Action: 'create', calling method: .version_select at 0x7f6340dee9d0>, body: {"keypair": {"name": "tempest-keypair-271311791", "type": "x509"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:27.485867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:27.491625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:27.508505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.processutils [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmptbhwpxbq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptbhwpxbq/temp.key -subj /CN=602bed8c1a18459abeb2c41b083a8df0 -extensions v3_req_client {{(pid=128770) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:00:27.873710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.processutils [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmptbhwpxbq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptbhwpxbq/temp.key -subj /CN=602bed8c1a18459abeb2c41b083a8df0 -extensions v3_req_client" returned: 0 in 0.365s {{(pid=128770) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:00:27.875233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.processutils [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmptbhwpxbq/temp.key -password pass: {{(pid=128770) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:00:27.921345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.processutils [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] CMD "openssl pkcs12 -export -inkey /tmp/tmptbhwpxbq/temp.key -password pass:" returned: 0 in 0.040s {{(pid=128770) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:00:27.989233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:28.007138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Getting quotas for user 602bed8c1a18459abeb2c41b083a8df0 and project 4d419a31acca461494e7932d0786d568. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:28.042751 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cc4995a-2133-41a4-b401-64d26a44fff8 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.579986 Oct 04 18:00:28.049734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1721/2516] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Oct 4 18:00:27 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 582 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:28.058895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-740478987"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:28.062037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:00:28.062578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 56 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-test-snap-740478987"}} Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-740478987'}}} Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.064891 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-371ec46c-fc21-4fc5-ac97-88cc03c27fe5 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.015363 Oct 04 18:00:28.069537 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1722/2517] 10.222.0.33 () {60 vars in 1275 bytes} [Tue Oct 4 18:00:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.072599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.073198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.080855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.081390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.081841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.082603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.083619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.083619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.205005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.219097 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69bc3a98-feb3-4c59-b3be-82fc3173249c tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1294 microversion: 2.1 time: 0.150502 Oct 04 18:00:28.224833 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1723/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:28.240191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee7af305-d111-44e3-9694-f16a95c24a74 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6345d751f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.249768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee7af305-d111-44e3-9694-f16a95c24a74 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-271311791" status: 200 len: 1533 microversion: 2.2 time: 0.022243 Oct 04 18:00:28.257793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1724/2519] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-271311791 => generated 1533 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:28.257793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.257793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.263772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.264272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.264716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.265991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.266120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.266555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.513626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.522043 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-326263f1-7007-47db-b6a6-e18dfe1ff059 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.269858 Oct 04 18:00:28.523179 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1725/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:28.528180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-440050814"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:28.530571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:00:28.531154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 56 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-test-snap-440050814"}} Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-440050814'}}} Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.533468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.537386 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef456a4d-469c-4853-a335-6830434afd06 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010609 Oct 04 18:00:28.541389 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1726/2521] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 18:00:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.548098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb58217b-2a39-420b-8014-f4355cbdc6f3 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340deeee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.553888 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-bb58217b-2a39-420b-8014-f4355cbdc6f3 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:28.561284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb58217b-2a39-420b-8014-f4355cbdc6f3 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.018696 Oct 04 18:00:28.562080 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1727/2522] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:28.566955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.567950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.578259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.578832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.579525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.580435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.580909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.581348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.678223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.696220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.698663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3571343ed2c24d37bf9385ec6552da2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c14a72309845b087dd7a836938c79b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.709644 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41514cad-795f-4d53-a550-14a683b77187 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 200 len: 1537 microversion: 2.91 time: 0.146573 Oct 04 18:00:28.710580 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1728/2523] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:28.717064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.717872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.725408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.726829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.727304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.728287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.728765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.729202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.745303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 HTTP/1.1 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e441b5e2-f69e-4702-b094-fec87b05b784'} Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.746904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a416d398-2f53-4234-902d-fd90c4e93ef8 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 404 len: 111 microversion: 2.1 time: 0.037912 Oct 04 18:00:28.751688 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1729/2524] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:28 2022] DELETE /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.755204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-424c83cd-875f-4083-ac1c-e1784aab0bd4 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] Calling method '.version_select at 0x7f6340deeee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.763877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:28.791088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-424c83cd-875f-4083-ac1c-e1784aab0bd4 tempest-KeyPairsV22TestJSON-1911030415 tempest-KeyPairsV22TestJSON-1911030415-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271311791" status: 204 len: 0 microversion: 2.2 time: 0.039680 Oct 04 18:00:28.792484 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1730/2525] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271311791 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:28.803906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.804844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] [instance: e441b5e2-f69e-4702-b094-fec87b05b784] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.813283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.813983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.814597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.818945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.818945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.818945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.841891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] HTTP exception thrown: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Request method failure captured: Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 HTTP/1.1 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSgBMFsCsUUKHdmQ9_tBTatLQXEuVqhBFPw_GkPNJK3_qBhHsuivWLMIuxBLkrgJ9PxXzwUMhoMg8DqwgFD2kNN1Po9pzjyoaHCIdhM2yLkqkFtNj7RBBJjy-jmEjZGvNf-yRlgjdrIZZEZAF4iEzo_qEB8zRFUb78ie9eMdRBbJT4 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0af872e452ba4bd8ba7fda0346576ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0af872e452ba4bd8ba7fda0346576ea8 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1536513268 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1f40629f9eff4aeebf7694a7c33f0677 Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesNegativeTestJSON-1536513268-project Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e441b5e2-f69e-4702-b094-fec87b05b784'} Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.844240 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] Returning 404 to user: Instance e441b5e2-f69e-4702-b094-fec87b05b784 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.849450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8884789-7575-4218-b6b6-5a4041e1ee00 tempest-ImagesNegativeTestJSON-1536513268 tempest-ImagesNegativeTestJSON-1536513268-project] 10.222.0.33 "GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784" status: 404 len: 111 microversion: 2.1 time: 0.047210 Oct 04 18:00:28.851070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1731/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/e441b5e2-f69e-4702-b094-fec87b05b784 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:29.245842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:29.247140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:29.260377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.261394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.262107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.263102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.264851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.265582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.694512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.702714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-184d4d65-336d-4ac4-9328-91b295fb70b3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 0.462182 Oct 04 18:00:29.703335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1732/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:29 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:29.739545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:29.744215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:29.765126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.768162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.771742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.772770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.773407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.773969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.283675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:30.293891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80b25a0e-d167-499a-9e1f-4838ec674972 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.584943 Oct 04 18:00:30.295282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1733/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:29 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:30.300319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:30.300941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] [instance: 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:30.308952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.309794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.310409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.311377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.311843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.312278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.330983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] HTTP exception thrown: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Request method failure captured: Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 HTTP/1.1 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHQOjj_cjwu5Z-vkOn0VNCQg5JsThAjOjGlwqe0FTqHY4PluGvVOaffPvWzOlbQNQeicAtfjFvK4A3OHJpeMqmgjDPdl5bk_PkHjLjUxf-Rq1sKkgkErVHDtd5w7MpC4dVd008_KM587J2BRJleCRliR755VMcfbW6-wnnZwVT5FXSk Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c6c14a72309845b087dd7a836938c79b Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1495619115 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c6c14a72309845b087dd7a836938c79b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c6c14a72309845b087dd7a836938c79b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c6c14a72309845b087dd7a836938c79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c6c14a72309845b087dd7a836938c79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1495619115 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c6c14a72309845b087dd7a836938c79b Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1495619115 Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-UnshelveToHostMultiNodesTest-1495619115-project Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3571343ed2c24d37bf9385ec6552da2c Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1495619115-project Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7'} Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. Oct 04 18:00:30.333588 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] Returning 404 to user: Instance 0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:30.340097 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49df16b1-a3c2-41f3-947c-3dd75363b1f7 tempest-UnshelveToHostMultiNodesTest-1495619115 tempest-UnshelveToHostMultiNodesTest-1495619115-project] 10.222.0.33 "GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7" status: 404 len: 111 microversion: 2.91 time: 0.039133 Oct 04 18:00:30.341773 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1734/2529] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:30 2022] GET /compute/v2.1/servers/0f8dc6c2-24e4-419f-b3d3-7ab3863a42e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:30.346561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:30.353863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.354581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.355232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.386672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:00:30.470587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb20ec5f-689a-4dfe-825d-5bb9a4f8f963 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action" status: 202 len: 0 microversion: 2.1 time: 0.126645 Oct 04 18:00:30.474624 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1735/2530] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:30 2022] POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:00:30.486486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:30.488131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:30.501198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.503016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.504221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.505328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.505885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.506588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.236104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:31.263480 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59a37bdb-1e66-4a4e-a465-50cae26131e1 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.784589 Oct 04 18:00:31.266703 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1736/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:30 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:31.273321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.274412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:31.282454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.283275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.285597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.287674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.288526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.289503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.334081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:31.773105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:31.804817 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8de94513-70dd-4487-9300-abab189258cd tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 0.536564 Oct 04 18:00:31.805595 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1737/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:31 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:31.823370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.824545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:31.847167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.852244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.852716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.853465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.853945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.854377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.335629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.344411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7cad0d9-0c1f-4f6a-9621-dc9a6b931564 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.534198 Oct 04 18:00:32.345884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1738/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:31 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:32.360713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913", "tag": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:32.374912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.376667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.377787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.401026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] Creating event network-changed:c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238 for instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 on n-h2-831193-17 Oct 04 18:00:32.408894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9ec5ea86-96a5-4759-a6fc-db6a8e2304d3 req-2d38d132-5039-4ed0-acc7-0049723b82c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061116 Oct 04 18:00:32.410732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1739/2534] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:32.417761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.418823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.426610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.427577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.428539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.430666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.431611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.433021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.783726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.809885 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4d7c17a-3637-4c85-a1c8-897d4df4e81e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.397364 Oct 04 18:00:32.839144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1740/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:32.864357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.871567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.881417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.882792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.883335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.884147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.886586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.887066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.183240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.196721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2166bf0e-60eb-4fd2-adae-062da0f140a1 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 0.353511 Oct 04 18:00:33.197694 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1741/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:33.373899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.377816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:33.389828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.392340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.393055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.394301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.395454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.396301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.712886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.728339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99a5d661-5603-47aa-a01e-06acba86d8ca tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.361885 Oct 04 18:00:33.768179 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1742/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:33.873974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.876617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:33.889964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.890955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.891665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.892932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.893813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.894689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.688457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:34.702417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75b38a11-805b-4941-bd36-4481dd6063a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.840014 Oct 04 18:00:34.715583 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1743/2538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:34.727832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.731972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.748454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.755916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.756689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.757435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.758074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.758712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.022608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:36.034620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e0ce0ee-d4f5-40df-ab7f-d692061226c8 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 1.317170 Oct 04 18:00:36.040052 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1744/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.046008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.050814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:36.059531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.060031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.060658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.061387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.061849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.062285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.405174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:36.486760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:36.505048 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f694d1b2-4ab8-4d8e-8a71-0f9f36f04dc4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.461215 Oct 04 18:00:36.507420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1745/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.519667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.520778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:36.533412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.538299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.539018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.539986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.540640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.542368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.032252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.046134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ec096a6-d318-4744-a3bf-2f6af4340165 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.537390 Oct 04 18:00:37.060585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1746/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:37.078073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.079353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:37.087719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.088575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.089276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.090244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.091354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.092356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.526122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.543327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-302efd4a-9163-4fa0-9335-c8c7e3dc0c55 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 0.467444 Oct 04 18:00:37.544522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1747/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:37 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:37.555017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.557274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:37.570077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.571294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.592647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.594610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.595718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.596753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.937532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.959073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf6d8ef0-0256-44e1-a0ce-f1b8cb47a110 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.412594 Oct 04 18:00:37.961660 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1748/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:37 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:38.084337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:38.085891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:38.121404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=44 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:38.127852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.130199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.132537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.134946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.135671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.136288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.476670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:38.493492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e2bd50b-0df5-4fe8-b0d6-a5dd294dfd57 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.418945 Oct 04 18:00:38.495338 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1749/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:38 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:38.501311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913", "name": "network-vif-plugged", "status": "completed", "tag": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:38.519499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.520318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.522487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.544881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] Creating event network-vif-plugged:c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238 for instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 on n-h2-831193-17 Oct 04 18:00:38.555237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1c3a83df-5f66-4070-ab21-059634ef92ec req-5541f9ae-ada9-43df-afff-33a2071edc5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056010 Oct 04 18:00:38.557410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1750/2545] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:38.594822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:38.601037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:38.615280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.618717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.619621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.620466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.622100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.622968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:39.098225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:39.107898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3af26c56-0699-4110-8f71-56df846a7e7d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1324 microversion: 2.1 time: 0.538456 Oct 04 18:00:39.127899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1751/2546] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:38 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:39.143221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:39.144408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:39.157635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:39.158977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:39.159655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:39.160751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:39.161888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:39.162644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.069453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.084025 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-630613ce-2ec2-4b00-a168-8a04fe9ddc50 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1513 microversion: 2.1 time: 0.954925 Oct 04 18:00:40.108286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1752/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:39 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1513 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:40.117486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:40.121281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:40.137033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.143890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.144799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.145925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.146556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.147206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.706542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.721450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e7e67f8-f577-442f-86a0-0f2970984ddc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.610829 Oct 04 18:00:40.730842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1753/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:40 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:40.746448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:40.747488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:40.772636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.773069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.773514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.774251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.774719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.775179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.357086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:41.376968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4612fa4-3acd-48fa-979a-dc3d1a43d6c3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 200 len: 1520 microversion: 2.1 time: 0.644542 Oct 04 18:00:41.381529 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1754/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:40 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 1520 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:41.810437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1280586541", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:41.933062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:42.888256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:42.890186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:42.891672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:42.892342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:42.892984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:42.915537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.918428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.919755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.925203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.926619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.931297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.001210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Getting quotas for project 65df4413de8d4f12a9e324fda9bb9238. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:43.007483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Getting quotas for user a614044e07e442a2adc158f8f3420b01 and project 65df4413de8d4f12a9e324fda9bb9238. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:43.037177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:43.044417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:43.166548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ccd8dd0-07a1-4cb3-a291-9bd22d0c88c4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782006 Oct 04 18:00:43.167892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1755/2550] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:43.179432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:43.180842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:43.202950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.204045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.206329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.208092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.211277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.212658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.227992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:43.641698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.660613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-162df8ac-13c1-4719-b05c-e27307b5d36d tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 200 len: 1490 microversion: 2.1 time: 0.489896 Oct 04 18:00:43.662000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1756/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:43 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 1490 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:43.681215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:43.691285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:43.715755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.720861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.726439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.731276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.732156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.733229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.818433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:00:43.820830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquired lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:00:47.716765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:00:49.602456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Updating instance_info_cache with network_info: [{"id": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8", "address": "fa:16:3e:ac:70:bd", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a2f9079-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:00:49.625397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Releasing lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:00:49.628301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb5a8132-73c5-4f7d-bf36-05a5b59e4579 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action" status: 202 len: 0 microversion: 2.1 time: 5.961721 Oct 04 18:00:49.630339 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1757/2552] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:43 2022] POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action => generated 0 bytes in 5966 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:00:49.638578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:49.639493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:49.648265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.649070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.649738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:49.650967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.651874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.654905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.006510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.035224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3b57b2a-c437-4f01-8a66-a8bec991f986 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1723 microversion: 2.1 time: 0.401676 Oct 04 18:00:50.038311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1758/2553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:49 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:50.051941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.052966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:50.060922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.061435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.062119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.063746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.064445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.065052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.255788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.264183 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b0e585d-f7bf-4e6c-818d-181e36e1fa27 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.223431 Oct 04 18:00:50.268319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1759/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:50 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:50.294228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.295366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:50.309505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.314762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.315614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.316687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.317490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.318138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.733515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.747983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f114803c-e08e-431d-b5e1-a979bef147a4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1317 microversion: 2.1 time: 0.477858 Oct 04 18:00:50.748870 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1760/2555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:50 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:51.040760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:51.041552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:51.049564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.050900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.051628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.053859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.054758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.055483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.104407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:51.193143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52bc81f5-e7f7-4421-8da6-78bd261cf3a0 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 204 len: 0 microversion: 2.1 time: 0.442372 Oct 04 18:00:51.195325 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1761/2556] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:50 2022] DELETE /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:51.256041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-58632596", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "a806b917-9d96-493f-926b-ca832ae16298"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:51.311578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] validate_networks() for [('a806b917-9d96-493f-926b-ca832ae16298', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:51.723134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:51.723574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:51.724058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:51.724480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:51.724930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:51.733763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.735108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.735282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.736028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.736498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.736928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.753788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Getting quotas for project 5857093eaeee448a95f9adedd7f52689. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:51.759097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Getting quotas for user ab51dc213a114803bb421d0422e37fc2 and project 5857093eaeee448a95f9adedd7f52689. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:51.773036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:51.775493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:51.796355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:51.834577 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-687370d5-e74b-4fd4-a033-5d3ad02eba7a tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637061 Oct 04 18:00:51.835331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1762/2557] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:51.914006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4afaac19-3d8f-439f-a69a-7c3667fb2560 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Action: 'create', calling method: .version_select at 0x7f6345cdf430>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:53.968852 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4afaac19-3d8f-439f-a69a-7c3667fb2560 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.125851 Oct 04 18:00:53.972581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1763/2558] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:00:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:53.974370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4afaac19-3d8f-439f-a69a-7c3667fb2560 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:53.976330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4afaac19-3d8f-439f-a69a-7c3667fb2560 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001892 Oct 04 18:00:53.976921 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1764/2559] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 18:00:53 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:00:53.986416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:53.999168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.999660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.000286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.012103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] Creating event network-changed:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:00:54.017015 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0b6fed21-5bb0-4647-98c0-92bfecfe6a97 req-5409c7c3-f4bf-4987-b82d-e454495788fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038420 Oct 04 18:00:54.017619 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1765/2560] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:54.023052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:54.025501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:54.032331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.032843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.033263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.033963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.034415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.034859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.064501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:00:54.065140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquired lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:00:59.063685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.neutron [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] re-assign floating IP 172.25.6.100 from instance 658b9396-d38e-410f-9514-fae1743c30ee Oct 04 18:00:59.147207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:01:00.085165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Updating instance_info_cache with network_info: [{"id": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8", "address": "fa:16:3e:ac:70:bd", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a2f9079-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:01:00.101594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:01:01.084590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Updating instance_info_cache with network_info: [{"id": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238", "address": "fa:16:3e:5d:74:31", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3e31d9e-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:01:01.108549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Releasing lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:01.111187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd705ae1-f3a1-4ed0-bdde-54742cc918ae tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913/action" status: 202 len: 0 microversion: 2.1 time: 7.091943 Oct 04 18:01:01.113013 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1766/2561] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:54 2022] POST /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913/action => generated 0 bytes in 7094 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:01:01.129708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.131739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.141872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.142690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.143827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.145714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.146820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.147703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.386914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.404882 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4919465-918f-4725-87e0-e31d1679d807 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.288045 Oct 04 18:01:01.416785 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1767/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:01.425398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.426614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.433972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.434475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.434982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.435723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.436176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.436600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.585682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.598226 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24a3c0e7-ad5f-41f2-9e8b-5ef298ca7c7b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1700 microversion: 2.1 time: 0.178148 Oct 04 18:01:01.599726 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1768/2563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:01.606602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.608659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.619064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.620072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.620671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.622830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.623725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.624160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.642174 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 HTTP/1.1 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '32f340ec-eeba-4114-b93c-300fbcbf6431'} Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:01.643904 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:01.648213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c5935c7-74b5-43c2-b99b-c776682d94bd tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 404 len: 111 microversion: 2.1 time: 0.044443 Oct 04 18:01:01.650409 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1769/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:01.654049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.654602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.661866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.661994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.662438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.663158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.663618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.664047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.746344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:01.768216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:01.886974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.896501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00c925cc-cf22-42e9-91df-8db154748761 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1317 microversion: 2.1 time: 0.246170 Oct 04 18:01:01.897654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1770/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:01.902208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.903058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.910934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.911584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.912093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.914896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:01.916136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:01.916639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.128518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:02.140848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6e32fc1-0aa3-4177-aed3-d9c9baf2a21f tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1315 microversion: 2.1 time: 0.242206 Oct 04 18:01:02.151714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1771/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:02.164974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f340ec-eeba-4114-b93c-300fbcbf6431", "name": "network-vif-deleted", "tag": "b92d5cf0-c7a0-40fc-ba22-c708506769e3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:02.182703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.184245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.184245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.188230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:02.202398 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] Creating event network-vif-deleted:b92d5cf0-c7a0-40fc-ba22-c708506769e3 for instance 32f340ec-eeba-4114-b93c-300fbcbf6431 on n-h1-831193-17 Oct 04 18:01:02.211596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-885e0c0f-1e54-4bde-913f-0fa261a1fc4c req-2208e0f3-3039-4c10-b537-dd715ff6585b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053641 Oct 04 18:01:02.215200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1772/2567] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:02.226355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-94478e58-1c37-47c0-9dc3-c89bd54243ef tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340d61700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:02.777786 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-94478e58-1c37-47c0-9dc3-c89bd54243ef tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/695f2732-d243-432c-88cf-62edffa71317" status: 200 len: 142 microversion: 2.1 time: 0.557978 Oct 04 18:01:02.778381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1773/2568] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:01:02 2022] GET /compute/v2.1/os-floating-ips/695f2732-d243-432c-88cf-62edffa71317 => generated 142 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:02.783428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:02.794392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.794868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.795475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.810247 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] Creating event network-changed:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:01:02.819807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8456ca85-67d5-46ce-aa4d-a22302924e7f req-aaf385cd-e283-465c-b262-8a9a8fa0d04d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040076 Oct 04 18:01:02.820797 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1774/2569] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:02.826038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-plugged", "status": "completed", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:02.838110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.838971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.839600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.858443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] Creating event network-vif-plugged:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:01:02.864572 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-777156a3-25b0-482a-8481-2c276df483c5 req-d2e3562b-ba2f-41cd-8f12-6b595caf8178 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042799 Oct 04 18:01:02.865199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1775/2570] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:02.871269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:03.130520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:03.139549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.140204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.140667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.141402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.141874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.142315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.520790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] HTTP exception thrown: Floating IP 172.25.6.100 is not associated with instance 658b9396-d38e-410f-9514-fae1743c30ee. Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Request method failure captured: Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action HTTP/1.1 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 49 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSc96lHJSrMmqtcoOWNa-7xZdmtM3if_X93mpyiDo0arluBemcc4Nnr2BQxFq4NKn54vZDI_aX9IumdRJxCjfhBNz1TPv98DyCNpZx1SEi1OliM_lb-FK_XMdA_OkpbSPuip2MzQyP9Jq0a-qvYxBOh8Y26SGp24gh-Nxxi33v1uiQ Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ef9b5baaf1b64847944bf2b3c855275c Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: {"removeFloatingIp": {"address": "172.25.6.100"}} Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP 172.25.6.100 is not associated with instance 658b9396-d38e-410f-9514-fae1743c30ee. Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '658b9396-d38e-410f-9514-fae1743c30ee', 'body': {'removeFloatingIp': {'address': '172.25.6.100'}}} Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.100 is not associated with instance 658b9396-d38e-410f-9514-fae1743c30ee. Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.100 is not associated with instance 658b9396-d38e-410f-9514-fae1743c30ee. Oct 04 18:01:03.523149 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:03.529123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Returning 409 to user: Floating IP 172.25.6.100 is not associated with instance 658b9396-d38e-410f-9514-fae1743c30ee. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:03.530176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd774dee-fa01-4bd0-89ea-292cbcaa9340 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action" status: 409 len: 146 microversion: 2.1 time: 0.663893 Oct 04 18:01:03.531080 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1776/2571] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:02 2022] POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action => generated 146 bytes in 665 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:03.536998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:03.537841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:03.544122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.544872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.545478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.546783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.548695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.549145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.712639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:03.722567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-370a3bff-ae1c-4b37-88db-654602daf8ea tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.190201 Oct 04 18:01:03.723413 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1777/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:03 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:03.731952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:03.751482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.751482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.751482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.789775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Going to try to start instance {{(pid=128770) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:01:03.852951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64a1e6fe-301e-4cc5-bc9a-f557faf8b204 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action" status: 202 len: 0 microversion: 2.1 time: 0.126995 Oct 04 18:01:03.854060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1778/2573] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:03 2022] POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:03.866054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-266988769", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "66b705f3-0696-4070-a412-9319295d3154"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:03.974771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] validate_networks() for [('66b705f3-0696-4070-a412-9319295d3154', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:04.453685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:04.454373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:04.454567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:04.454976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:04.455416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:04.464656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.465308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.465761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.466501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.466986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.467434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.485038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:04.490827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Getting quotas for user 44b91ae4f4d34bc8b4cdef0e24767c0c and project 1f38490a49f84a79b9540fedccb26d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:04.504807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:04.507259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:04.564702 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-034fb300-e859-4e96-9053-3e17b1829066 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707760 Oct 04 18:01:04.565359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1779/2574] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:04.572119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-faa744e7-83e0-4f13-bba8-2ff4e0f6365d tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340d61ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:04.777578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-faa744e7-83e0-4f13-bba8-2ff4e0f6365d tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.210628 Oct 04 18:01:04.778519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1780/2575] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:04 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:04.787361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:04.788513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:04.798193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.798691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.799180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.799878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.800364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.800813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.961086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:04.970746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac17b1aa-17be-41c8-83e7-9e9be0a1d12f tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1467 microversion: 2.1 time: 0.190644 Oct 04 18:01:04.984600 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1781/2576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:04 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1467 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:04.996107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:04.997017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:05.004909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.005763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.006676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.007429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.008049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.008751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.188038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.196244 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4602d553-e5e4-4f2d-b235-de3f473536eb tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1315 microversion: 2.1 time: 0.210513 Oct 04 18:01:05.196847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1782/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:04 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:05.201855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:05.342258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:05.350285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.350789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.351275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.351973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.352428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.352859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.592659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:01:05.593526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquired lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:01:06.375814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:01:07.049640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Updating instance_info_cache with network_info: [{"id": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238", "address": "fa:16:3e:5d:74:31", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3e31d9e-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:01:07.067088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Releasing lock "refresh_cache-a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:07.068341 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb7d2d3e-f8c1-499b-9026-cdef1a2e28fa tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913/action" status: 202 len: 0 microversion: 2.1 time: 1.870511 Oct 04 18:01:07.069258 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1783/2578] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:05 2022] POST /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913/action => generated 0 bytes in 1872 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:01:07.080749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-870746664"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:07.084521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:07.092573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.093829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.094430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.095508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.096387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.097271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.359898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9db5b2a4-a75a-4d38-ae71-0197e55ccbb1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.288581 Oct 04 18:01:07.361752 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1784/2579] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:07 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:01:07.369259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:07.370228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:07.378600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.379535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.380283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.381335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.382151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.382805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.558518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.569387 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6d93b56-23b6-4799-980d-71a5e9bc0d05 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1713 microversion: 2.1 time: 0.205524 Oct 04 18:01:07.591452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1785/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:07 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1713 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:07.787286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8ff228a7-b056-42e5-9587-0a3200901e5c tempest-ExtensionsTest-1231869522 tempest-ExtensionsTest-1231869522-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:07.788912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8ff228a7-b056-42e5-9587-0a3200901e5c tempest-ExtensionsTest-1231869522 tempest-ExtensionsTest-1231869522-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.217993 Oct 04 18:01:07.789736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1786/2581] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 18:01:07 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:07.794625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:07.795565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:07.802336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.802827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.803514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.804420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.804873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.805513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.981962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.990417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-726c241f-be6d-44fc-8117-67016f09d7fb tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1314 microversion: 2.1 time: 0.199391 Oct 04 18:01:07.991010 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1787/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:07 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:07.995885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce3d15db-9d37-48ed-a41e-0721c99efeb2 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340d4ef70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:08.744224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce3d15db-9d37-48ed-a41e-0721c99efeb2 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/695f2732-d243-432c-88cf-62edffa71317" status: 202 len: 0 microversion: 2.1 time: 0.751942 Oct 04 18:01:08.745089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1788/2583] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:07 2022] DELETE /compute/v2.1/os-floating-ips/695f2732-d243-432c-88cf-62edffa71317 => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:08.752041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8d0fbc-907f-4999-b2ee-108a753f5770", "tag": "7fa9b66d-fc01-4c09-9a89-338cd6958334"}, {"name": "network-changed", "server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}, {"name": "network-changed", "server_uuid": "a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913", "tag": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:08.765480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.765978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.766527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.782120 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Creating event network-changed:7fa9b66d-fc01-4c09-9a89-338cd6958334 for instance ed8d0fbc-907f-4999-b2ee-108a753f5770 on n-h2-831193-17 Oct 04 18:01:08.782637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Creating event network-changed:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:01:08.783173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] Creating event network-changed:c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238 for instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 on n-h2-831193-17 Oct 04 18:01:08.794501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6294e40d-5167-4506-b128-2d5de18ea202 req-cd36a122-b520-4680-9ed1-897a068dbd8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.047901 Oct 04 18:01:08.795239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1789/2584] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:08.802847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-628050777", "metadata": {"image_type": "test"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:08.805721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:08.813908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.814405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.814875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.815614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.816072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.816504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.855737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Getting quotas for project 65df4413de8d4f12a9e324fda9bb9238. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:08.861088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Getting quotas for user a614044e07e442a2adc158f8f3420b01 and project 65df4413de8d4f12a9e324fda9bb9238. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:09.087766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50e3f801-1366-4703-bffe-025318562d7e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "POST /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb/action" status: 202 len: 0 microversion: 2.1 time: 0.290346 Oct 04 18:01:09.099751 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1790/2585] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:08 2022] POST /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:01:09.102229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8d0fbc-907f-4999-b2ee-108a753f5770", "name": "network-vif-plugged", "status": "completed", "tag": "7fa9b66d-fc01-4c09-9a89-338cd6958334"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:09.116318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.117094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.117719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.123146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:09.131799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] Creating event network-vif-plugged:7fa9b66d-fc01-4c09-9a89-338cd6958334 for instance ed8d0fbc-907f-4999-b2ee-108a753f5770 on n-h2-831193-17 Oct 04 18:01:09.137275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7077f453-5460-44dd-ace0-3e8eefb1f57b req-4f152e64-3138-436d-bba4-a2f45f0e4c9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046061 Oct 04 18:01:09.138522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1791/2586] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:09.145369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:09.146176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:09.157656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.160321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.161731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.164124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.164989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.165881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.764382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.777638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64c24d1d-9a73-4901-974f-555f421d88ca tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1315 microversion: 2.1 time: 0.637584 Oct 04 18:01:09.778261 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1792/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:09 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:09.783353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:09.784157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:09.790161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.791434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.792383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.793141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.793595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.794019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.819823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:09.900109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70712d26-d340-405c-a7aa-a25c57e777e0 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 204 len: 0 microversion: 2.1 time: 0.120552 Oct 04 18:01:09.901128 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1793/2588] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:09 2022] DELETE /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:09.910447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91137be-05ef-4c61-8ef7-1a2cab796623", "tag": "d085f00b-1013-48f9-b517-9f2c17939d94"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:09.917753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.918309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.918857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.931922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] Creating event network-changed:d085f00b-1013-48f9-b517-9f2c17939d94 for instance e91137be-05ef-4c61-8ef7-1a2cab796623 on n-h1-831193-17 Oct 04 18:01:09.941129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-74415bc6-1032-4860-a9fb-e4d429c4525a req-d3eab46d-e24a-48b4-8e00-bbd2235d45df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038530 Oct 04 18:01:09.942009 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1794/2589] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:09.947124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6fd47f7-6147-40bd-8d11-20320caec9aa tempest-ExtensionsTest-1231869522 tempest-ExtensionsTest-1231869522-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:09.949187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6fd47f7-6147-40bd-8d11-20320caec9aa tempest-ExtensionsTest-1231869522 tempest-ExtensionsTest-1231869522-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006220 Oct 04 18:01:09.950155 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1795/2590] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 18:01:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:09.962219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b58495f-3346-494d-b94b-df8f4fbaa041 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Action: 'create', calling method: .version_select at 0x7f6345ca70d0>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:11.431452 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b58495f-3346-494d-b94b-df8f4fbaa041 tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.475253 Oct 04 18:01:11.432827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1796/2591] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:01:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:11.439083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:11.439880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:11.447733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.448362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.449031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.449802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.450389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.451063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.720689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:11.733295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a665010-8256-4dc1-8d62-540d71bf4647 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1314 microversion: 2.1 time: 0.298601 Oct 04 18:01:11.734783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1797/2592] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:11 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:11.742282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1b03700-80f1-4d2b-99e5-111a820989fa tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6345ca70d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:11.811816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1b03700-80f1-4d2b-99e5-111a820989fa tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 200 len: 1423 microversion: 2.1 time: 0.075505 Oct 04 18:01:11.824777 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1798/2593] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:11 2022] GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:11.824777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:11.824777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:11.836146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.836653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.837094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.837812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.838451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.838889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.871946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:01:11.872349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquired lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:01:13.644645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:01:14.462105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Updating instance_info_cache with network_info: [{"id": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8", "address": "fa:16:3e:ac:70:bd", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a2f9079-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:01:14.475858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:14.478729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Releasing lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:14.480099 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a2f752a-7bf0-4f19-9214-37fb35deda72 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action" status: 202 len: 0 microversion: 2.1 time: 2.666421 Oct 04 18:01:14.493170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1799/2594] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:11 2022] POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action => generated 0 bytes in 2680 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:01:14.510917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:14.511584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:14.520348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:14.533737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.534459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.538828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.539876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.540307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.540849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.860205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:14.877514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87faff51-ee63-4ce1-9210-1649b3cc5f3b tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1505 microversion: 2.1 time: 0.378702 Oct 04 18:01:14.878962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1800/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:14 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:14.900209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913", "tag": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:14.925097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.925600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.926052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.955591 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] Creating event network-changed:c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238 for instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 on n-h2-831193-17 Oct 04 18:01:14.970635 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b6c05f38-e9d0-4927-b0c8-486175b40b47 req-c0d7a0d8-dd63-48be-a2bb-418982c3cf90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087409 Oct 04 18:01:14.971296 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1801/2596] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:14.986548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9a54960-3f46-4d18-86cd-a96c606f914e tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340dee820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:16.859310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9a54960-3f46-4d18-86cd-a96c606f914e tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d" status: 202 len: 0 microversion: 2.1 time: 1.878345 Oct 04 18:01:16.862475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1802/2597] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:14 2022] DELETE /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d => generated 0 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:16.871496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913", "name": "network-vif-deleted", "tag": "c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:16.896136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.896958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.897659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.915084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] Creating event network-vif-deleted:c3e31d9e-7d3a-4df7-9d9c-d70bbc7a3238 for instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 on n-h2-831193-17 Oct 04 18:01:16.920527 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7953323c-74ea-4366-9ca4-92001e2be621 req-647d6bf7-6fa5-4adb-992a-b2028175bc16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056543 Oct 04 18:01:16.921984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1803/2598] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:17.154120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8382802f-7b41-45c5-a019-8478a7ae6c30 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Action: 'create', calling method: .version_select at 0x7f6340d564c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-570077605", "metadata": {"Type": "work"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:17.788035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8382802f-7b41-45c5-a019-8478a7ae6c30 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.864392 Oct 04 18:01:17.789670 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1804/2599] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 18:01:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 867 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:01:17.806945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:17.808098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:17.834325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.834827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.835330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.836289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.836898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.837339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.127199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:18.145490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6952c882-0811-44e6-acb1-e1b922f0842a tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1314 microversion: 2.1 time: 0.336692 Oct 04 18:01:18.145490 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1805/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:17 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:18.168802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91137be-05ef-4c61-8ef7-1a2cab796623", "name": "network-vif-plugged", "status": "completed", "tag": "d085f00b-1013-48f9-b517-9f2c17939d94"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:18.186342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.187676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.188336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.207393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] Creating event network-vif-plugged:d085f00b-1013-48f9-b517-9f2c17939d94 for instance e91137be-05ef-4c61-8ef7-1a2cab796623 on n-h1-831193-17 Oct 04 18:01:18.214148 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ded36f5c-b5c4-43fd-8547-9545655b616b req-d13e647c-c0c9-4167-9d5f-5be285eccf40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070461 Oct 04 18:01:18.215311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1806/2601] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:18.222681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4eeade7-7f78-4ef5-a9b8-ae0309cc1174 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340d631f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.227804 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:01:23.229241 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:01:27.048558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4eeade7-7f78-4ef5-a9b8-ae0309cc1174 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 200 len: 1432 microversion: 2.1 time: 8.831839 Oct 04 18:01:27.059306 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1807/2602] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:18 2022] GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 1432 bytes in 8833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:27.059306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fff9fdcc-c72b-4140-9983-7c3f68055962 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '.version_select at 0x7f6340d639d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.248521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fff9fdcc-c72b-4140-9983-7c3f68055962 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/39debd55-a9e4-4f60-867e-56db17849670" status: 200 len: 184 microversion: 2.1 time: 0.198006 Oct 04 18:01:27.249680 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1808/2603] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/os-floating-ips/39debd55-a9e4-4f60-867e-56db17849670 => generated 184 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:27.254440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.255097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.257117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:27.266655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.268100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.268353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.270023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.270855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.271680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.317130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.318042 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-540d6584-b4c5-41a7-9ada-27e4726a3da5 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/os-instance-actions/req-687370d5-e74b-4fd4-a033-5d3ad02eba7a" status: 200 len: 313 microversion: 2.1 time: 0.067434 Oct 04 18:01:27.318915 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1809/2604] 10.222.0.33 () {58 vars in 1419 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/os-instance-actions/req-687370d5-e74b-4fd4-a033-5d3ad02eba7a => generated 313 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:27.323285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340d4ed30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.369348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d0f01cb0-2813-43b1-8058-767f5aa7819d could not be found", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:01:27.370157 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] HTTP exception thrown: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Request method failure captured: Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d HTTP/1.1 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTNXSARYBoPIYqUUX2Ftvpgaoo5FcZZ53orYqQYedbkq154eoNWG-vNzbjlVEDEHJc5GEQ_WQKivsdPHHYz178rxecHTfcCUsPiF6FWy3ZMJT7LaOolbsapUipzUzQ03aCSI2fK6w73APvqX4Bc-mOowJweT_WrAOJyDcuSbQjbuKE Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0abc875015d4498bb44c365770a10607 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abc875015d4498bb44c365770a10607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abc875015d4498bb44c365770a10607"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abc875015d4498bb44c365770a10607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abc875015d4498bb44c365770a10607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0abc875015d4498bb44c365770a10607 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsTestJSON-1504131105-project Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 540ea41950ee4d16b5983f14d86e5fe5 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsTestJSON-1504131105-project Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'd0f01cb0-2813-43b1-8058-767f5aa7819d'} Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d0f01cb0-2813-43b1-8058-767f5aa7819d could not be found Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f240c390-e6d3-494a-83d4-e7735707d52e'] Oct 04 18:01:27.372223 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d. Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Returning 404 to user: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a33f4ad2-7a01-434b-9b4a-c4b6a6ed681c tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d" status: 404 len: 111 microversion: 2.1 time: 0.055223 Oct 04 18:01:27.380360 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1810/2605] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:27.387777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:27.399007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.399698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.400179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.411153 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] Creating event network-changed:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:01:27.415898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b27d40f6-7cff-4dba-b269-97d036785653 req-aea9630f-1d11-46e8-b6df-6b0fb96c2035 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036590 Oct 04 18:01:27.416498 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1811/2606] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:27.421604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6a2be87-2d22-4afd-8369-54a322af0b2a tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Calling method '.version_select at 0x7f6340d63a60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.474615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6a2be87-2d22-4afd-8369-54a322af0b2a tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822" status: 200 len: 353 microversion: 2.1 time: 0.056690 Oct 04 18:01:27.475384 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1812/2607] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:27.482324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.483561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.490347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.490842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.491315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.492022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.492480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.492909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.699265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.718985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87138c87-894f-4205-a2d7-b847bf754f6c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1501 microversion: 2.1 time: 0.241262 Oct 04 18:01:27.721144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1813/2608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:27.734265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-plugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}, {"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-plugged", "status": "completed", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:27.755974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.756996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.757579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.776845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Creating event network-vif-plugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:01:27.777449 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] Creating event network-vif-plugged:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:01:27.784656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-03019153-2d60-47c7-9067-ea51a2ce95e2 req-e3c85c31-4fde-43fe-8e18-5f77744d1879 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061032 Oct 04 18:01:27.785301 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1814/2609] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:27.790726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73416d18-bf40-4fd2-8737-7d3d2f70f7c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340d560d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.843233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73416d18-bf40-4fd2-8737-7d3d2f70f7c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 200 len: 1432 microversion: 2.1 time: 0.056714 Oct 04 18:01:27.843816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1815/2610] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 1432 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:27.848913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.100"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:27.996233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:28.003934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.004431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.004878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.005584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.006041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.006461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.227816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:01:28.228663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquired lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:01:28.856537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:01:29.375885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Updating instance_info_cache with network_info: [{"id": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8", "address": "fa:16:3e:ac:70:bd", "network": {"id": "2977e2cf-edcf-4e74-8108-2e16e8c22bd8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1745404353-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d67466a0221b4f6cad9978a8f1b51432", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a2f9079-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:01:29.394819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Releasing lock "refresh_cache-658b9396-d38e-410f-9514-fae1743c30ee" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:29.396528 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45a48df1-6951-46bd-ae1c-9e6c9ac9f838 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action" status: 202 len: 0 microversion: 2.1 time: 1.551389 Oct 04 18:01:29.402842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1816/2611] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:27 2022] POST /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee/action => generated 0 bytes in 1558 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:01:29.410377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:29.413052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.420048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.420878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.421638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.422860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.423701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.424448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.505436 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3bd6544b-d7cc-4da0-a4e9-cff33896e930 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "POST /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/action" status: 202 len: 0 microversion: 2.1 time: 0.100595 Oct 04 18:01:29.506084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1817/2612] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:29 2022] POST /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:29.512165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Calling method '.version_select at 0x7f6340ca7790>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.558734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d0f01cb0-2813-43b1-8058-767f5aa7819d could not be found", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:01:29.559983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] HTTP exception thrown: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Request method failure captured: Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d HTTP/1.1 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTNXSARYBoPIYqUUX2Ftvpgaoo5FcZZ53orYqQYedbkq154eoNWG-vNzbjlVEDEHJc5GEQ_WQKivsdPHHYz178rxecHTfcCUsPiF6FWy3ZMJT7LaOolbsapUipzUzQ03aCSI2fK6w73APvqX4Bc-mOowJweT_WrAOJyDcuSbQjbuKE Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0abc875015d4498bb44c365770a10607 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abc875015d4498bb44c365770a10607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abc875015d4498bb44c365770a10607"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abc875015d4498bb44c365770a10607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abc875015d4498bb44c365770a10607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0abc875015d4498bb44c365770a10607 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1504131105 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsTestJSON-1504131105-project Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 540ea41950ee4d16b5983f14d86e5fe5 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsTestJSON-1504131105-project Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'd0f01cb0-2813-43b1-8058-767f5aa7819d'} Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d0f01cb0-2813-43b1-8058-767f5aa7819d could not be found Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d892da-1d5b-4adc-a1d4-8fd11bf85016'] Oct 04 18:01:29.564920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d. Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:29.569559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] Returning 404 to user: Floating IP not found for ID d0f01cb0-2813-43b1-8058-767f5aa7819d {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:29.572135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0f90f22-3c4a-4757-82d5-a18bc046d7ff tempest-FloatingIPsTestJSON-1504131105 tempest-FloatingIPsTestJSON-1504131105-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d" status: 404 len: 111 microversion: 2.1 time: 0.061456 Oct 04 18:01:29.575448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1818/2613] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:29 2022] DELETE /compute/v2.1/os-floating-ips/d0f01cb0-2813-43b1-8058-767f5aa7819d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:29.580950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e05b4eab-dead-49d7-a4d9-8e7e49811429 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Calling method '.version_select at 0x7f6340d61ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.673596 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e05b4eab-dead-49d7-a4d9-8e7e49811429 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822" status: 200 len: 353 microversion: 2.1 time: 0.096986 Oct 04 18:01:29.674244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1819/2614] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:29.682065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:29.682749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.697388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.698229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.698890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.699956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.700613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.701235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.706469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:29.729635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'flavor' on Instance uuid e91137be-05ef-4c61-8ef7-1a2cab796623 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:29.843299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46a34aa8-9dbd-4e02-b3e9-e4e63c82a44e tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "POST /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623/action" status: 202 len: 0 microversion: 2.1 time: 0.167544 Oct 04 18:01:29.846912 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1820/2615] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:29 2022] POST /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:29.853626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.854274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.888967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.891009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.892525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.895251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.896608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.897490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.173060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.190210 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0c62e10-c9c5-4dc1-8969-fa911f776307 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1467 microversion: 2.1 time: 0.344185 Oct 04 18:01:30.191577 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1821/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1467 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.201571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.203384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.231607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.234346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.235327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.237722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.238988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.239748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.436727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.447388 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51e12507-3165-40b4-9e09-4ce52f7d148c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.254522 Oct 04 18:01:30.447978 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1822/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.452709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.453418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.459439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.460151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.460775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.461650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.462270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.462861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.478517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] HTTP exception thrown: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Request method failure captured: Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 HTTP/1.1 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSc96lHJSrMmqtcoOWNa-7xZdmtM3if_X93mpyiDo0arluBemcc4Nnr2BQxFq4NKn54vZDI_aX9IumdRJxCjfhBNz1TPv98DyCNpZx1SEi1OliM_lb-FK_XMdA_OkpbSPuip2MzQyP9Jq0a-qvYxBOh8Y26SGp24gh-Nxxi33v1uiQ Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ef9b5baaf1b64847944bf2b3c855275c Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913'} Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:30.480409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:30.485219 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:30.487135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Returning 404 to user: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:30.488015 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-290c2242-f411-4a55-976f-d8ad40caf44e tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 404 len: 111 microversion: 2.1 time: 0.038939 Oct 04 18:01:30.488847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1823/2618] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:30 2022] DELETE /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:30.493746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:30.503672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.504261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.504770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.519173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] Creating event network-changed:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:01:30.525028 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-753be609-1103-46eb-9e14-74fb7a500353 req-4761932b-ddbb-4f79-b35f-982f96f312d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034695 Oct 04 18:01:30.525893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1824/2619] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:30.531963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.532690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.540129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.540640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.541075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.541794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.542252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.542684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.682817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.692318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2bdc2d4-e351-4bff-b5fe-46bc8e77b6fc tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1512 microversion: 2.1 time: 0.165010 Oct 04 18:01:30.692960 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1825/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.697757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f5a8dab-d190-461d-ba8f-574888e307c1 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Calling method '.version_select at 0x7f6340d9b4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.769913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f5a8dab-d190-461d-ba8f-574888e307c1 tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822" status: 202 len: 0 microversion: 2.1 time: 0.075789 Oct 04 18:01:30.770998 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1826/2621] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:01:30 2022] DELETE /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:30.779173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.779798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.787670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.788383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.789019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.789962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.790677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.791547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.999892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:31.010324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-450c62d7-045d-4c58-a162-92d01a093f46 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1492 microversion: 2.1 time: 0.234958 Oct 04 18:01:31.011595 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1827/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1492 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:31.017557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1b7976a-7a89-4146-9786-603a1903901a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340e6e310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.070290 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1b7976a-7a89-4146-9786-603a1903901a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857" status: 200 len: 784 microversion: 2.1 time: 0.057198 Oct 04 18:01:31.080404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1828/2623] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/images/fde43323-6d3d-41e0-8fc0-c7db4539b857 => generated 784 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:31.090920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1727525303"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:31.094406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.105665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.106164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.106629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.107402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.107822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.108277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.410271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a542bb7-0bd7-4fe7-8d8a-9241de8cc354 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.333217 Oct 04 18:01:31.423736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1829/2624] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:31 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:01:31.452072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.453753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.477382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.478350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.479020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.479969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.480620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.481814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.525108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] HTTP exception thrown: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Request method failure captured: Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 HTTP/1.1 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSc96lHJSrMmqtcoOWNa-7xZdmtM3if_X93mpyiDo0arluBemcc4Nnr2BQxFq4NKn54vZDI_aX9IumdRJxCjfhBNz1TPv98DyCNpZx1SEi1OliM_lb-FK_XMdA_OkpbSPuip2MzQyP9Jq0a-qvYxBOh8Y26SGp24gh-Nxxi33v1uiQ Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ef9b5baaf1b64847944bf2b3c855275c Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913'} Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:31.527169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. Oct 04 18:01:31.531017 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:31.533089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Returning 404 to user: Instance a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:31.534211 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea026850-a568-4f14-8d75-d7cdedbb4e3a tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913" status: 404 len: 111 microversion: 2.1 time: 0.108763 Oct 04 18:01:31.535006 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1830/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/servers/a4bb3236-f5fa-4ccf-b9e6-bf6e27a2a913 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:31.540555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e88f97d-5ad5-4e80-9b75-2f7fd368836f tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Calling method '.version_select at 0x7f6340c7e4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.621654 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e88f97d-5ad5-4e80-9b75-2f7fd368836f tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822" status: 200 len: 352 microversion: 2.1 time: 0.085083 Oct 04 18:01:31.622366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1831/2626] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:31.629363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.630275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.638081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.638569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.639008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.639876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.640331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.640756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.668762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:31.761334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b663b7f7-15e5-4649-b09e-48d9fa0c9e52 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 204 len: 0 microversion: 2.1 time: 0.137307 Oct 04 18:01:31.762952 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1832/2627] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:31 2022] DELETE /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:31.769083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10aba92c-a0c2-41b5-9e67-f1b69d8be243 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.777622 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10aba92c-a0c2-41b5-9e67-f1b69d8be243 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012975 Oct 04 18:01:31.778249 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1833/2628] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:31.783739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-unplugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:31.799464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.801403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.801403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.813328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] Creating event network-vif-unplugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:01:31.821525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0e0352ae-3cda-40c2-895d-7507cc62f650 req-13f4d96e-2df5-42b4-9e70-ece4b1681c70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041887 Oct 04 18:01:31.828540 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1834/2629] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:31.834988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f5a05e5-81f0-40f3-aeec-96c978358663 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '.version_select at 0x7f6340c7e430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:32.833481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f5a05e5-81f0-40f3-aeec-96c978358663 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/39debd55-a9e4-4f60-867e-56db17849670" status: 202 len: 0 microversion: 2.1 time: 1.003111 Oct 04 18:01:32.836059 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1835/2630] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:31 2022] DELETE /compute/v2.1/os-floating-ips/39debd55-a9e4-4f60-867e-56db17849670 => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:32.842748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:32.843915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:32.855536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.856555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.857161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.858105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.858738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.859540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.050888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:33.066344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48f06bfa-fb42-42a7-8c31-3849b4681d9d tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1505 microversion: 2.1 time: 0.228956 Oct 04 18:01:33.083927 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1836/2631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:32 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.092040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.094634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.102967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.103541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.104192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.105078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.105541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.105971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.294315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:33.306712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01515767-b940-4f2f-8971-a07cd57f4501 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1498 microversion: 2.1 time: 0.221177 Oct 04 18:01:33.319160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1837/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:33 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.319160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-568af648-5505-4863-8151-0bdb40cf157d tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340d61700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.196636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-568af648-5505-4863-8151-0bdb40cf157d tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "DELETE /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 204 len: 0 microversion: 2.1 time: 0.887855 Oct 04 18:01:34.197741 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1838/2633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:33 2022] DELETE /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:34.223391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-861bab51-5a8e-467d-82e2-74c93fb4dace tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Calling method '.version_select at 0x7f6340c7eb80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.298869 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-861bab51-5a8e-467d-82e2-74c93fb4dace tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] HTTP exception thrown: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-861bab51-5a8e-467d-82e2-74c93fb4dace tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Request method failure captured: Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 HTTP/1.1 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHToJUpeAGk2tGGjiJIYSbNU0hIV_L6lQ22mzqtQ6ERz6zO8my0BNgfOFljxRVsa0K-3A4YSaKpBKSEtgJo1szzGb8GZgcVKxecz-h1qBnd09FzgIVr2yprWYF2BGrsFaXjefjfsrG8VI-nK9wSQarJHgPtkJEkbN8xOSHa2CKXwa10 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 8751f49b7e234fd1a0981fae67fb6390 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesGetTestJSON-1299930304 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8751f49b7e234fd1a0981fae67fb6390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8751f49b7e234fd1a0981fae67fb6390"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8751f49b7e234fd1a0981fae67fb6390"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8751f49b7e234fd1a0981fae67fb6390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesGetTestJSON-1299930304 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 8751f49b7e234fd1a0981fae67fb6390 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesGetTestJSON-1299930304 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesGetTestJSON-1299930304-project Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 59b5ccb2b2814bc48816ccfae0c6dc64 Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesGetTestJSON-1299930304-project Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: exception: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '86c8ebef-f185-4ae5-bb2e-f97697be6822'} Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. (HTTP 404) (Request-ID: req-18974566-2b98-444d-beda-d1419b71095b) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:01:34.306938 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-861bab51-5a8e-467d-82e2-74c93fb4dace tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] Returning 404 to user: Volume 86c8ebef-f185-4ae5-bb2e-f97697be6822 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:34.317589 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-861bab51-5a8e-467d-82e2-74c93fb4dace tempest-VolumesGetTestJSON-1299930304 tempest-VolumesGetTestJSON-1299930304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822" status: 404 len: 109 microversion: 2.1 time: 0.115816 Oct 04 18:01:34.334397 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1839/2634] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/os-volumes/86c8ebef-f185-4ae5-bb2e-f97697be6822 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:34.351578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.352112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.370724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.373379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.373891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.374639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.375132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.375566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.430723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:34.511420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:34.585539 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d788ad2-0ed7-4242-a360-ee58983320e3 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "DELETE /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 204 len: 0 microversion: 2.1 time: 0.248561 Oct 04 18:01:34.587348 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1840/2635] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:34 2022] DELETE /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:34.598891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '.version_select at 0x7f6340c7d160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.600028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.612166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.612841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.615389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.616701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.617374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.618937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.687208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a820fbdb-3f9f-4dd0-8338-aecc64a1c6ad tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.096736 Oct 04 18:01:34.687950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1841/2636] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770/os-instance-actions => generated 611 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:34.696890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-unplugged", "status": "completed", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:34.714387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.715554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.716211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.733407 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] Creating event network-vif-unplugged:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:01:34.740351 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-05842703-331c-4f6e-ad08-37af1710f668 req-a11dae1f-9ea8-47aa-9143-dedadce91a3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050061 Oct 04 18:01:34.741882 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1842/2637] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:34.753977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bae7947-4aef-47e8-ba77-97674c03f796 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c4bca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.802134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0bae7947-4aef-47e8-ba77-97674c03f796 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] HTTP exception thrown: Image not found. Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bae7947-4aef-47e8-ba77-97674c03f796 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Request method failure captured: Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 HTTP/1.1 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTICRRXejToIgPgScEz_u4zc9wG5TuxJLO4cWsF3GB17dFOgaJyXsM_gUoGqM5HV_kI_gD0ru-ktijs5sd8PZhoquSdsKwGtpXuOMUbE_w-U1FsBWId7GjZqJdKxeeRhIVbd9txrq3s4LXRRy2syFvbDke5StxIVLC2R5-mVFazCgs Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a614044e07e442a2adc158f8f3420b01 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '906cdaae-57a2-4850-a5d7-5410558c5ff7'} Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 906cdaae-57a2-4850-a5d7-5410558c5ff7 Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:01:34.807114 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 906cdaae-57a2-4850-a5d7-5410558c5ff7 could not be found. Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0bae7947-4aef-47e8-ba77-97674c03f796 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:34.813917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0bae7947-4aef-47e8-ba77-97674c03f796 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 404 len: 62 microversion: 2.1 time: 0.065446 Oct 04 18:01:34.825867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1843/2638] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:34.845215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.849429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.870761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.874310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.879078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.882332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.885389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.886144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.943063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.943893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.944642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.945122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lazy-loading 'fault' on Instance uuid e91137be-05ef-4c61-8ef7-1a2cab796623 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:35.029917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b91ae4f4d34bc8b4cdef0e24767c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f38490a49f84a79b9540fedccb26d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.044570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd569386-9383-4420-aeab-e9c3c4baa379 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 200 len: 1304 microversion: 2.1 time: 0.210030 Oct 04 18:01:35.045499 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1844/2639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 1304 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.050337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91137be-05ef-4c61-8ef7-1a2cab796623", "name": "network-vif-deleted", "tag": "d085f00b-1013-48f9-b517-9f2c17939d94"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:35.062860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.063575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.064387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.077676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] Creating event network-vif-deleted:d085f00b-1013-48f9-b517-9f2c17939d94 for instance e91137be-05ef-4c61-8ef7-1a2cab796623 on n-h1-831193-17 Oct 04 18:01:35.083516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-38e61f9a-2910-4045-9804-36c4e0afd7a0 req-4f5805cb-807b-44fd-89b6-526d18890d6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036345 Oct 04 18:01:35.084449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1845/2640] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:35.090008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.090726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.097640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.098145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.098781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.099968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.101075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.101520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.368507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.378706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a671744b-1edd-4b82-bea0-831ed38f7470 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1525 microversion: 2.1 time: 0.292914 Oct 04 18:01:35.395008 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1846/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.395008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.395008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.396726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.397242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.400820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.401574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.402241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.402685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.461835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:35.640188 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ce6eee4-b581-4da6-8038-84b1c88ae1a9 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 204 len: 0 microversion: 2.1 time: 0.249404 Oct 04 18:01:35.643383 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1847/2642] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:35 2022] DELETE /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:35.661235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-139898991"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:35.669426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.679990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.680764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.681371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.682661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.683077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.683620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.947957 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3afb98d8-e585-4c3b-8991-e2353aa43336 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "POST /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb/action" status: 202 len: 0 microversion: 2.1 time: 0.298032 Oct 04 18:01:35.948638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1848/2643] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:35 2022] POST /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:01:35.955125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.955826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.962256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.962904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.963399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.964240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.964815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.965305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.188353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.206721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ebf029d9-9b07-4741-b095-b1a412912aba tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1511 microversion: 2.1 time: 0.256330 Oct 04 18:01:36.208280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1849/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:36.232744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c71c7b0-cb5f-4965-8b10-e57b8213eed3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c7d550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.355547 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c71c7b0-cb5f-4965-8b10-e57b8213eed3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 0.145040 Oct 04 18:01:36.359296 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1850/2645] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:36.377641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.378547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.391688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.392580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.393600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.395057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.395790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.396892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.424282 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 HTTP/1.1 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e91137be-05ef-4c61-8ef7-1a2cab796623'} Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.427621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c7a7f710-9bcd-47d0-b032-5b47a61338ff tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 404 len: 111 microversion: 2.1 time: 0.068674 Oct 04 18:01:36.437497 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1851/2646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.445137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.446366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.459568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.459852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.460578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.461934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.462677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.463495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.646931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9b5baaf1b64847944bf2b3c855275c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67466a0221b4f6cad9978a8f1b51432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.656073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c5d0c2e-23e8-4e8d-a00e-6373e2775041 tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 200 len: 1525 microversion: 2.1 time: 0.222648 Oct 04 18:01:36.659221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1852/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 1525 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:36.669208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.671168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.683650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.691223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.692594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.694519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.696319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.697738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.735767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 HTTP/1.1 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e91137be-05ef-4c61-8ef7-1a2cab796623'} Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.740500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.744481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b613bc4a-aefd-4a88-b778-5421a6739bac tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 404 len: 111 microversion: 2.1 time: 0.081158 Oct 04 18:01:36.751264 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1853/2648] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:36 2022] DELETE /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.763168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.763987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: e91137be-05ef-4c61-8ef7-1a2cab796623] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.770866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.771664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.771845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.772543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.773009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.773442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.791228 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 HTTP/1.1 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e91137be-05ef-4c61-8ef7-1a2cab796623'} Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.792853 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance e91137be-05ef-4c61-8ef7-1a2cab796623 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-821f1356-163b-4fa5-942d-7d1328486b1b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623" status: 404 len: 111 microversion: 2.1 time: 0.038723 Oct 04 18:01:36.798587 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1854/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/e91137be-05ef-4c61-8ef7-1a2cab796623 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.803025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.803571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.813531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.814036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.814479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.815998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.816485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.816927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.839318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 HTTP/1.1 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '32f340ec-eeba-4114-b93c-300fbcbf6431'} Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.841794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.848202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1092d0a-7c4a-4f1b-a920-92711d1c16ec tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 404 len: 111 microversion: 2.1 time: 0.044760 Oct 04 18:01:36.850821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1855/2650] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:36 2022] DELETE /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.853617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.854258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 32f340ec-eeba-4114-b93c-300fbcbf6431] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.860719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.861270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.861804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.862530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.863024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.863489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.878612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 HTTP/1.1 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '32f340ec-eeba-4114-b93c-300fbcbf6431'} Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.880359 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 32f340ec-eeba-4114-b93c-300fbcbf6431 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a18492c8-4525-48ff-93ee-1b1c66dc7e5b tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431" status: 404 len: 111 microversion: 2.1 time: 0.031861 Oct 04 18:01:36.886031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1856/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/32f340ec-eeba-4114-b93c-300fbcbf6431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.894575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.895089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.901353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.903306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.903760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.904475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.905497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.905926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.922202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed HTTP/1.1 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ad57d438-4577-4e0b-8c7b-e64363fa45ed'} Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.924033 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.928442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14fa41c8-5d72-4f14-8fe6-8cd45aeb61d9 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 404 len: 111 microversion: 2.1 time: 0.036163 Oct 04 18:01:36.930300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1857/2652] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:36 2022] DELETE /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.936342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.936964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: ad57d438-4577-4e0b-8c7b-e64363fa45ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.943296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.943945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.944391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.945097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.945555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.947472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.971617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed HTTP/1.1 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ad57d438-4577-4e0b-8c7b-e64363fa45ed'} Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.973565 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance ad57d438-4577-4e0b-8c7b-e64363fa45ed could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.977738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c14fc553-7a2a-40c8-8d5b-6fa8fe1ae758 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed" status: 404 len: 111 microversion: 2.1 time: 0.043513 Oct 04 18:01:36.979652 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1858/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/ad57d438-4577-4e0b-8c7b-e64363fa45ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:36.985059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.985568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.994143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.994702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.995778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.996725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.997396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.999058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.028373 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd HTTP/1.1 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd'} Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:37.030823 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.034702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:37.037605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5ac957a-da1a-4a60-a6fe-0e4ef55d19d4 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 404 len: 111 microversion: 2.1 time: 0.054861 Oct 04 18:01:37.040376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1859/2654] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:36 2022] DELETE /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:37.045472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.046403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.059287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.059790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.060235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.062390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.062887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.063366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.085749 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd HTTP/1.1 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd'} Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.090406 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:37.095199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d47bc70e-f358-4c75-a880-d0bc2c5e8cc6 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd" status: 404 len: 111 microversion: 2.1 time: 0.052720 Oct 04 18:01:37.099434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1860/2655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/9d9f81fb-d5c8-4646-9dcf-5e99ab6b88cd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:37.122097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658b9396-d38e-410f-9514-fae1743c30ee", "name": "network-vif-deleted", "tag": "3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:37.140717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.146305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.147093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.181143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] Creating event network-vif-deleted:3a2f9079-8b7c-4a3c-a6a1-124cc6d237f8 for instance 658b9396-d38e-410f-9514-fae1743c30ee on n-h1-831193-17 Oct 04 18:01:37.198592 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8094aa31-801d-44cd-9991-e385721dd69f req-4cbe2c0e-19fa-4355-aac1-0b112909161e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097175 Oct 04 18:01:37.205168 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1861/2656] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:37.215204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.217777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.234301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:37.239495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.240310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.240310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.241271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.241531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.241960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.277570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 HTTP/1.1 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b12ec711-6fda-4a8c-842b-a316314701b0'} Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:37.286344 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:37.290969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6c7244a-3ade-405d-b042-a80396481920 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 404 len: 111 microversion: 2.1 time: 0.081492 Oct 04 18:01:37.293337 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1862/2657] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:37 2022] DELETE /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:37.307638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.308504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.322331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.322836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.327006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.327800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.328286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.328745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.713176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.722454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a648c13-a666-4637-9161-e569fba75892 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1511 microversion: 2.1 time: 0.427860 Oct 04 18:01:37.727118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1863/2658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.728217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.728826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: b12ec711-6fda-4a8c-842b-a316314701b0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.735331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.735852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.736258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.736960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.737419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.737855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.742108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:37.755185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 HTTP/1.1 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b12ec711-6fda-4a8c-842b-a316314701b0'} Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.757054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance b12ec711-6fda-4a8c-842b-a316314701b0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb8e5d30-68d6-4a5b-a60d-d237330073aa tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0" status: 404 len: 111 microversion: 2.1 time: 0.034047 Oct 04 18:01:37.762508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1864/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/b12ec711-6fda-4a8c-842b-a316314701b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:37.775845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-plugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:37.794401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.794896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.801312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.814966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] Creating event network-vif-plugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:01:37.828474 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b4a04d66-2ac7-490e-b8ea-442eb7230dc1 req-954a81ff-f5c9-4a3d-8655-ec8f83208c63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064327 Oct 04 18:01:37.832928 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1865/2660] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:37.840372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-148e6577-0480-4477-8a97-3afc553077d2 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c4b8b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.929506 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-148e6577-0480-4477-8a97-3afc553077d2 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 0.094337 Oct 04 18:01:37.931157 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1866/2661] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.938864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.943473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] [instance: 658b9396-d38e-410f-9514-fae1743c30ee] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.951803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.953007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.953705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.954673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.955871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.956701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.985238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] HTTP exception thrown: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Request method failure captured: Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee HTTP/1.1 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHSc96lHJSrMmqtcoOWNa-7xZdmtM3if_X93mpyiDo0arluBemcc4Nnr2BQxFq4NKn54vZDI_aX9IumdRJxCjfhBNz1TPv98DyCNpZx1SEi1OliM_lb-FK_XMdA_OkpbSPuip2MzQyP9Jq0a-qvYxBOh8Y26SGp24gh-Nxxi33v1uiQ Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d67466a0221b4f6cad9978a8f1b51432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d67466a0221b4f6cad9978a8f1b51432 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2118990362 Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ef9b5baaf1b64847944bf2b3c855275c Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2118990362-project Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '658b9396-d38e-410f-9514-fae1743c30ee'} Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.990036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:37.995081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] Returning 404 to user: Instance 658b9396-d38e-410f-9514-fae1743c30ee could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:37.995898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4e9cccc-dd03-4a05-a21b-4f0ae5e8236d tempest-FloatingIPsAssociationTestJSON-2118990362 tempest-FloatingIPsAssociationTestJSON-2118990362-project] 10.222.0.33 "GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee" status: 404 len: 111 microversion: 2.1 time: 0.062536 Oct 04 18:01:37.996879 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1867/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/658b9396-d38e-410f-9514-fae1743c30ee => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:38.170298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8d0fbc-907f-4999-b2ee-108a753f5770", "name": "network-vif-deleted", "tag": "7fa9b66d-fc01-4c09-9a89-338cd6958334"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:38.229311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.229832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.230284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.266198 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] Creating event network-vif-deleted:7fa9b66d-fc01-4c09-9a89-338cd6958334 for instance ed8d0fbc-907f-4999-b2ee-108a753f5770 on n-h2-831193-17 Oct 04 18:01:38.283272 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d37ca58b-8252-4173-9c73-b57fdd9d82a2 req-75db3147-a4c6-42b3-9c41-4d836062e87d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120195 Oct 04 18:01:38.298328 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1868/2663] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:38.746877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.747789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:38.772454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.775622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.779071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.782883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.785886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.791487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.907571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.908064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.914766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.916668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lazy-loading 'fault' on Instance uuid ed8d0fbc-907f-4999-b2ee-108a753f5770 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:38.997794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab51dc213a114803bb421d0422e37fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857093eaeee448a95f9adedd7f52689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.012560 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5e27f28-1f8f-4c06-bb9d-a1e5d92067f1 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 200 len: 1305 microversion: 2.1 time: 0.270231 Oct 04 18:01:39.027419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1869/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:38 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:39.027419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aece1df7-c292-4fd9-a086-f34e515a9543 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c02ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.163681 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aece1df7-c292-4fd9-a086-f34e515a9543 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 0.142514 Oct 04 18:01:39.164634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1870/2665] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:40.045037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.047220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] [instance: ed8d0fbc-907f-4999-b2ee-108a753f5770] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.064143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.064647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.065090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.084948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.085630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.088155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.133606 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] HTTP exception thrown: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Request method failure captured: Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 HTTP/1.1 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTLAe99t9zkBRVTsjxPI3Fiksr7wKdpg-osA6R0ddcU5SjO7nO2c0KnDRKSriAl0dKm1nSoRRTVzLt2KCwyYzMrESl7yVet0bBqctdu9FyaAjMZV6RMVbYS89PrdD4_kT3NgalUh3_T9JygdgFGKfA1yRdxZ9AeJKeYSSC4znpMd7I Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5857093eaeee448a95f9adedd7f52689 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsTestJSON-1102320526 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5857093eaeee448a95f9adedd7f52689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5857093eaeee448a95f9adedd7f52689"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5857093eaeee448a95f9adedd7f52689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5857093eaeee448a95f9adedd7f52689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsTestJSON-1102320526 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5857093eaeee448a95f9adedd7f52689 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1102320526 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsTestJSON-1102320526-project Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: ab51dc213a114803bb421d0422e37fc2 Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsTestJSON-1102320526-project Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ed8d0fbc-907f-4999-b2ee-108a753f5770'} Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:40.148947 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. Oct 04 18:01:40.153519 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.161618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] Returning 404 to user: Instance ed8d0fbc-907f-4999-b2ee-108a753f5770 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:40.162868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4d8c57f-0ee4-4f67-9592-6d421e08d822 tempest-InstanceActionsTestJSON-1102320526 tempest-InstanceActionsTestJSON-1102320526-project] 10.222.0.33 "GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770" status: 404 len: 111 microversion: 2.1 time: 0.123314 Oct 04 18:01:40.165442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1871/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/ed8d0fbc-907f-4999-b2ee-108a753f5770 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:40.182290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bdebaae-9a84-47c3-b928-d7d609e00182 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340d63280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.256453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bdebaae-9a84-47c3-b928-d7d609e00182 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 0.078148 Oct 04 18:01:40.257854 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1872/2667] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:40.357395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.358622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.372754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.376445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.380103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.381597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.382337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.383132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.590940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lazy-loading 'services' on Instance uuid 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:40.739523 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4eed3c5-dd93-4e47-a38d-870d59d648ed tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments/71a3919b-7b92-4686-acf9-a745f18ec440" status: 202 len: 0 microversion: 2.1 time: 0.386207 Oct 04 18:01:40.741605 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1873/2668] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:01:40 2022] DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments/71a3919b-7b92-4686-acf9-a745f18ec440 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:01:41.274393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43ff031c-fc5d-41a5-b4d9-b19a3d1ae3c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c4ba60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.701771 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43ff031c-fc5d-41a5-b4d9-b19a3d1ae3c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 0.430845 Oct 04 18:01:41.703986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1874/2669] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:42.717841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e770375f-3481-49a4-ae97-90c111406adb tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340bf9af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.373173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:50.720890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:05.270732 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:02:05.271401 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:02:07.093473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e770375f-3481-49a4-ae97-90c111406adb tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1428 microversion: 2.1 time: 24.379655 Oct 04 18:02:07.095786 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1875/2670] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1428 bytes in 24382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:07.105243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.105872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:07.140834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.141682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.163672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.164679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.165174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.165622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.215322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d HTTP/1.1 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '03cbd653-fc5d-4603-9453-436e2600734d'} Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:07.217103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:07.222094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ce67c60-6329-4b82-9253-a4bf1e2adc3f tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 404 len: 111 microversion: 2.1 time: 0.118572 Oct 04 18:02:07.235537 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1876/2671] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:07 2022] DELETE /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:07.242502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-plugged", "status": "completed", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:07.273168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.275200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.276020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.304833 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] Creating event network-vif-plugged:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:02:07.311932 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c75291fa-dd2e-4175-b4b0-9aaa6cc1957f req-a795899c-1d4b-4ebd-b4e0-bc458f5addf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077627 Oct 04 18:02:07.312920 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1877/2672] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:07.320781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:07.329733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.330419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.331059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.366666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:02:07.490929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-708dbad2-8541-40e3-b48a-cd5031d1ec5a tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action" status: 202 len: 0 microversion: 2.1 time: 0.160097 Oct 04 18:02:07.494273 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1878/2673] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:07 2022] POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:08.118400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5ee85be-2099-4510-9989-5f76133013c1 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Action: 'create', calling method: .version_select at 0x7f6340c1d4c0>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:12.972468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5ee85be-2099-4510-9989-5f76133013c1 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.475227 Oct 04 18:02:12.973811 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1879/2674] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:02:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:12.982893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.984362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.998208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.999398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.999974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.000900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.001601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.002756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.284905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.294715 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c92e071-ae3c-40fa-aa58-2ed7d0fe35b3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.318006 Oct 04 18:02:13.295673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1880/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.313568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.315980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 03cbd653-fc5d-4603-9453-436e2600734d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:13.328762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.329686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.334355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.336417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.337038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.337753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.369946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d HTTP/1.1 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '03cbd653-fc5d-4603-9453-436e2600734d'} Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:13.371879 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 03cbd653-fc5d-4603-9453-436e2600734d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd0dbeff-1faf-44b3-9ec9-e095cade4bd8 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d" status: 404 len: 111 microversion: 2.1 time: 0.076772 Oct 04 18:02:13.376851 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1881/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/servers/03cbd653-fc5d-4603-9453-436e2600734d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:13.386402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.386995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:13.396227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.403380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.403741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.405045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.405517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.405947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.615329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.646269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ce7c9a8-cf46-4820-922e-aa7e1e127c11 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1677 microversion: 2.1 time: 0.270556 Oct 04 18:02:13.647622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1882/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.661329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fff7d6ab-04b4-49f2-93c0-ba66eb255b86 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c18ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.739480 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fff7d6ab-04b4-49f2-93c0-ba66eb255b86 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1437 microversion: 2.1 time: 0.087580 Oct 04 18:02:13.740057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1883/2678] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:14.055643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] Calling method '.version_select at 0x7f6340c203a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.102689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 33a73114-0c96-4675-bce6-150cbb067681 could not be found", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:02:14.103428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] HTTP exception thrown: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] Request method failure captured: Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-floating-ips/33a73114-0c96-4675-bce6-150cbb067681 HTTP/1.1 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHUgeueFF5-NpdcjRRBOwOIsNbMGjdNNqxa-I1jTEchEZ8JIdpXevMXuFghQ1vsMDrl0YyxR-bgGNqGI4fiEZCzVk6s0jgfUssB1KjGCKre1yc9acr64gA4V2MPfmBA_p61g8S-SnmBQ-o_Swlepe_Eo215b2cHPp-mpCBCmE_Y5D3c Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1065fba907554e14a403aeaa62976632 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1132904880 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "tempest-type-820917140", "name": "tempest-service-286789713", "endpoints": [{"region": "tempest-region-1444483866", "publicURL": "https://url-430457111.com"}, {"region": "tempest-region-1500269258", "publicURL": "https://url-826612384.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1065fba907554e14a403aeaa62976632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1065fba907554e14a403aeaa62976632"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1065fba907554e14a403aeaa62976632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1065fba907554e14a403aeaa62976632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "tempest-type-1658208673", "name": "tempest-service-1520647265", "endpoints": [{"region": "tempest-region-46486795", "internalURL": "https://url-889803073.com"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1132904880 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1065fba907554e14a403aeaa62976632 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1132904880 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 787cddd52b234b8f89046f5d7f2991ec Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: exception: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681 Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '33a73114-0c96-4675-bce6-150cbb067681'} Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:02:14.105245 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 33a73114-0c96-4675-bce6-150cbb067681 could not be found Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8094441-37db-4d1e-be05-ece9688def22'] Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681. Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681 Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681 Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] Returning 404 to user: Floating IP not found for ID 33a73114-0c96-4675-bce6-150cbb067681 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee8e083f-db7c-454b-8adb-ae671b108f72 tempest-FloatingIPDetailsNegativeTestJSON-1132904880 tempest-FloatingIPDetailsNegativeTestJSON-1132904880-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/33a73114-0c96-4675-bce6-150cbb067681" status: 404 len: 111 microversion: 2.1 time: 0.365516 Oct 04 18:02:14.112392 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1884/2679] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/os-floating-ips/33a73114-0c96-4675-bce6-150cbb067681 => generated 111 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:14.116385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-unplugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:14.123727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.124065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.124499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.135335 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] Creating event network-vif-unplugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:02:14.140432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e8218a52-bebe-4f4a-9885-25546494a5cc req-4277e1f1-9f5e-472c-bd88-f16e705d0c23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031190 Oct 04 18:02:14.141030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1885/2680] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:14.145945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b03bdb30-2d13-4776-aa55-cb611e9f83d4 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Action: 'create', calling method: .version_select at 0x7f6340c200d0>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:16.019807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b03bdb30-2d13-4776-aa55-cb611e9f83d4 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.877572 Oct 04 18:02:16.021814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1886/2681] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:02:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:16.111695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-169443716", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "3f1ede1b-2f5b-40fc-b318-9da51907afab"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:16.170065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] validate_networks() for [('3f1ede1b-2f5b-40fc-b318-9da51907afab', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:16.883641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:16.884153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:16.884645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:16.885386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:16.885839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:16.907662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.908157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.909347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.910090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.913161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.913984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.980315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Getting quotas for project a0a24b0303084f4b90cff8fb9ef7137c. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:16.995372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Getting quotas for user 6eb3fef75b0949e4a23ab9efe7c9958c and project a0a24b0303084f4b90cff8fb9ef7137c. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:17.017319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:17.021087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:17.091912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d84b95b-b719-4214-8eee-ae89e63e882e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067922 Oct 04 18:02:17.092966 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1887/2682] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:17.098576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1587524888"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:17.102198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.111501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.112187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.126056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.127187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.127935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.128563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.512518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db04e0a3-3ddd-488b-a326-3eafe7f678a3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.417639 Oct 04 18:02:17.534675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1888/2683] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:17 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:02:17.549234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.549828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.557091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.557928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.558364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.559896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.561624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.562274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.580526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 HTTP/1.1 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f5e07c3-69d8-4902-b286-a66bb8da5d20'} Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:17.584600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:17.589301 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:17.591650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:17.593044 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f933ca82-b930-44df-9371-4b03f5891c9c tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 404 len: 111 microversion: 2.1 time: 0.054987 Oct 04 18:02:17.599317 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1889/2684] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:17 2022] DELETE /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:17.610749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-579c96d9-7221-4586-af15-e76c73634a4a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340c18550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.713906 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-579c96d9-7221-4586-af15-e76c73634a4a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 200 len: 1437 microversion: 2.1 time: 0.112435 Oct 04 18:02:17.718090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1890/2685] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:17.735586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.736453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.751361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.753090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.754434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.758669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.759556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.760613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.176248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.191311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af63f4c9-812b-4804-9bcd-07b30345c571 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1677 microversion: 2.1 time: 0.471971 Oct 04 18:02:18.195187 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1891/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1677 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:18.203092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f145629-3f07-4c85-a6d9-5cdfe643b9ed tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Action: 'create', calling method: .version_select at 0x7f6340c7d550>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:20.773920 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f145629-3f07-4c85-a6d9-5cdfe643b9ed tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.580522 Oct 04 18:02:20.775099 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1892/2687] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:02:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:20.791168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-unplugged", "status": "completed", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:20.812782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.813870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.814837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.831646 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] Creating event network-vif-unplugged:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:02:20.837616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2c27147f-4c8b-4c91-923e-a20a2bb33a1d req-2fc1e3b8-765e-4ab1-9b55-bbc2785e4aaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060747 Oct 04 18:02:20.838517 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1893/2688] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:20.846744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.847497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.854715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.855492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.856089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.857498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.858226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.858822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.092690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.103113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68e277ea-9015-4fcc-afc4-e866c0d3225d tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1324 microversion: 2.1 time: 0.263100 Oct 04 18:02:21.103820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1894/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:21.125839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.127280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.135260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.136327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.137021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.137999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.138706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.139392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.335296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.345129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99ab7517-e8dc-4e3b-9c0e-2b58c65b845f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.228328 Oct 04 18:02:21.346403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1895/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:21.351509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.352702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] [instance: 0f5e07c3-69d8-4902-b286-a66bb8da5d20] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.360152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.360912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.361519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.366592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.367496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.368102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.387738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] HTTP exception thrown: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Request method failure captured: Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 HTTP/1.1 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHOho6Xp0fA0bIA2XXvnzNT__Qm1OiLejV_xuHLWQFIeAkU29N7xpZ0lzsnbq_twGbIEirXAOq9Z053A9jwhKDXobl8uerfE7Q9ypjCtbHXiwYRF9vKdNVmxpQ1_F0uGmx5Jky7dW77xM9kUR-C6sHCgRucYp_WeqnE77qWSvtfPhPQ Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f38490a49f84a79b9540fedccb26d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1f38490a49f84a79b9540fedccb26d0d Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-668851068 Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 44b91ae4f4d34bc8b4cdef0e24767c0c Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-668851068-project Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f5e07c3-69d8-4902-b286-a66bb8da5d20'} Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:21.391640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. Oct 04 18:02:21.400813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.415581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] Returning 404 to user: Instance 0f5e07c3-69d8-4902-b286-a66bb8da5d20 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:21.417329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0967efd3-998d-4f2c-88d0-b5d60f014e51 tempest-DeleteServersTestJSON-668851068 tempest-DeleteServersTestJSON-668851068-project] 10.222.0.33 "GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20" status: 404 len: 111 microversion: 2.1 time: 0.069711 Oct 04 18:02:21.418756 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1896/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/0f5e07c3-69d8-4902-b286-a66bb8da5d20 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:21.433640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.446610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.462422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.463057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.463609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.465412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.466432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.468653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.879177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.895270 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f548698-2365-40f9-9baa-38c24ece1c0a tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1467 microversion: 2.1 time: 0.474431 Oct 04 18:02:21.900345 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1897/2692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1467 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:21.909639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.917074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.933921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.935532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.938412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.939436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.941541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.942209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.302884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:22.315619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12d44409-72a4-489e-a83d-81982991d0dc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1654 microversion: 2.1 time: 0.413638 Oct 04 18:02:22.316279 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1898/2693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1654 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:22.324832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6c2cb17-5bef-4ee7-a955-8703ab2fc845 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Action: 'create', calling method: .version_select at 0x7f6340c1ff70>, body: {"pool": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:26.720719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6c2cb17-5bef-4ee7-a955-8703ab2fc845 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.402707 Oct 04 18:02:26.729254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1899/2694] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:02:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:26.755666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381e0e66-2e1e-4799-9eb2-acdc97ede404", "tag": "221758de-2b24-4a3a-a300-edc064402791"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:26.820217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.822134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.823475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.878085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] Creating event network-changed:221758de-2b24-4a3a-a300-edc064402791 for instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 on n-h1-831193-17 Oct 04 18:02:26.897293 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1fe902e0-336b-44b6-b99f-e0fadacf6ad6 req-480a43db-3208-4066-bb31-055c93bcdd22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172300 Oct 04 18:02:26.913463 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1900/2695] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:26.937201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1665f015-0064-4278-a75a-63b65fb3fd23 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340bb8dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.015151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:27.026784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:29.365431 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1665f015-0064-4278-a75a-63b65fb3fd23 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "DELETE /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d" status: 204 len: 0 microversion: 2.1 time: 2.447675 Oct 04 18:02:29.366167 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1901/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:26 2022] DELETE /compute/v2.1/images/8c9d7959-957c-42d3-bbd6-2aad1c2e315d => generated 0 bytes in 2451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:29.373371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:29.374557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:29.395450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.396415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.397030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.398351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.399229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.399839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.682532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:29.693705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ccdfa28c-a1aa-41d1-995e-f42fe2befd50 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1324 microversion: 2.1 time: 0.326159 Oct 04 18:02:29.695013 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1902/2697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:29 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1324 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:29.701396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:29.708935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.710066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.710739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.773363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Going to try to start instance {{(pid=128770) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:02:29.828845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:29.878785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1d3b5f7-26c6-42ec-ac75-6f65e3920af3 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action" status: 202 len: 0 microversion: 2.1 time: 0.179894 Oct 04 18:02:29.883420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1903/2698] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:29 2022] POST /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:29.897814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:29.901380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:29.918217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.919892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.920417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.922809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.924025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.926498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.215492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:30.233971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-563b3132-56d7-436e-8bfa-59395b4b357b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.340684 Oct 04 18:02:30.234661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1904/2699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:29 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:30.244515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-plugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:30.271986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.272487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.272987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.304241 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] Creating event network-vif-plugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:02:30.318546 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cdecf947-56d2-4442-99a2-f77361b94d57 req-37d703f7-7086-43ad-bd08-9030750f94c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082566 Oct 04 18:02:30.319898 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1905/2700] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:30.339475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39633931-1cd0-4795-9e49-c77b0ced26b2 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340c18ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.472033 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39633931-1cd0-4795-9e49-c77b0ced26b2 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/cf9384e3-17e2-41d4-9ca9-f8159094ac55" status: 200 len: 141 microversion: 2.1 time: 1.148343 Oct 04 18:02:31.473505 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1906/2701] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/os-floating-ips/cf9384e3-17e2-41d4-9ca9-f8159094ac55 => generated 141 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:31.478978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-94034efe-599d-494a-b451-4bc6d91eecc4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '.version_select at 0x7f6340bd6430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.554826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-94034efe-599d-494a-b451-4bc6d91eecc4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] HTTP exception thrown: Image not found. Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-94034efe-599d-494a-b451-4bc6d91eecc4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Request method failure captured: Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 HTTP/1.1 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTICRRXejToIgPgScEz_u4zc9wG5TuxJLO4cWsF3GB17dFOgaJyXsM_gUoGqM5HV_kI_gD0ru-ktijs5sd8PZhoquSdsKwGtpXuOMUbE_w-U1FsBWId7GjZqJdKxeeRhIVbd9txrq3s4LXRRy2syFvbDke5StxIVLC2R5-mVFazCgs Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a614044e07e442a2adc158f8f3420b01 Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '906cdaae-57a2-4850-a5d7-5410558c5ff7'} Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 906cdaae-57a2-4850-a5d7-5410558c5ff7 to delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 906cdaae-57a2-4850-a5d7-5410558c5ff7 could not be found. Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.557211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:02:31.562957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.565853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-94034efe-599d-494a-b451-4bc6d91eecc4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:31.566945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-94034efe-599d-494a-b451-4bc6d91eecc4 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "DELETE /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7" status: 404 len: 62 microversion: 2.1 time: 0.092190 Oct 04 18:02:31.568385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1907/2702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:31 2022] DELETE /compute/v2.1/images/906cdaae-57a2-4850-a5d7-5410558c5ff7 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:31.581446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.583064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:31.597276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:31.601897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.603219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.607463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.608595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.609248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.612410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.616902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:32.636028 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-919207ad-6000-4f4c-8788-c8a73a80f0fc tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1663 microversion: 2.1 time: 1.066308 Oct 04 18:02:32.636788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1908/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:31 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1663 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:32.656296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:32.660457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:32.711186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.712068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.712861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.720037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.727797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.728649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.529428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:33.551779 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9e26a64-11b0-4802-a34a-849ca9c69ddb tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1324 microversion: 2.1 time: 0.911106 Oct 04 18:02:33.576362 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1909/2704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:32 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1324 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:33.605010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:33.606218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:33.637089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.637782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.638320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.639169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.639740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.640334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.232539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:34.242881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-678967aa-508c-4b29-8608-68174c04e4d8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.658060 Oct 04 18:02:34.256885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1910/2705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:33 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:34.289203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9bee991-ba98-4f85-9a10-57c3d5a879a7 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340bd60d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:36.464763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9bee991-ba98-4f85-9a10-57c3d5a879a7 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/cf9384e3-17e2-41d4-9ca9-f8159094ac55" status: 202 len: 0 microversion: 2.1 time: 2.206692 Oct 04 18:02:36.468891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1911/2706] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:02:34 2022] DELETE /compute/v2.1/os-floating-ips/cf9384e3-17e2-41d4-9ca9-f8159094ac55 => generated 0 bytes in 2211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:36.485510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:36.487364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:36.501378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.502154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.502966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.503949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.504705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.505630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.586696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:36.812739 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-021b3fdd-b582-4775-acb6-d1527f77e0c3 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 204 len: 0 microversion: 2.1 time: 0.341653 Oct 04 18:02:36.813571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1912/2707] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:36 2022] DELETE /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:36.839843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381e0e66-2e1e-4799-9eb2-acdc97ede404", "name": "network-vif-plugged", "status": "completed", "tag": "221758de-2b24-4a3a-a300-edc064402791"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:36.865439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.865923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.866986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.898645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] Creating event network-vif-plugged:221758de-2b24-4a3a-a300-edc064402791 for instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 on n-h1-831193-17 Oct 04 18:02:36.925383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d271561d-03b9-4a1e-9296-a6ec29da26e5 req-ab427b8c-0633-47db-8774-61a2c89cd67f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104987 Oct 04 18:02:36.927557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1913/2708] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:36.949114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:36.952307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:36.964565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.967498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.969193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.970472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.971696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.972425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.362252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:37.370445 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-522e4723-f15d-4662-b300-bc2c04e8f75f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1667 microversion: 2.1 time: 0.440274 Oct 04 18:02:37.371054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1914/2709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:36 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1667 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:37.402784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:37.404959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:37.425132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.427249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.427892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.430071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.432605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.433513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.921677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:37.932894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f62dd8b7-3210-4cdc-8572-e311c742c77e tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1324 microversion: 2.1 time: 0.542838 Oct 04 18:02:37.951231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1915/2710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:37 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:37.960868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:37.968316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:37.984811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.986767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.991200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.999020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:38.000603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:38.005555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:38.505718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:38.514842 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b287b57e-a53a-4fde-8a15-dbe56723fff9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.562313 Oct 04 18:02:38.520089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1916/2711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:37 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:39.062656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce16ddb8-d2c5-4302-b6f6-71f638c4f286 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340bb8550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-218327172", "description": "tempest-description-518506615"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:39.455338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce16ddb8-d2c5-4302-b6f6-71f638c4f286 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.933623 Oct 04 18:02:39.468409 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1917/2712] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:38 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:39.481545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c20a45c2-4c47-474b-9394-0771dfe353b0 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340c263a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.013647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c20a45c2-4c47-474b-9394-0771dfe353b0 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.543168 Oct 04 18:02:40.014503 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1918/2713] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 18:02:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:40.026955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.028018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:40.060211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.062921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.063521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.067926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.070469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.071504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.225814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.226625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.227163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.227628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lazy-loading 'fault' on Instance uuid 6d930477-4ecf-49a8-82ea-6002ce881feb {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:40.378014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a614044e07e442a2adc158f8f3420b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65df4413de8d4f12a9e324fda9bb9238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:40.388062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5b2607a-47ef-40db-aa98-ea349667077e tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 200 len: 1307 microversion: 2.1 time: 0.372088 Oct 04 18:02:40.388655 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1919/2714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:40.403747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.404523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:40.421550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.422048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.422488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.423359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.423813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.424239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.834348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:40.853927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2f13d4d4-08ed-430a-a322-80b626b76a26 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1520 microversion: 2.1 time: 0.462403 Oct 04 18:02:40.855471 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1920/2715] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:40.875961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4c28d00-496e-4f1d-96b9-ce6e4322258c tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340c183a0>, body: {"security_group_rule": {"parent_group_id": "d763b375-d56e-4674-9557-9b38174d1c8e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:41.335680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4c28d00-496e-4f1d-96b9-ce6e4322258c tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.478318 Oct 04 18:02:41.337090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1921/2716] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:40 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:41.358614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:41.360766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:41.385693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.386398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.388881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.389781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.391273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.393247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.771620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:41.793161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-960422da-d94f-4a53-a8ff-b59ea4c5b44c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.454693 Oct 04 18:02:41.798138 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1922/2717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:41 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:41.813361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d930477-4ecf-49a8-82ea-6002ce881feb", "name": "network-vif-deleted", "tag": "84b7304e-e187-4b8b-b0b6-baf267f53086"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:41.836206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.836687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.837116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.853018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] Creating event network-vif-deleted:84b7304e-e187-4b8b-b0b6-baf267f53086 for instance 6d930477-4ecf-49a8-82ea-6002ce881feb on n-h2-831193-17 Oct 04 18:02:41.859296 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-012970b2-4f11-45eb-9f84-94dad7d2f750 req-f5e154f1-e671-41ed-98bd-ff797cf7bbc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059831 Oct 04 18:02:41.860159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1923/2718] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:41.870542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1dc14a8-1cea-418e-bb8e-17e38c8a434f tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340c20280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:42.415098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1dc14a8-1cea-418e-bb8e-17e38c8a434f tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.549133 Oct 04 18:02:42.416147 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1924/2719] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 18:02:41 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:42.432126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:42.434224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:42.466901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.472662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.476725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.478012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.479292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.479974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.533321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] HTTP exception thrown: Action 999 not found Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Request method failure captured: Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404/os-instance-actions/999 HTTP/1.1 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHUlX9vCOwJO68TVtdNg2V9zHdvkJOG66X2ylj40ayPHH5ipUrb76WoL3WUz9b-RAZZ41bO6Ez6PSHTmZUGbQltv-7YtoJqBK0BfAEnKo5LOVJ8D8MVFFC51Rp9lAk11z1nsNsz7XOjikek335gHHCSLdLW5CEY4h868LHznYu2gp9Y Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6eb3fef75b0949e4a23ab9efe7c9958c Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: exception: Action 999 not found Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '381e0e66-2e1e-4799-9eb2-acdc97ede404', 'id': '999'} Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 18:02:42.547618 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:42.552479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Returning 404 to user: Action 999 not found {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:42.553751 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ab2d9b6-873e-4b59-9819-c2a189014b0f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.133408 Oct 04 18:02:42.557418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1925/2720] 10.222.0.33 () {58 vars in 1308 bytes} [Tue Oct 4 18:02:42 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404/os-instance-actions/999 => generated 66 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:42.573503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-169712fa-9bba-4bec-b832-39b6697432d9 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340c1f280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1664248289", "description": "tempest-description-41418575"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:43.053781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-169712fa-9bba-4bec-b832-39b6697432d9 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.494879 Oct 04 18:02:43.054403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1926/2721] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:42 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:43.067580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:43.068411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] [instance: 6d930477-4ecf-49a8-82ea-6002ce881feb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:43.087512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.088035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.088479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.091404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.094049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.097905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.119687 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] HTTP exception thrown: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Request method failure captured: Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb HTTP/1.1 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHTICRRXejToIgPgScEz_u4zc9wG5TuxJLO4cWsF3GB17dFOgaJyXsM_gUoGqM5HV_kI_gD0ru-ktijs5sd8PZhoquSdsKwGtpXuOMUbE_w-U1FsBWId7GjZqJdKxeeRhIVbd9txrq3s4LXRRy2syFvbDke5StxIVLC2R5-mVFazCgs Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65df4413de8d4f12a9e324fda9bb9238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 65df4413de8d4f12a9e324fda9bb9238 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2002036412 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: a614044e07e442a2adc158f8f3420b01 Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerTestJSON-2002036412-project Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6d930477-4ecf-49a8-82ea-6002ce881feb'} Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:43.121773 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. Oct 04 18:02:43.126563 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:43.128019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] Returning 404 to user: Instance 6d930477-4ecf-49a8-82ea-6002ce881feb could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:43.129383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90ab6a7b-316d-41ee-9b25-73bea6455bd9 tempest-ImagesOneServerTestJSON-2002036412 tempest-ImagesOneServerTestJSON-2002036412-project] 10.222.0.33 "GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb" status: 404 len: 111 microversion: 2.1 time: 0.073512 Oct 04 18:02:43.130120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1927/2722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:43 2022] GET /compute/v2.1/servers/6d930477-4ecf-49a8-82ea-6002ce881feb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:43.138267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cc343a3-c218-47f8-8e6f-c9f6eff6699a tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340bdc670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:45.768024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cc343a3-c218-47f8-8e6f-c9f6eff6699a tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/120cb0be-0c43-4e2f-a171-060d13425ef3" status: 202 len: 0 microversion: 2.1 time: 2.631689 Oct 04 18:02:45.778079 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1928/2723] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:02:43 2022] DELETE /compute/v2.1/os-floating-ips/120cb0be-0c43-4e2f-a171-060d13425ef3 => generated 0 bytes in 2645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:45.832711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '.version_select at 0x7f6340bb8dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:45.836562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 82dc17f6-c55d-4f59-b0be-d955a3282774] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:45.867521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] HTTP exception thrown: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Request method failure captured: Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/82dc17f6-c55d-4f59-b0be-d955a3282774/os-instance-actions HTTP/1.1 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHUlX9vCOwJO68TVtdNg2V9zHdvkJOG66X2ylj40ayPHH5ipUrb76WoL3WUz9b-RAZZ41bO6Ez6PSHTmZUGbQltv-7YtoJqBK0BfAEnKo5LOVJ8D8MVFFC51Rp9lAk11z1nsNsz7XOjikek335gHHCSLdLW5CEY4h868LHznYu2gp9Y Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6eb3fef75b0949e4a23ab9efe7c9958c Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '82dc17f6-c55d-4f59-b0be-d955a3282774'} Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:45.878358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. Oct 04 18:02:45.882518 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:45.883245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Returning 404 to user: Instance 82dc17f6-c55d-4f59-b0be-d955a3282774 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:45.889994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0276d6f-fb87-4026-9dab-f052afbef53c tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/82dc17f6-c55d-4f59-b0be-d955a3282774/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.107514 Oct 04 18:02:45.896241 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1929/2724] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 18:02:45 2022] GET /compute/v2.1/servers/82dc17f6-c55d-4f59-b0be-d955a3282774/os-instance-actions => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:45.915610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:45.916236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:45.958808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.959337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.962183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.966271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.967119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.967758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.532337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:46.760766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:46.769604 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-559c200b-7c6a-482c-a6cb-bef3f6b8fa5e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1680 microversion: 2.1 time: 0.870759 Oct 04 18:02:46.777893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1930/2725] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:45 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1680 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:46.798962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39cc4c19-cea9-438b-ae35-4f31ded63f91 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340b815e0>, body: {"security_group_rule": {"parent_group_id": "9073a9cd-86d0-4ba7-b751-597b19396604", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:47.814938 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39cc4c19-cea9-438b-ae35-4f31ded63f91 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.034332 Oct 04 18:02:47.826240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1931/2726] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:46 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:47.831447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a29a8e7f-c4fa-4e47-b77e-700bafb82902 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340bcc670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.057957 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a29a8e7f-c4fa-4e47-b77e-700bafb82902 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/cd2d3321-8b1d-4345-9eff-aa139bdbeb51" status: 202 len: 0 microversion: 2.1 time: 2.228944 Oct 04 18:02:50.060086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1932/2727] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:02:47 2022] DELETE /compute/v2.1/os-floating-ips/cd2d3321-8b1d-4345-9eff-aa139bdbeb51 => generated 0 bytes in 2233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:50.073282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.073805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:50.082943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.085153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.085619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.086348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.086927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.087295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.128823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:50.290368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb426f38-97df-4818-a3ea-7d8b075422f9 tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 204 len: 0 microversion: 2.1 time: 0.222805 Oct 04 18:02:50.290974 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1933/2728] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:50 2022] DELETE /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:50.299533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.300247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:50.317580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.318085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.318540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.319296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.319759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.320190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.580437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.598865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d1aaa68-bae5-4366-94b3-512b5bcac537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.301105 Oct 04 18:02:50.599980 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1934/2729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:50.626148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-764fbd96-6407-4c07-8863-b90ca7c48147 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340b81430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-916871291", "description": "tempest-description-175593295"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.377303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-764fbd96-6407-4c07-8863-b90ca7c48147 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.759666 Oct 04 18:02:51.379143 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1935/2730] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:50 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:51.683674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-664a33b0-76b0-439b-b11c-328c4e173860 tempest-ListImageFiltersNegativeTestJSON-772437313 tempest-ListImageFiltersNegativeTestJSON-772437313-project] Calling method '.version_select at 0x7f6340b81af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:51.750692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-664a33b0-76b0-439b-b11c-328c4e173860 tempest-ListImageFiltersNegativeTestJSON-772437313 tempest-ListImageFiltersNegativeTestJSON-772437313-project] HTTP exception thrown: Image not found. Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-664a33b0-76b0-439b-b11c-328c4e173860 tempest-ListImageFiltersNegativeTestJSON-772437313 tempest-ListImageFiltersNegativeTestJSON-772437313-project] Request method failure captured: Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/images/87558c58-2df8-45ed-9d1a-264347694c20 HTTP/1.1 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVIaRiq0Jp-anWq3RNWAftZSjd8W1mn_yWaP2koZgWQIfkofBfceUmhlfrs6C838IulST9nVv7Q1SDFLe6i4AoXUhe6d_sV1khlc5ths5cCRUZc3bkziZdQTuyRcIuf8kO8nUJ2rIMSJsueS810NzPLX3Uo8Yy-BtqZuBoQpzOi-RA Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 170fb8a58acf46c0af1467b435571af7 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-772437313 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/170fb8a58acf46c0af1467b435571af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_170fb8a58acf46c0af1467b435571af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/170fb8a58acf46c0af1467b435571af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/170fb8a58acf46c0af1467b435571af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-772437313 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 170fb8a58acf46c0af1467b435571af7 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-772437313 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListImageFiltersNegativeTestJSON-772437313-project Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: f879e644977a4a77b07e7951d60394c2 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-772437313-project Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '87558c58-2df8-45ed-9d1a-264347694c20'} Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 87558c58-2df8-45ed-9d1a-264347694c20 Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:02:51.753252 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 87558c58-2df8-45ed-9d1a-264347694c20 could not be found. Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:02:51.757768 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.765613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-664a33b0-76b0-439b-b11c-328c4e173860 tempest-ListImageFiltersNegativeTestJSON-772437313 tempest-ListImageFiltersNegativeTestJSON-772437313-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:51.766973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-664a33b0-76b0-439b-b11c-328c4e173860 tempest-ListImageFiltersNegativeTestJSON-772437313 tempest-ListImageFiltersNegativeTestJSON-772437313-project] 10.222.0.33 "GET /compute/v2.1/images/87558c58-2df8-45ed-9d1a-264347694c20" status: 404 len: 62 microversion: 2.1 time: 0.385727 Oct 04 18:02:51.768153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1936/2731] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:02:51 2022] GET /compute/v2.1/images/87558c58-2df8-45ed-9d1a-264347694c20 => generated 62 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:51.774094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-312a6d1b-7a9a-4417-8a9c-2507f0dc51e9 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] Calling method '.version_select at 0x7f6340c4b820>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.081166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-312a6d1b-7a9a-4417-8a9c-2507f0dc51e9 tempest-FloatingIPDetailsTestJSON-1627206195 tempest-FloatingIPDetailsTestJSON-1627206195-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/1111271d-deeb-4efd-88ec-4a976ff240b5" status: 202 len: 0 microversion: 2.1 time: 1.311095 Oct 04 18:02:53.082318 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1937/2732] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:02:51 2022] DELETE /compute/v2.1/os-floating-ips/1111271d-deeb-4efd-88ec-4a976ff240b5 => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:53.107568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.109290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:53.130989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.131354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.131878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.140834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.141621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.144636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.242034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.243353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.245234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.245734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lazy-loading 'fault' on Instance uuid 381e0e66-2e1e-4799-9eb2-acdc97ede404 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:53.383528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb3fef75b0949e4a23ab9efe7c9958c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a24b0303084f4b90cff8fb9ef7137c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:53.406659 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26718914-02e9-465b-8d9c-1c92b62ac08f tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 200 len: 1314 microversion: 2.1 time: 0.303309 Oct 04 18:02:53.407634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1938/2733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:53 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:53.420844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ce47fd1-059c-4901-8cba-b21c999886a2 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340d568b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-812187480", "description": "tempest-description-933886233"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:53.826143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ce47fd1-059c-4901-8cba-b21c999886a2 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.416426 Oct 04 18:02:53.827742 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1939/2734] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:53 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:53.834213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.835297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:53.855445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.856819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.859105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.860503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.861297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.861939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.181406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:54.196114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83503c64-3e7c-421c-a292-e5085c8d1e63 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.366676 Oct 04 18:02:54.199191 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1940/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:53 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:54.220704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381e0e66-2e1e-4799-9eb2-acdc97ede404", "name": "network-vif-deleted", "tag": "221758de-2b24-4a3a-a300-edc064402791"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:54.248762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.249561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.250056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.276931 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] Creating event network-vif-deleted:221758de-2b24-4a3a-a300-edc064402791 for instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 on n-h1-831193-17 Oct 04 18:02:54.288958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-14dd60d1-07e3-4a3e-8951-1daf41c2f3d5 req-45360f36-34ec-4bb0-9577-86085b0528a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087908 Oct 04 18:02:54.290533 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1941/2736] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:54.299054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bf8812d-0e2f-40d2-8bfe-23f91f0ea674 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340d63040>, body: {"security_group_rule": {"parent_group_id": "cfc29236-f962-4adb-ae90-466064167910", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "554f08f6-f95d-40cc-9dc2-dca6ccc34713"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:55.801438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2bf8812d-0e2f-40d2-8bfe-23f91f0ea674 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.506373 Oct 04 18:02:55.802885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1942/2737] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:54 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:55.807932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-unplugged", "status": "completed", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:55.848860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.849356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.856049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.910723 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] Creating event network-vif-unplugged:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:02:55.923143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-17d20ec6-2902-4704-8540-662c230e6a55 req-7c555368-14cf-4a0a-a7a3-2083fb97b817 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117274 Oct 04 18:02:55.924271 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1943/2738] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:55.939786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:55.941345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] [instance: 381e0e66-2e1e-4799-9eb2-acdc97ede404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:55.950408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.950929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.951297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.952715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.953353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.953945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.979509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] HTTP exception thrown: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Request method failure captured: Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 HTTP/1.1 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHUlX9vCOwJO68TVtdNg2V9zHdvkJOG66X2ylj40ayPHH5ipUrb76WoL3WUz9b-RAZZ41bO6Ez6PSHTmZUGbQltv-7YtoJqBK0BfAEnKo5LOVJ8D8MVFFC51Rp9lAk11z1nsNsz7XOjikek335gHHCSLdLW5CEY4h868LHznYu2gp9Y Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0a24b0303084f4b90cff8fb9ef7137c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: a0a24b0303084f4b90cff8fb9ef7137c Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1512137990 Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 6eb3fef75b0949e4a23ab9efe7c9958c Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1512137990-project Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '381e0e66-2e1e-4799-9eb2-acdc97ede404'} Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:55.981624 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. Oct 04 18:02:55.986445 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:02:55.988618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] Returning 404 to user: Instance 381e0e66-2e1e-4799-9eb2-acdc97ede404 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:55.991214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2854d81e-9d5d-403c-971a-3a8c3c3f8f5a tempest-InstanceActionsNegativeTestJSON-1512137990 tempest-InstanceActionsNegativeTestJSON-1512137990-project] 10.222.0.33 "GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404" status: 404 len: 111 microversion: 2.1 time: 0.065506 Oct 04 18:02:55.992029 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1944/2739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:55 2022] GET /compute/v2.1/servers/381e0e66-2e1e-4799-9eb2-acdc97ede404 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:55.997549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a91dc3cf-eae4-4b30-905a-9f679fecdf05 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340b81430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1147659852", "description": "tempest-description-1587478960"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:57.659738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a91dc3cf-eae4-4b30-905a-9f679fecdf05 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.666197 Oct 04 18:02:57.660411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1945/2740] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:57.672264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.673342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.701226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.702102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.702764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.703782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.707446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.708112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.903364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.914210 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1283b1e-7e2d-4e04-91e5-e47a6ab81f0f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 1.250684 Oct 04 18:02:58.917929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1946/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:57 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:58.927175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96c1185c-5a1a-4c85-9e77-fc6684711d18 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340bcc550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1062346578", "description": "tempest-description-903318402"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:59.891697 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96c1185c-5a1a-4c85-9e77-fc6684711d18 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.971406 Oct 04 18:02:59.893069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1947/2742] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:59.898412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.899053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.914883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.915615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.915839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.918012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.920376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.921015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.531617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:00.551150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb35cdca-ebfc-4148-8719-ebd1d5cac1b6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.656675 Oct 04 18:03:00.552051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1948/2743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:00.567439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e929eed-3da4-4aac-909e-237fb8d13035 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340cfb040>, body: {"security_group_rule": {"parent_group_id": "5f744c7b-d8f6-4911-9d21-e55dd9095c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "97d6b1f6-e18f-45ad-a0eb-b198ef750da8"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:02.035233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e929eed-3da4-4aac-909e-237fb8d13035 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.481603 Oct 04 18:03:02.042635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1949/2744] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:03:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:02.042635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.042635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.044876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:02.076170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.076873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.077379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.078229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.078747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.086863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.597619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.629010 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34199ff6-1c04-486d-b026-4df745dd556b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.591540 Oct 04 18:03:02.629651 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1950/2745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.644981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc24dffc-cfb3-4121-8b5a-fb1861833071 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340c20550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.170401 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:03:03.170998 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:03:03.662977 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:03:03.663880 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 18:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8 (ip 10.222.0.33) !!! Oct 04 18:03:04.891539 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc24dffc-cfb3-4121-8b5a-fb1861833071 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8" status: 202 len: 0 microversion: 2.1 time: 2.260737 Oct 04 18:03:04.892162 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1951/2746] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:02 2022] DELETE /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8 => generated 0 bytes in 2262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:04.900789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:04.909746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.925444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.934903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.935863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.939404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.940373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.940986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.259539 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8da3a509-6543-4037-b884-b920de94c9a9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.357497 Oct 04 18:03:05.262415 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1952/2747] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:04 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:05.294044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6230ab89-4cd3-4a19-b88f-a8542048b461 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340dee280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.112513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6230ab89-4cd3-4a19-b88f-a8542048b461 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5f744c7b-d8f6-4911-9d21-e55dd9095c45" status: 200 len: 248 microversion: 2.1 time: 0.844789 Oct 04 18:03:06.115927 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1953/2748] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/os-security-groups/5f744c7b-d8f6-4911-9d21-e55dd9095c45 => generated 248 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:06.120977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.121757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.156854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.169209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.175830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.177036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.177760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.178898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.154750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.171947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-379c0a13-ed6b-41ee-af25-fa59d3a5babf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1669 microversion: 2.1 time: 1.054252 Oct 04 18:03:07.172979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1954/2749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1669 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:07.181637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-71b88713-b3b7-4c60-bdb1-cdbcd9893698 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340d3b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-594120581", "description": "tempest-description-2044165373"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:08.495132 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-71b88713-b3b7-4c60-bdb1-cdbcd9893698 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.320744 Oct 04 18:03:08.495734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1955/2750] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:03:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:08.508277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.510860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.536413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.537290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.537946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.544490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.545290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.545956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.631914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f2ec0e9-c94c-4dcf-ad5a-96ac2c97c7e7 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135027 Oct 04 18:03:08.641859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1956/2751] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:03:08.654837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.659421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.674282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.674885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.676086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.676836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.678682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.679209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.201337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.216584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-278fd170-c5c5-416c-b8f2-132f3b0dbe10 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.570319 Oct 04 18:03:09.218228 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1957/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:09.236755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c38336a-3e1f-46d8-9f9b-be1ec4e11453 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340c20a60>, body: {"security_group_rule": {"parent_group_id": "124297c5-806d-406e-ab0d-a1a45bd12cea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:09.954089 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c38336a-3e1f-46d8-9f9b-be1ec4e11453 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.730945 Oct 04 18:03:09.957019 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1958/2753] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:03:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:09.967377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.971114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.009864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.013924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.013924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.016528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.018319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.019961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.100527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:10.130472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:10.301427 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8058fcb8-e690-4a94-8a6f-27beeef216db tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 204 len: 0 microversion: 2.1 time: 0.341630 Oct 04 18:03:10.302039 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1959/2754] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:09 2022] DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:10.315071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:10.324829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.346261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.346760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.347408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.348501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.349383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.350169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.426519 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e620b530-de77-43d6-b7ef-8281523c0cb7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 200 len: 322 microversion: 2.1 time: 0.121723 Oct 04 18:03:10.427620 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1960/2755] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:10 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:10.436045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cde3ed9-45ec-4268-91d9-108f7eea1b3f tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Action: 'create', calling method: .version_select at 0x7f6340bcc670>, body: {"security_group_rule": {"parent_group_id": "124297c5-806d-406e-ab0d-a1a45bd12cea", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:10.957960 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cde3ed9-45ec-4268-91d9-108f7eea1b3f tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.528608 Oct 04 18:03:10.959590 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1961/2756] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 18:03:10 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:10.966465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.967987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.000932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.002580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.004184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.006726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.007998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.009201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.404470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:11.426927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57206fe9-0f61-4c49-b9fa-139121cda042 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1673 microversion: 2.1 time: 0.456539 Oct 04 18:03:11.429917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1962/2757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:10 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1673 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:11.449794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.452158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.464563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.467066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.468082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.469827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.488558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.489054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.816146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:11.828691 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-205a9bfb-580e-40fb-9b44-0b98b1abad71 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.397402 Oct 04 18:03:11.834061 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1963/2758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.378720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5a35db2-da26-47ab-8747-6b112a477464 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f6340b81550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-174453897", "description": "tempest-description-31940140"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:12.989693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5a35db2-da26-47ab-8747-6b112a477464 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.152210 Oct 04 18:03:12.990309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1964/2759] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:03:11 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:12.995728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62f06180-d0fc-4dc5-9f5e-f8f511fc05f0 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340c203a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.194384 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62f06180-d0fc-4dc5-9f5e-f8f511fc05f0 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/124297c5-806d-406e-ab0d-a1a45bd12cea" status: 200 len: 664 microversion: 2.1 time: 0.202108 Oct 04 18:03:13.195472 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1965/2760] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/os-security-groups/124297c5-806d-406e-ab0d-a1a45bd12cea => generated 664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:13.210327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.211537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.223626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.226045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.226694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.229807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.231870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.234022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.675720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.691225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3adb314b-a976-4fd9-90d6-2377b391a114 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.492546 Oct 04 18:03:13.692081 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1966/2761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.717947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.718839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.728041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.729025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.729634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.730577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.731308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.732100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.898002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.936542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07a9b616-d934-4ede-946f-b083d20a6282 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 200 len: 1606 microversion: 2.1 time: 0.222648 Oct 04 18:03:13.938031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1967/2762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 1606 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.950677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-841c0fd8-c3a6-4839-ae53-9e31b13428c3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f63417f9700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-355988283", "description": "tempest-description-124428131"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:14.598902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-841c0fd8-c3a6-4839-ae53-9e31b13428c3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.659371 Oct 04 18:03:14.599553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1968/2763] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:03:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:14.606535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8a4e9de-d199-4fb6-b3e9-96e3a8c17c05 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340c4bdc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:15.691864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8a4e9de-d199-4fb6-b3e9-96e3a8c17c05 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/a1e93e91-50b5-4505-8cbb-8182473627c8" status: 202 len: 0 microversion: 2.1 time: 1.091239 Oct 04 18:03:15.698019 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1969/2764] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 18:03:14 2022] DELETE /compute/v2.1/os-security-group-rules/a1e93e91-50b5-4505-8cbb-8182473627c8 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:15.703081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:15.704019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:15.729607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.730604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.731299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.732261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.735528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.736210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.469042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:17.481983 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6694e7db-64c6-4fff-8bd1-585b50c9ab41 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 1.782753 Oct 04 18:03:17.482591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1970/2765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:15 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:17.489901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-902780633", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "87eee9de-3ed4-48dc-80c8-b4e41df1fa4b"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:17.628084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] validate_networks() for [('87eee9de-3ed4-48dc-80c8-b4e41df1fa4b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:18.414597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:18.415664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:18.418816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:18.419533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:18.420382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:18.442148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.443930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.444542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.445461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.446078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.447533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.514379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Getting quotas for project ffd16dad7b5c41b0b24c0046311ca93e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:18.530366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Getting quotas for user 8dd1ef50fcfe4ec9840921305d16dea5 and project ffd16dad7b5c41b0b24c0046311ca93e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:18.567113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:18.569956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:18.668580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c26f205-35f0-40bb-9918-3e23ce4b9509 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183902 Oct 04 18:03:18.675613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1971/2766] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:18.688897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:18.690993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:18.706018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.708372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.709518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.712673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.713162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.713610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.749142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 HTTP/1.1 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8bc6ddeb-263c-43aa-8c2e-87193a5c93a8'} Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:18.752156 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:03:18.757103 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:18.760554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:18.764971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff0c123c-09b4-482d-9c9d-67acf4618873 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 404 len: 111 microversion: 2.1 time: 0.091820 Oct 04 18:03:18.767340 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1972/2767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:18 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:18.772338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc6ddeb-263c-43aa-8c2e-87193a5c93a8", "name": "network-vif-deleted", "tag": "8863052f-7da7-4088-a78e-404ba621335a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:18.802092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.802577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.807608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.847879 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] Creating event network-vif-deleted:8863052f-7da7-4088-a78e-404ba621335a for instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 on n-h1-831193-17 Oct 04 18:03:18.863829 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-51d7758e-84b5-494e-8a9f-20c4ef9253e1 req-a585b38e-0f31-4731-bd5a-0f29cfac0446 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093025 Oct 04 18:03:18.864466 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1973/2768] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:18.881850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04550899-bf74-48f4-94e5-8da67dd116c5 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f63417f98b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:19.411643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04550899-bf74-48f4-94e5-8da67dd116c5 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/124297c5-806d-406e-ab0d-a1a45bd12cea" status: 202 len: 0 microversion: 2.1 time: 0.541812 Oct 04 18:03:19.412544 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1974/2769] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:18 2022] DELETE /compute/v2.1/os-security-groups/124297c5-806d-406e-ab0d-a1a45bd12cea => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:20.211877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-831807955", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "797dd02c-a004-438a-901c-6b8011f646fa"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:20.349602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] validate_networks() for [('797dd02c-a004-438a-901c-6b8011f646fa', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:21.395474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:21.396112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:21.396382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:21.396802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:21.397219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:21.409793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.409793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.409793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.410511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.410975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.415810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.476612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:21.509247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for user 2f1fb61079c747799838255e355bef86 and project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:21.548211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:21.552174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:21.678531 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79722ecc-b4c6-439b-b3c4-354d29b9490b tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264692 Oct 04 18:03:21.679219 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1975/2770] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:21.700598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:21.701408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:21.716601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.717397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.717993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.722384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.723063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.729699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.992200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.009160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f809e4c-7697-4ed1-addd-8aa7153346f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.328706 Oct 04 18:03:22.023108 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1976/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.030834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.032058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.048479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.049237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.052172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.052971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.053463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.053910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.190531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.202374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6de8777b-dec8-47c6-b318-5d587ec2b216 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1273 microversion: 2.1 time: 0.181599 Oct 04 18:03:22.203454 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1977/2772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.210469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13e080d6-c255-47d7-8e1d-7a4342b723e8 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '.version_select at 0x7f6340d56670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.250865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13e080d6-c255-47d7-8e1d-7a4342b723e8 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739353653" status: 202 len: 0 microversion: 2.1 time: 0.045816 Oct 04 18:03:22.251629 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1978/2773] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739353653 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:22.258594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6345ca4f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.374906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:03:22.375756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Neutron security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:03:22.376472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] HTTP exception thrown: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.376472 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Request method failure captured: Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8 HTTP/1.1 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHU8R1stG7fKqiZ3INVFTfNM1B2ki8P7EqQ0_5TG5PJEjmcxVyjy0Sl5EcEIeZCUNr5NoRCs6IAbvwhivwXBBTF20xvWNQ0DbwD4CRtmgdM3TnL_2-7d5IFzsAqdvQ8ZG3RZfDm7kk_7tRzrYcF83b4dfXd93Uzy3DARqaThZD8iPGA Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0ee5431122964d55bb66a7655ba90758 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-734311836 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee5431122964d55bb66a7655ba90758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ee5431122964d55bb66a7655ba90758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee5431122964d55bb66a7655ba90758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ee5431122964d55bb66a7655ba90758"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupRulesTestJSON-734311836 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0ee5431122964d55bb66a7655ba90758 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-734311836 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupRulesTestJSON-734311836-project Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 415fbd66b315462aac162b13d8eaead6 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupRulesTestJSON-734311836-project Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '97d6b1f6-e18f-45ad-a0eb-b198ef750da8'} Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:03:22.379024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] Oct 04 18:03:22.383742 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:03:22.387921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Returning 404 to user: Security group 97d6b1f6-e18f-45ad-a0eb-b198ef750da8 does not exist Oct 04 18:03:22.387921 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-213c9454-05bd-48e3-a199-237880e20b0e'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:22.389086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dbfe7ed3-33ec-4962-b474-b3981edc87a1 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8" status: 404 len: 194 microversion: 2.1 time: 0.136273 Oct 04 18:03:22.389823 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1979/2774] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:22 2022] DELETE /compute/v2.1/os-security-groups/97d6b1f6-e18f-45ad-a0eb-b198ef750da8 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:22.406381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1183830313", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "797dd02c-a004-438a-901c-6b8011f646fa"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:22.535422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] validate_networks() for [('797dd02c-a004-438a-901c-6b8011f646fa', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:24.267763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:24.268752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:24.268991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:24.269760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:24.272645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:24.321159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.326088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.327543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:24.328667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.329496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.330735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:24.392768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:24.419127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for user 2f1fb61079c747799838255e355bef86 and project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:24.452957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:24.462730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:24.573030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b914b47-8538-4666-aa88-3a5ff14627ad tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.181890 Oct 04 18:03:24.587132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1980/2775] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:24.595427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-209531560", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "89fe5a7e-7761-4d04-bb95-deb9053990c0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:24.729973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] validate_networks() for [('89fe5a7e-7761-4d04-bb95-deb9053990c0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:25.866016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:25.867685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:25.868691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:25.869452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:25.870371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:25.899720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.900469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.901644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.903611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.904090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.904525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.962301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:25.989951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:26.032159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:26.035466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:26.040235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:26.111815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6dc968b6-3eae-4b2e-baa7-d2896a98648e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523230 Oct 04 18:03:26.119334 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1981/2776] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:26.129399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a7b9a330-757c-459f-9a31-a316855030e2 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6345cdfee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.430944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a7b9a330-757c-459f-9a31-a316855030e2 tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5f744c7b-d8f6-4911-9d21-e55dd9095c45" status: 202 len: 0 microversion: 2.1 time: 1.309540 Oct 04 18:03:27.432236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1982/2777] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:26 2022] DELETE /compute/v2.1/os-security-groups/5f744c7b-d8f6-4911-9d21-e55dd9095c45 => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:27.442271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.443747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.474698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.475702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.476578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.477740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.478924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.483744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.939102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:27.953149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-20b9f450-5ec8-42d2-be5e-cc2f06c17dd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1315 microversion: 2.1 time: 0.515194 Oct 04 18:03:27.954473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1983/2778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:27 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:28.365653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1134697232", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "7cc2a1d3-40de-4f7f-ba18-cce7344fac7e"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:28.442434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] validate_networks() for [('7cc2a1d3-40de-4f7f-ba18-cce7344fac7e', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:29.702113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:29.703366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:29.704523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:29.705173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:29.705818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:29.743540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.744080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.744533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.745307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.745832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.746772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.791757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:29.811814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for user fea98bf127544d63a6f3c65c16fafa6a and project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:29.841226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:29.845214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:29.941693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d80554f0-324b-4997-ba84-41e90a4188fa tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.985895 Oct 04 18:03:29.951999 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1984/2779] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:29.968786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65cdb498-bc7f-4940-b533-bfaa00c43f01 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: .version_select at 0x7f6340c20e50>, body: {"keypair": {"name": "tempest-keypair-1993464551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEiG9lqJm2ZBLla/H/bOrmy/hDmkIHUyn5rodVwR6572Etc7d3pWnuzzDVrlqZ62SNVf4PUSUmkgOd31yXcGUgqsL34dFG7gBsUxek//iZ4XsR6wzC7Pa0dAlET0WIVqw=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:30.036148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-65cdb498-bc7f-4940-b533-bfaa00c43f01 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:30.061549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-65cdb498-bc7f-4940-b533-bfaa00c43f01 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for user 552ac7eefa95467d9a4ba25125244af3 and project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:30.154190 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65cdb498-bc7f-4940-b533-bfaa00c43f01 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200972 Oct 04 18:03:30.155520 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1985/2780] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:03:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:30.162952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-197598680", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "451", "networks": [{"uuid": "797dd02c-a004-438a-901c-6b8011f646fa"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:30.271656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] validate_networks() for [('797dd02c-a004-438a-901c-6b8011f646fa', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:31.305056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:31.305706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:31.305953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:31.306369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:31.306781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:31.332156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.332931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.344049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.344954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.345391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.345826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.421608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:31.440583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Getting quotas for user 2f1fb61079c747799838255e355bef86 and project bc89323aab614dd882a557f0798965f3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:31.462326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:31.465193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:31.532125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b1ceb31-c409-4d4f-b171-ba9d58760f46 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375109 Oct 04 18:03:31.533158 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1986/2781] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:31.545376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5440add-518a-4360-9443-9ec69a1ca6a8", "tag": "75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:31.569324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.569811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.573202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.593186 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] Creating event network-changed:75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 for instance c5440add-518a-4360-9443-9ec69a1ca6a8 on n-h1-831193-17 Oct 04 18:03:31.616347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-02f0e352-f059-4c52-84a9-7152ba6d69cd req-d7b63e2d-3762-44cf-a8f3-df407178655d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081502 Oct 04 18:03:31.617336 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1987/2782] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:31.628938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.636450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.650021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.651369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.652530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.654219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.656691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.663114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.650516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.669728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6f47182-f2ac-483b-887a-2cce4fb4e47d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1314 microversion: 2.1 time: 1.048456 Oct 04 18:03:32.670848 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1988/2783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:32.686426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b9a5fd1-a779-48f4-a245-7e2354e1bb4c tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340d56670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.227572 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b9a5fd1-a779-48f4-a245-7e2354e1bb4c tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/554f08f6-f95d-40cc-9dc2-dca6ccc34713" status: 202 len: 0 microversion: 2.1 time: 1.554288 Oct 04 18:03:34.229120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1989/2784] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:32 2022] DELETE /compute/v2.1/os-security-groups/554f08f6-f95d-40cc-9dc2-dca6ccc34713 => generated 0 bytes in 1558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:34.340389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a796e9-5022-4e86-8046-109cc15ae3f9", "tag": "004dca21-3e72-4e5a-9966-e8bfab04e633"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:34.368511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.369616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.370120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.383615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] Creating event network-changed:004dca21-3e72-4e5a-9966-e8bfab04e633 for instance 35a796e9-5022-4e86-8046-109cc15ae3f9 on n-h2-831193-17 Oct 04 18:03:34.389368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ceb7850b-2cc4-472d-ab5c-8fdbcb98f921 req-e6025840-0fb0-4f8f-a7de-31a50ddcfa90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155250 Oct 04 18:03:34.390290 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1990/2785] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:34.396478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.397254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.414974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.415603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.417083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.418619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.419331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.419973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.830758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.844513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad10eb88-5065-4c42-82dc-2d5d10da08dd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1315 microversion: 2.1 time: 0.452717 Oct 04 18:03:34.845399 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1991/2786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:34.850312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.855515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.870171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.872462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.873218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.873967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.874440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.874876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.015263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.043051 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-280fa429-d1ea-4a72-b3a7-1a5ca79cef90 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1283 microversion: 2.1 time: 0.193869 Oct 04 18:03:35.044020 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1992/2787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.061014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.062406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.072273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.072793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.073267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.075229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.075724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.076170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.114531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:35.234012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.253991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f23fee9c-de10-4b18-995a-e3bd5edb21a0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1278 microversion: 2.1 time: 0.208491 Oct 04 18:03:35.259290 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1993/2788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.265298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5440add-518a-4360-9443-9ec69a1ca6a8", "name": "network-vif-plugged", "status": "completed", "tag": "75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:35.281252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.281916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.282515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.297521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] Creating event network-vif-plugged:75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 for instance c5440add-518a-4360-9443-9ec69a1ca6a8 on n-h1-831193-17 Oct 04 18:03:35.319901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4ed29cad-21bc-407d-8eb8-21ffb6b3994c req-5598ceee-c8de-478b-8851-192d028877f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059028 Oct 04 18:03:35.320542 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1994/2789] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:35.332628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.336975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.366757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.367598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.368489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.369474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.371669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.372924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.886895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.895608 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a34de61-97ce-43d9-9692-121e86638592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1314 microversion: 2.1 time: 0.567166 Oct 04 18:03:35.896202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1995/2790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.909426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58507fc9-af3d-4498-bde6-b0620ae7138d tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6345ca7af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.149599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58507fc9-af3d-4498-bde6-b0620ae7138d tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cfc29236-f962-4adb-ae90-466064167910" status: 202 len: 0 microversion: 2.1 time: 0.243840 Oct 04 18:03:36.150866 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1996/2791] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:35 2022] DELETE /compute/v2.1/os-security-groups/cfc29236-f962-4adb-ae90-466064167910 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:36.240372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f5f017-8641-4a5c-a172-a8756c9fbb5d", "tag": "9fa7e558-819c-404b-a928-b7ec0fed69d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:36.273974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.273974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.273974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.287121 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] Creating event network-changed:9fa7e558-819c-404b-a928-b7ec0fed69d4 for instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d on n-h2-831193-17 Oct 04 18:03:36.294383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7dbebb26-6dd1-46fd-a9d6-0a9deced9ea0 req-e44d6806-edca-464b-a4ec-5bf6ba708fa2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141806 Oct 04 18:03:36.295647 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1997/2792] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:36.301825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.303134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:36.311720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.312452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.313242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.314201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.314956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.315798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.493872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.503826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4675c83e-18c6-4ddd-85d6-b5a991f464ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1315 microversion: 2.1 time: 0.204135 Oct 04 18:03:36.503826 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1998/2793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:36 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:36.507967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.508711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:36.515721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.516346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.516868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.517653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.518125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.518567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.661412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.670041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce31b812-37c9-43a8-89cf-7e31184fc9d4 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1325 microversion: 2.1 time: 0.166688 Oct 04 18:03:36.670423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 1999/2794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:36 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:36.675132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42a0ab19-0b40-4dd5-baeb-6bc68591131d tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340d5fb80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:37.362108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42a0ab19-0b40-4dd5-baeb-6bc68591131d tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9073a9cd-86d0-4ba7-b751-597b19396604" status: 202 len: 0 microversion: 2.1 time: 0.689883 Oct 04 18:03:37.362108 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2000/2795] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:36 2022] DELETE /compute/v2.1/os-security-groups/9073a9cd-86d0-4ba7-b751-597b19396604 => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:37.366747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:37.367385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:37.394411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.396474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.397250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.399116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.401024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.403836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.998289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:38.010704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd4857d1-7f78-4fc5-83c4-5219bfa37c80 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1320 microversion: 2.1 time: 0.647414 Oct 04 18:03:38.013646 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2001/2796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:37 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:38.022562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab978cd-e254-42dd-a4f8-cf877b56d826", "tag": "1bbd37ce-b327-4d7f-aa71-23960fc34183"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:38.048701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.049202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.049652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.087680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] Creating event network-changed:1bbd37ce-b327-4d7f-aa71-23960fc34183 for instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 on n-h1-831193-17 Oct 04 18:03:38.095007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-14992a39-8ec8-4eab-a84d-487c634523c7 req-e64badf7-c51a-48ce-80e8-5cd8b610929c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079431 Oct 04 18:03:38.096469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2002/2797] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:38.135797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1893251720", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e7eb701-da0d-4e1f-8568-c130a1a6f34f"}], "security_groups": [{"name": "tempest-securitygroup--1332946079"}], "key_name": "tempest-keypair-1993464551", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:38.197205 n-d-831193-17 devstack@n-api.service[128770]: Exception ignored in: . at 0x7f6340d3bc10> Oct 04 18:03:38.197685 n-d-831193-17 devstack@n-api.service[128770]: Traceback (most recent call last): Oct 04 18:03:38.211149 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 04 18:03:38.211689 n-d-831193-17 devstack@n-api.service[128770]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 04 18:03:38.211858 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 04 18:03:38.212396 n-d-831193-17 devstack@n-api.service[128770]: connection_record.checkin() Oct 04 18:03:38.212540 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 04 18:03:38.212953 n-d-831193-17 devstack@n-api.service[128770]: pool.dispatch.checkin(connection, self) Oct 04 18:03:38.213092 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 04 18:03:38.213472 n-d-831193-17 devstack@n-api.service[128770]: fn(*args, **kw) Oct 04 18:03:38.213644 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 04 18:03:38.213927 n-d-831193-17 devstack@n-api.service[128770]: time.sleep(0) Oct 04 18:03:38.214076 n-d-831193-17 devstack@n-api.service[128770]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 04 18:03:38.214870 n-d-831193-17 devstack@n-api.service[128770]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 04 18:03:38.215026 n-d-831193-17 devstack@n-api.service[128770]: AssertionError: do not call blocking functions from the mainloop Oct 04 18:03:38.428606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] validate_networks() for [('1e7eb701-da0d-4e1f-8568-c130a1a6f34f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:39.748677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:39.749245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:39.749619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:39.750046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:39.750468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:39.771425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.772203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.773253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.776524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.778395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.778833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.830201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:39.836506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Getting quotas for user 552ac7eefa95467d9a4ba25125244af3 and project 3a84ce584f8e4f58a25a6129f2ed125a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:39.874273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:39.880580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:39.985343 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b0cdc85-db68-45c1-bdab-30b11edddbdf tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.887237 Oct 04 18:03:39.986030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2003/2798] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:40.025491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:40.028072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.037114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.037637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.038085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.038805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.039304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.039775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.412613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.436242 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac9be581-15e2-489a-810f-583ffde44592 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1314 microversion: 2.1 time: 0.448113 Oct 04 18:03:40.444866 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2004/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:39 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:40.450705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a796e9-5022-4e86-8046-109cc15ae3f9", "name": "network-vif-plugged", "status": "completed", "tag": "004dca21-3e72-4e5a-9966-e8bfab04e633"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:40.463559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.464772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.465397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.481908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] Creating event network-vif-plugged:004dca21-3e72-4e5a-9966-e8bfab04e633 for instance 35a796e9-5022-4e86-8046-109cc15ae3f9 on n-h2-831193-17 Oct 04 18:03:40.487735 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3d0fa8fc-2c04-4e22-97e8-e065c75bcfb2 req-5c3692ec-27e5-4d16-ba17-688cbe536db5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040682 Oct 04 18:03:40.488998 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2005/2800] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:40.497226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25b880a1-a504-493e-9d26-fcd787522e9a tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] Calling method '.version_select at 0x7f6340dee790>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.076562 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-25b880a1-a504-493e-9d26-fcd787522e9a tempest-SecurityGroupRulesTestJSON-734311836 tempest-SecurityGroupRulesTestJSON-734311836-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d763b375-d56e-4674-9557-9b38174d1c8e" status: 202 len: 0 microversion: 2.1 time: 0.586039 Oct 04 18:03:41.080949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2006/2801] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:40 2022] DELETE /compute/v2.1/os-security-groups/d763b375-d56e-4674-9557-9b38174d1c8e => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:41.085946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.086681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.088798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:41.108452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.108964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.109413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.110195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.110609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.111049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.540840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.559472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-81dc3fd6-6171-459a-8534-563351c1e978 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1503 microversion: 2.1 time: 0.477249 Oct 04 18:03:41.563775 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2007/2802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:41.575267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.576605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.596262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.597957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.598588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.600283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.601048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.602337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.976840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.009308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bcb0b87-7931-43df-95ce-ba404065c837 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1325 microversion: 2.1 time: 0.439112 Oct 04 18:03:42.014457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2008/2803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:42.025934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d3ab41-3908-42ab-b1b7-ea03f557f380", "tag": "559a78d9-1bb6-4b6d-b9a2-e67b60948967"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:42.048242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.049137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.049739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.069388 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] Creating event network-changed:559a78d9-1bb6-4b6d-b9a2-e67b60948967 for instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 on n-h1-831193-17 Oct 04 18:03:42.080200 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7a2cb66c-e113-4516-9983-13f31b05ebcd req-5771e4a1-7b12-4241-a43d-cf02b0e29b94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060419 Oct 04 18:03:42.083837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2009/2804] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:42.105584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.112166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.128800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.130533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.132904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.133836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.136314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.136929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.741988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.755811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ac1c1c8-a232-455d-826e-a845d8d7b72f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1320 microversion: 2.1 time: 0.657463 Oct 04 18:03:42.756432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2010/2805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:42 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:42.780975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.781983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.789302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.789794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.790238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.791324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.795958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.797533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.978539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.989523 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a805f3cb-a580-4742-a1d8-4c4cd6f9053d tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1296 microversion: 2.1 time: 0.232021 Oct 04 18:03:42.990111 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2011/2806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:42 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1296 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:43.038623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cf54a2-0fd7-42e5-98c7-05fb09f6d983", "tag": "85810682-5866-4809-8fa2-5f9b609f36f4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:43.059145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.059645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.060087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.089993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] Creating event network-changed:85810682-5866-4809-8fa2-5f9b609f36f4 for instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 on n-h2-831193-17 Oct 04 18:03:43.099316 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-dd7fef14-5761-48ac-965b-007767170611 req-0bcbfdde-246b-488e-ab91-8b7af29c088c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075955 Oct 04 18:03:43.100135 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2012/2807] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:43.105551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:43.113305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:43.130704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.131714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.132340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.133248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.134022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.134635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.153543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:44.172436 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6297073-4bac-42f1-bda6-bc56919e377f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1314 microversion: 2.1 time: 1.069101 Oct 04 18:03:44.172436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2013/2808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:43 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:44.178348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-174453897"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:44.178900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:44.200829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.201346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.201788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.202515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.202982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.203441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.018425 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Adding security group 129381db-c7fd-4052-aa0f-9cfdc6c054db to port 75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 Oct 04 18:03:46.229157 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12ce28b6-691d-4938-95d4-014823679c79 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/action" status: 202 len: 0 microversion: 2.1 time: 2.056682 Oct 04 18:03:46.233315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2014/2809] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:44 2022] POST /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/action => generated 0 bytes in 2061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:46.247676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab978cd-e254-42dd-a4f8-cf877b56d826", "name": "network-vif-plugged", "status": "completed", "tag": "1bbd37ce-b327-4d7f-aa71-23960fc34183"}, {"server_uuid": "95f5f017-8641-4a5c-a172-a8756c9fbb5d", "name": "network-vif-plugged", "status": "completed", "tag": "9fa7e558-819c-404b-a928-b7ec0fed69d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:46.317517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.329726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.332790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.393177 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Creating event network-vif-plugged:1bbd37ce-b327-4d7f-aa71-23960fc34183 for instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 on n-h1-831193-17 Oct 04 18:03:46.393844 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] Creating event network-vif-plugged:9fa7e558-819c-404b-a928-b7ec0fed69d4 for instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d on n-h2-831193-17 Oct 04 18:03:46.416836 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cbb23481-f38a-4356-96d1-9912c7feef8a req-94e37e7c-eb2b-4f4f-a48d-c9d4e4a12a07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.181956 Oct 04 18:03:46.418781 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2015/2810] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:46.434862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.435883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:46.458620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.464587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.466286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.475371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.480466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.482877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.095351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:47.108111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd3ffb87-6866-416a-a60c-53fcf9a81985 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1325 microversion: 2.1 time: 0.683521 Oct 04 18:03:47.108780 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2016/2811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:46 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:47.123462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:47.124095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.148793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.152592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.153323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.156483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.160099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.162925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.567728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:47.576936 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44b238f4-1d71-4de3-abea-c02e5ad321dc tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1320 microversion: 2.1 time: 0.467066 Oct 04 18:03:47.579500 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2017/2812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:47 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:47.596752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:47.597711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.606607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.610483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.611015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.611857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.612338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.612768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.649455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:48.032398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.048012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30806522-17b5-423c-9935-3d8f4bec51c9 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1364 microversion: 2.1 time: 0.462400 Oct 04 18:03:48.048664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2018/2813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:47 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.073543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.075602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.097646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.098164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.098603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.102056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.102756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.103428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.462946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.473009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04d3d5fc-b1eb-4c9d-920f-f22f7a2c7bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1314 microversion: 2.1 time: 0.414555 Oct 04 18:03:48.473922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2019/2814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.500450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-feab83ea-0f4f-4ba8-b239-80ff6240a947 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Action: 'create', calling method: .version_select at 0x7f6340dee040>, body: {"keypair": {"name": "tempest-keypair-46955100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXIMMJKtnn23eXnwJWjDB8UORim2dyUQJirp9KfNAtxqd3X5oT3g5YonndUutMhEuvbBlQPzwW2Okwwe9efnnk60TP7eiitagWyGy9rzGQYDrQPP9osRluLFANStYvqrg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:48.520149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=47 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:48.522157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-feab83ea-0f4f-4ba8-b239-80ff6240a947 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Getting quotas for project 23dde8cd7f6b49e983f986d09fd2a4b9. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:48.529693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-feab83ea-0f4f-4ba8-b239-80ff6240a947 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Getting quotas for user cafc66c317434995a863e37c450d2aca and project 23dde8cd7f6b49e983f986d09fd2a4b9. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:48.575099 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-feab83ea-0f4f-4ba8-b239-80ff6240a947 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.083442 Oct 04 18:03:48.576685 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2020/2815] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 18:03:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:03:48.583105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-355988283"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:48.583779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.592893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.593462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.593995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.594770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.596479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.596479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.925778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Adding security group f86269f5-b43c-41e3-a8e5-b72c928e5bcf to port 75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 Oct 04 18:03:49.795708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=14 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:50.091405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2124348-e5af-4de6-87b8-131b325af323 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/action" status: 202 len: 0 microversion: 2.1 time: 1.513372 Oct 04 18:03:50.092208 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2021/2816] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:48 2022] POST /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/action => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:50.102116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5440add-518a-4360-9443-9ec69a1ca6a8", "tag": "75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:50.132449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.134466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.135146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.159370 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] Creating event network-changed:75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 for instance c5440add-518a-4360-9443-9ec69a1ca6a8 on n-h1-831193-17 Oct 04 18:03:50.172003 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-50092ee5-faf9-4119-8c3a-f1e9130bdab5 req-a38fd843-7136-471c-9f21-8f1246d6840f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072965 Oct 04 18:03:50.174475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2022/2817] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:50.180449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.181238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:50.195228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.196040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.196691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.197621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.199149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.199797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.627454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.636450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-650ca17a-0917-4be2-a9aa-a01f327c414d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1325 microversion: 2.1 time: 0.459608 Oct 04 18:03:50.637199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2023/2818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:50.642133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d3ab41-3908-42ab-b1b7-ea03f557f380", "name": "network-vif-plugged", "status": "completed", "tag": "559a78d9-1bb6-4b6d-b9a2-e67b60948967"}, {"server_uuid": "75cf54a2-0fd7-42e5-98c7-05fb09f6d983", "name": "network-vif-plugged", "status": "completed", "tag": "85810682-5866-4809-8fa2-5f9b609f36f4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:50.658155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.659184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.659918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.675841 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Creating event network-vif-plugged:559a78d9-1bb6-4b6d-b9a2-e67b60948967 for instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 on n-h1-831193-17 Oct 04 18:03:50.676734 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] Creating event network-vif-plugged:85810682-5866-4809-8fa2-5f9b609f36f4 for instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 on n-h2-831193-17 Oct 04 18:03:50.688913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0f92aa8a-6ef7-4c7f-99b3-3f16b63dbb8f req-24f68102-0a61-4845-8970-baf106dbea3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050268 Oct 04 18:03:50.695465 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2024/2819] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:50.708079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.709142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:50.718908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.720067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.720822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.722383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.723111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.723840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.131680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.144850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4a6774d-b7e5-4128-961f-a009d11f5db1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1320 microversion: 2.1 time: 0.447334 Oct 04 18:03:51.145605 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2025/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1320 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.152319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.153224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.166853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.168365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.168832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.170043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.170820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.171391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.379975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.393607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5af4a4b-0a6c-47ae-ae5c-c4d255caa18b tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1364 microversion: 2.1 time: 0.246528 Oct 04 18:03:51.398444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2026/2821] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.411894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.413744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.426763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.427538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.428363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.429473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.430528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.430970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.783050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.791224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18157b60-cd0d-4c38-9556-201b34957783 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1501 microversion: 2.1 time: 0.391583 Oct 04 18:03:51.791898 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2027/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1501 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.797888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.798396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.804767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.805556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.806214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.807274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.808944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.809594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.018617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7163b39e-258a-4274-ba4c-34441dc42ba3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.225377 Oct 04 18:03:52.019244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2028/2823] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8/os-security-groups => generated 1154 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:52.036117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:52.036835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:52.049591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.050388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.051007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.052460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.053092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.053717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.213256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.221966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c1b1c69-510f-405c-a021-ae7856f9ad79 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1325 microversion: 2.1 time: 0.201505 Oct 04 18:03:52.222878 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2029/2824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:52 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:52.227619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1673404772", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4c1c8804-7c74-4e1e-86e8-2ad5e223e1d1"}, {"port": "9a386d56-83a6-40eb-a509-e49e385d342d", "tag": "port-1"}, {"port": "287d2d07-2de6-41c9-bbc7-0e81b808dd6d", "tag": "port-2"}, {"uuid": "abff5d5d-f5cd-46e5-8c37-8c9b41d637d9", "tag": "net-1"}, {"uuid": "abff5d5d-f5cd-46e5-8c37-8c9b41d637d9"}, {"uuid": "088277dc-6a5c-44a9-85b9-de6738cb21a1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "088277dc-6a5c-44a9-85b9-de6738cb21a1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5274e726-a869-487f-a793-30c9073e15f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "dbe0097b-ab22-4888-9da6-f8e420d6394b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ab96b3c9-6878-4a49-88fe-88cf71941867", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1223873973"}], "key_name": "tempest-keypair-46955100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:52.408756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] validate_networks() for [('4c1c8804-7c74-4e1e-86e8-2ad5e223e1d1', None, None, None, None, None), (None, None, '9a386d56-83a6-40eb-a509-e49e385d342d', None, None, None), (None, None, '287d2d07-2de6-41c9-bbc7-0e81b808dd6d', None, None, None), ('abff5d5d-f5cd-46e5-8c37-8c9b41d637d9', None, None, None, None, None), ('abff5d5d-f5cd-46e5-8c37-8c9b41d637d9', None, None, None, None, None), ('088277dc-6a5c-44a9-85b9-de6738cb21a1', '10.2.2.100', None, None, None, None), ('088277dc-6a5c-44a9-85b9-de6738cb21a1', '10.2.2.200', None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:55.658682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:55.659361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:55.659620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:55.660225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:55.660642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:55.674519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.675737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.678901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.679910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.682234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.682885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.733486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Getting quotas for project 23dde8cd7f6b49e983f986d09fd2a4b9. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:55.749682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Getting quotas for user cafc66c317434995a863e37c450d2aca and project 23dde8cd7f6b49e983f986d09fd2a4b9. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:55.989143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:55.992938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5274e726-a869-487f-a793-30c9073e15f2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='dbe0097b-ab22-4888-9da6-f8e420d6394b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab96b3c9-6878-4a49-88fe-88cf71941867',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:56.473448 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b0105f8-2461-4b86-8908-34f91a9bf4ac tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.249373 Oct 04 18:03:56.474645 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2030/2825] 10.222.0.33 () {62 vars in 1189 bytes} [Tue Oct 4 18:03:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 4251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:03:56.481187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:56.490308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.491152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.491789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.578712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:03:56.645390 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5eaa5ea0-5534-4ff4-9704-a46a66c466a0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d/action" status: 202 len: 0 microversion: 2.1 time: 0.168877 Oct 04 18:03:56.647280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2031/2826] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:56 2022] POST /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:56.655617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9c7c68c5-a1d9-4075-b64a-40adeb2515b3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f6340e624c0>, body: {"security_group": {"name": " tempest-securitygroup -705958175 ", "description": "tempest-description-687975468"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:56.944768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9c7c68c5-a1d9-4075-b64a-40adeb2515b3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.295507 Oct 04 18:03:56.946276 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2032/2827] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:03:56 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:56.960549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:56.967118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:56.995661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.998472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.998472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.998472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.003570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.004052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.258039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.269733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26c74fde-0da8-442c-a714-47b418d1be1e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1512 microversion: 2.1 time: 0.321950 Oct 04 18:03:57.270336 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2033/2828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:56 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.302125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b1da11-20b7-4aa4-a317-d6bb0db9027c", "tag": "587acfa3-030c-46d7-9652-30925db16335"}, {"name": "network-changed", "server_uuid": "c5440add-518a-4360-9443-9ec69a1ca6a8", "tag": "75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:57.334224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.334926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.335674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.373297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Creating event network-changed:587acfa3-030c-46d7-9652-30925db16335 for instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c on n-h1-831193-17 Oct 04 18:03:57.373968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] Creating event network-changed:75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 for instance c5440add-518a-4360-9443-9ec69a1ca6a8 on n-h1-831193-17 Oct 04 18:03:57.388283 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ef77c348-202e-4242-af14-42610c3c7b99 req-dcfa7613-ae2c-492a-ac12-576f1077e39f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.095049 Oct 04 18:03:57.395202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2034/2829] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:57.411614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.412674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.438106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.442366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.446480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.456694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.457470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.459436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.732501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.744517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ee1a79d-c23a-4d2a-9f95-80891d72f465 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1364 microversion: 2.1 time: 0.347140 Oct 04 18:03:57.750104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2035/2830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.766400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.767669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.787531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.789115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.790617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.793124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.795283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.795934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.207442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.215968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e32d1587-7344-4567-869a-609382c4825d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.464303 Oct 04 18:03:58.216986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2036/2831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.241111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b1da11-20b7-4aa4-a317-d6bb0db9027c", "name": "network-vif-plugged", "status": "completed", "tag": "587acfa3-030c-46d7-9652-30925db16335"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:58.251065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.251551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.251980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.265049 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] Creating event network-vif-plugged:587acfa3-030c-46d7-9652-30925db16335 for instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c on n-h1-831193-17 Oct 04 18:03:58.271984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-82e84e82-8c70-4593-a6c4-7c52aba2de5d req-212160e4-6ec2-4330-9ca4-6ffa0c3bbd4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052863 Oct 04 18:03:58.273144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2037/2832] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:58.282262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.283230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.321848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.322704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.325436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.327345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.328663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.330871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.536947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.550413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.561975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.564135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a60c992d-2285-4aef-8718-8b684ec25e6e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1574 microversion: 2.42 time: 0.289639 Oct 04 18:03:58.564831 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2038/2833] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1574 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:58.570205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.571948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.580686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.581536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.582668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.583549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.584311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.584842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.730160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.738706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e8b7cfa-28a1-4f65-89a1-d8029dfd99b0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.172626 Oct 04 18:03:58.739587 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2039/2834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.745997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-03d67046-184b-4d85-91a6-0b0311e46962 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345ca4700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.254111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-03d67046-184b-4d85-91a6-0b0311e46962 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0" status: 200 len: 222 microversion: 2.1 time: 0.512747 Oct 04 18:03:59.256228 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2040/2835] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 => generated 222 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:59.266885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.269055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.289875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.290397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.291367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.293556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.294343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.299373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.305561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:59.739754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.756330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee3923cc-fb98-422a-8e2a-0f226aad7852 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1511 microversion: 2.1 time: 0.498567 Oct 04 18:03:59.757131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2041/2836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:59.894868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Action: 'create', calling method: .version_select at 0x7f6340c20a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:59.952759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Getting quotas for project ff2966a5b87d489e9e94aeb38266d2c5. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:59.965834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Getting quotas for user 48b9f8e2d2c8432aa98f38e950dfbf6c and project ff2966a5b87d489e9e94aeb38266d2c5. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:59.970567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:00.021695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Getting quotas for project ff2966a5b87d489e9e94aeb38266d2c5. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:00.029729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Getting quotas for user 48b9f8e2d2c8432aa98f38e950dfbf6c and project ff2966a5b87d489e9e94aeb38266d2c5. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:00.047502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2427dc6-ea86-46d2-93a4-5aea7caa0c08 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.288993 Oct 04 18:04:00.055814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2042/2837] 10.222.0.33 () {62 vars in 1214 bytes} [Tue Oct 4 18:03:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:00.061498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.062380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.071270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.071780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.072228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.073050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.073864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.074305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.540476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.550958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c993a02-bb2d-4f59-ae4b-eeacc604fbdb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.493647 Oct 04 18:04:00.563107 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2043/2838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:00.563107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.563107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.588596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.589868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.590472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.595409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.595983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.596435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.915090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.926827 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cbcc5d9-32fa-4b15-9d58-4b5b143641ae tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1550 microversion: 2.1 time: 0.372621 Oct 04 18:04:00.933816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2044/2839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1550 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:00.952145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af20a3ae-04ee-439c-944d-e0dce5e59011 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f634255d160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.769360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af20a3ae-04ee-439c-944d-e0dce5e59011 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0" status: 202 len: 0 microversion: 2.1 time: 0.833986 Oct 04 18:04:01.771855 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2045/2840] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:04:00 2022] DELETE /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:01.779648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.780606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.801217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.802054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.805188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.809890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.822689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.824609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.501141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.515480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.522570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.526941 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a62ea2ac-f36e-432f-be44-8074ac67ffb7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1660 microversion: 2.42 time: 0.753137 Oct 04 18:04:02.528888 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2046/2841] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:01 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1660 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:02.545313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.554550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.564797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.570647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.571157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.572120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.577603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.578454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.427083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.435523 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-def0190b-f3eb-4c0a-b096-fec39b5ce8df tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.905355 Oct 04 18:04:03.440300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2047/2842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:03.445263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.450886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.461046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.471186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.471937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.472870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.473531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.473953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.765879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.785155 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd11e7fc-38ad-46e0-a919-df13fa09e795 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 200 len: 1512 microversion: 2.1 time: 0.343487 Oct 04 18:04:03.796036 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2048/2843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:03.802990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c21f9f9c-76c2-4cd6-b324-100ec5c10853 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.828708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c21f9f9c-76c2-4cd6-b324-100ec5c10853 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030455 Oct 04 18:04:03.830088 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2049/2844] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:03.840401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbe00442-e909-4ed7-a63d-1c3787ccf225 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2135338272", "metadata": {"": ""}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbe00442-e909-4ed7-a63d-1c3787ccf225 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action HTTP/1.1 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 107 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2135338272", "metadata": {"": ""}}} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2135338272', 'metadata': {'': ''}}}} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:03.848068 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:03.853819 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:03.856627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbe00442-e909-4ed7-a63d-1c3787ccf225 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:03.859633 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbe00442-e909-4ed7-a63d-1c3787ccf225 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action" status: 400 len: 170 microversion: 2.1 time: 0.026071 Oct 04 18:04:03.863813 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2050/2845] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 18:04:03 2022] POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action => generated 170 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:04.315614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.316671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.326314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.326931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.327470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.328418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.329086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.329690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.468197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbd9641e-9935-4795-92ab-ec36bca6f600 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.604522 Oct 04 18:04:04.483378 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2051/2846] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-interface => generated 285 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:04.497858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345cefb80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.598492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:04.599661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group ec4f327f-7daf-421a-a05d-06459bab3fd0 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:04:04.601839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.601839 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 HTTP/1.1 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ec4f327f-7daf-421a-a05d-06459bab3fd0'} Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:04.605631 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-0a15ce6c-e5dc-4f92-ba33-2e90b3ed4389'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2dde99b-ee00-4ae5-876e-0ac415241f6b tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0" status: 404 len: 194 microversion: 2.1 time: 0.121342 Oct 04 18:04:04.611091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2052/2847] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:04.621744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.630269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.649815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.650521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.651674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.652548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.653164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.655466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.068990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.078633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.084326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.089840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-686c874f-98ca-43d1-9830-c70b9b506215 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1754 microversion: 2.42 time: 0.470929 Oct 04 18:04:05.090952 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2053/2848] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1754 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:05.095948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.110121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.111970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:05.140096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.140486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.146030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.147424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.148094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.149027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.329120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:05.412024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.419818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.420523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.421127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.857064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54ad3a19-bace-4097-b74a-0335ee489dd1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.764758 Oct 04 18:04:05.857716 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2054/2849] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:05.880837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42158a92-37ac-46c3-88b0-ffdf44a02188 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.901609 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42158a92-37ac-46c3-88b0-ffdf44a02188 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549" status: 200 len: 235 microversion: 2.64 time: 0.024470 Oct 04 18:04:05.907967 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2055/2850] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549 => generated 235 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:05.916656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.918515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.928326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.928832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.929486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.930365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.930986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.931610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.160426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.168621 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cc7a9b5-0c26-49b3-8ad1-caf1610fa247 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.265093 Oct 04 18:04:06.172243 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2056/2851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:06.177063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.181701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.193005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.197034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.199536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.201681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.202321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.204273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.516172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.537623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-53b477a0-e56e-4d85-9c5c-55de5cbffdee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.364099 Oct 04 18:04:06.540721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2057/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:06.564395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd90f106-639c-41db-95b2-7670144365d1 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f6340c18dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2021970689", "description": "tempest-description-1060477744"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.321950 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd90f106-639c-41db-95b2-7670144365d1 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.778324 Oct 04 18:04:07.323890 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2058/2853] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:04:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.329104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.335450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.336512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-831807955', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:07.343315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.344216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.344897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.346214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.347261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.347971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.493767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:07.592956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.600851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.602265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.603201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.808868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6c3b341-80d8-401f-9793-eacfd6b234a7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-831807955" status: 200 len: 1514 microversion: 2.1 time: 0.483820 Oct 04 18:04:07.809938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2059/2854] 10.222.0.33 () {58 vars in 1261 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-831807955 => generated 1514 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:07.815124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e26322c1-57fc-4c15-98a5-be2585bfef5b tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.894164 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e26322c1-57fc-4c15-98a5-be2585bfef5b tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549" status: 204 len: 0 microversion: 2.64 time: 0.082048 Oct 04 18:04:07.894791 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2060/2855] 10.222.0.33 () {60 vars in 1307 bytes} [Tue Oct 4 18:04:07 2022] DELETE /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:07.910201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b1da11-20b7-4aa4-a317-d6bb0db9027c", "tag": "587acfa3-030c-46d7-9652-30925db16335"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.942550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.946942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.948561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.974743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] Creating event network-changed:587acfa3-030c-46d7-9652-30925db16335 for instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c on n-h1-831193-17 Oct 04 18:04:07.989561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3b6a9b9a-f6e5-421c-ae2f-4956ef73cded req-5baf7be4-a781-4041-9d51-806439f8026f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090497 Oct 04 18:04:07.990539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2061/2856] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.999971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.001005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.009379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.014249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.015080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.016226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.016925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.017890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.473895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.487377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.489555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.491377 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0fc13674-ca83-476c-9ed1-c7dc63cedbd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1848 microversion: 2.42 time: 0.499229 Oct 04 18:04:08.492628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2062/2857] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1848 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:08.499158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.500744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.508123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.509061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.509764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.511345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.512069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.513529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.929648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.940477 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6b037754-373d-4224-9058-224eb23914cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.446083 Oct 04 18:04:08.942013 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2063/2858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:08.947329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0af8e8d7-275d-4fa6-9220-762357196f81 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f6345d5f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1521676221", "description": "tempest-description-828678882"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.455169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0af8e8d7-275d-4fa6-9220-762357196f81 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.511066 Oct 04 18:04:09.455725 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2064/2859] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:09.471153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.471790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.478897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.480561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.481004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.481709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.482662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.483130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.693822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.702442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-944698df-934f-417e-ae6e-ef0ddff54537 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.245639 Oct 04 18:04:09.703065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2065/2860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:09.716160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.722542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.724010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:09.730478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.731193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.731655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.732549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.732999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.733423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.844488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:09.849882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:09.925205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.933004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.933799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.934492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.219348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fe10bf87-c6d3-4bef-9920-425a6c4d50a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.514152 Oct 04 18:04:10.220590 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2066/2861] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:10.226196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01559bdd-ac16-4405-bcfe-e8526286f0a6 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.237966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-01559bdd-ac16-4405-bcfe-e8526286f0a6 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] HTTP exception thrown: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01559bdd-ac16-4405-bcfe-e8526286f0a6 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Request method failure captured: Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549 HTTP/1.1 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWNnGPWHdwfVRDEJyXvxa224BSo3jB0v5ETM4ymFEVIAB3duYHThFrvZBJjRUQaO32GZmyBEw_Ns3hOTDPbjyvhNYKPUql52Gg6XrzDE-YqflPgneRwnXZTP-S-DrmseYjbyNPUnlk633IkAMcxLsyJAGSCerxGui9oxDyEYwl99Ew Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ff2966a5b87d489e9e94aeb38266d2c5 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerGroup264TestJSON-501834304 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff2966a5b87d489e9e94aeb38266d2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff2966a5b87d489e9e94aeb38266d2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff2966a5b87d489e9e94aeb38266d2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff2966a5b87d489e9e94aeb38266d2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerGroup264TestJSON-501834304 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ff2966a5b87d489e9e94aeb38266d2c5 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerGroup264TestJSON-501834304 Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerGroup264TestJSON-501834304-project Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 48b9f8e2d2c8432aa98f38e950dfbf6c Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerGroup264TestJSON-501834304-project Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7a272f85-e44a-40e6-bc5e-c219b827b549'} Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.264949 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. Oct 04 18:04:10.270894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.273093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01559bdd-ac16-4405-bcfe-e8526286f0a6 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] Returning 404 to user: Instance group 7a272f85-e44a-40e6-bc5e-c219b827b549 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:10.274974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01559bdd-ac16-4405-bcfe-e8526286f0a6 tempest-ServerGroup264TestJSON-501834304 tempest-ServerGroup264TestJSON-501834304-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549" status: 404 len: 117 microversion: 2.64 time: 0.053213 Oct 04 18:04:10.275797 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2067/2862] 10.222.0.33 () {60 vars in 1307 bytes} [Tue Oct 4 18:04:10 2022] DELETE /compute/v2.1/os-server-groups/7a272f85-e44a-40e6-bc5e-c219b827b549 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:10.282774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ac7b234-fd43-4956-a94c-b1a4327ea29d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-945628028", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ac7b234-fd43-4956-a94c-b1a4327ea29d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action HTTP/1.1 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 618 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-945628028", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-945628028', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:10.287950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:10.291313 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:10.297185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ac7b234-fd43-4956-a94c-b1a4327ea29d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:10.298314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ac7b234-fd43-4956-a94c-b1a4327ea29d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action" status: 400 len: 938 microversion: 2.1 time: 0.021355 Oct 04 18:04:10.299404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2068/2863] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:10.311520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89049e62-b97f-4f03-899f-c05996fbb0ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f63416ddee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1265781691", "description": "tempest-description-1208448873"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.715847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89049e62-b97f-4f03-899f-c05996fbb0ff tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.414033 Oct 04 18:04:10.717910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2069/2864] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:10.727183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.728027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:10.738982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.739562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.740040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.740779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.741238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.741670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.065610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.084040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.085735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.087144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-418f4ae9-b5d7-421f-9688-e9481814c32a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1869 microversion: 2.42 time: 0.368075 Oct 04 18:04:11.087816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2070/2865] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:10 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1869 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:11.108103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "7fb21bea-b1f2-4e11-88c6-51799235d44a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:11.120512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.122404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.123462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.153968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] Creating event network-changed:7fb21bea-b1f2-4e11-88c6-51799235d44a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:11.164942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-66cc561d-824a-48d7-ac49-22387a8c65a5 req-cc8cf62c-50ae-4ea1-a22d-954d05046999 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072371 Oct 04 18:04:11.168200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2071/2866] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:11.177870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:11.194825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.195454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.servers [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Removing options 'limit' from query {{(pid=128770) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:04:11.196622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:11.206273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.206771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.207243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.207980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.209396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.209877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.251184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.258139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.258636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.259095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.021547 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2da3f0ab-cbd2-4683-9b31-e7cc8769a41f tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.850899 Oct 04 18:04:12.023692 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2072/2867] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 18:04:11 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:12.029359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.030628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.045450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.046894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.052162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.053147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.055001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.056137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.407632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.416945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e26ce69-0282-4ddb-96c4-4d152ef0574a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.391908 Oct 04 18:04:12.417541 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2073/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:12.456297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.456297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.470800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.471333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.472085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.473028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.473492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.473896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.951334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.960492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bab1819-89ca-4a07-9418-14df13ac4ca6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.525043 Oct 04 18:04:12.981037 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2074/2869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.004590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cb05a8a-e9be-4787-8eb2-aa10dc164fd7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345d5f1f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.926513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cb05a8a-e9be-4787-8eb2-aa10dc164fd7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.943398 Oct 04 18:04:13.927501 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2075/2870] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.933074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.950172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.950907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:13.966450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.966940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.967455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.968179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.968823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.969357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.002676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:14.037826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d0e8859-25df-469c-9961-6cf2b5b2f4a1 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.108944 Oct 04 18:04:14.038824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2076/2871] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.051119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.052283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.060674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.061491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.062360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.064569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.067163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.068013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.767189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.788806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.790738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.792817 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5389dcf-1ede-4eae-b7a0-9e01f735d6a8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1890 microversion: 2.42 time: 0.752540 Oct 04 18:04:14.810246 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2077/2872] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1890 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:14.816645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.817537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.826673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.827482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.828124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.829094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.832311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.833129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.149657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.160773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cd00d7b-8c9c-4037-b9c3-1d5eb857ca83 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.348442 Oct 04 18:04:15.175821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2078/2873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:15.180823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "9a386d56-83a6-40eb-a509-e49e385d342d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:15.202046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.203128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.203787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.232883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] Creating event network-changed:9a386d56-83a6-40eb-a509-e49e385d342d for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:15.246168 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-58bbba23-b074-4ea9-9b59-69fa24b78fd5 req-5609bae2-b7fe-4894-aa58-43de68172678 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068774 Oct 04 18:04:15.247424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2079/2874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:15.256867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51d5e3bc-9255-4ba7-b1dd-9462304b73be tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6342560b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.211811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51d5e3bc-9255-4ba7-b1dd-9462304b73be tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03" status: 202 len: 0 microversion: 2.1 time: 0.961978 Oct 04 18:04:16.213371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2080/2875] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:04:15 2022] DELETE /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03 => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:16.219173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.220025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.240422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.241607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.242151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.243980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.251524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.251524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.552212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.562666 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70131bb0-bd24-47fb-b4a5-f045705af294 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1511 microversion: 2.1 time: 0.348123 Oct 04 18:04:16.566885 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2081/2876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:16.579333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.611900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.615056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.servers [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Removing options 'limit' from query {{(pid=128770) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:04:16.617462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:16.633269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.635951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.638167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.641249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.642740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.644177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.696622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:16.756125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9aa6a45a-9dc8-4770-93c2-f882fc96261a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.182981 Oct 04 18:04:16.759171 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2082/2877] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:16.771505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bbbd6de-48cd-461b-a016-69811390c7b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bbbd6de-48cd-461b-a016-69811390c7b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action HTTP/1.1 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 285 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.778907 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bbbd6de-48cd-461b-a016-69811390c7b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bbbd6de-48cd-461b-a016-69811390c7b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action" status: 400 len: 619 microversion: 2.1 time: 0.020292 Oct 04 18:04:16.782466 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2083/2878] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 18:04:16 2022] POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:16.787723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.788433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.801414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.802282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.802874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.803998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.804534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.805076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.332070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.350086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.356090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.358840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d9e26a1-c553-4817-8de4-8badc542510d tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1890 microversion: 2.42 time: 0.574345 Oct 04 18:04:17.367168 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2084/2879] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1890 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:17.372642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f63416bb310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.415897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:17.417099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 836275f0-c190-4ae8-bb21-0da7e417fe03 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:04:17.417624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.417624 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03 HTTP/1.1 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '836275f0-c190-4ae8-bb21-0da7e417fe03'} Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:17.419876 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-525463e0-4286-473a-8840-ed5bd261c6b8'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-700b02e8-8c71-4be8-b6a6-a07f3b7df2ad tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03" status: 404 len: 194 microversion: 2.1 time: 0.052648 Oct 04 18:04:17.424468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2085/2880] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:17.429508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.435854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.436531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:17.450773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:17.462680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.463108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.464737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.465727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.466472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.467128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.504783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:17.544344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-98deaea6-54f3-4f08-9b60-3d84610f56f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.120989 Oct 04 18:04:17.545763 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2086/2881] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers => generated 1010 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.572332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.575253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.597245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.599922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.600372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.603491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.604163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.604603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.918662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.930422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5cd62e05-7196-4c2c-964b-c59d61ad05b0 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.383040 Oct 04 18:04:17.933402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2087/2882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.939567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "287d2d07-2de6-41c9-bbc7-0e81b808dd6d"}, {"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "20938216-0411-47c1-b277-44f94db5f660"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:17.954952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.956152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.956899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.981690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Creating event network-changed:287d2d07-2de6-41c9-bbc7-0e81b808dd6d for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:17.982460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] Creating event network-changed:20938216-0411-47c1-b277-44f94db5f660 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:17.992601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-041f7f98-c547-4dc2-97f6-636fe7cd3952 req-0a283d9b-d0da-4866-9bc0-a57951dd2470 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057411 Oct 04 18:04:17.993168 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2088/2883] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:18.001563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-223312fe-e0f3-4314-9b97-791e91caac8c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6341c41280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.720336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-223312fe-e0f3-4314-9b97-791e91caac8c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef" status: 202 len: 0 microversion: 2.1 time: 0.725390 Oct 04 18:04:18.721914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2089/2884] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:04:17 2022] DELETE /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:18.731344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.747801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.751347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:18.767417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.768451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.769253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.770265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.771002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.771683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.066281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:19.235129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63962319-5d50-4b22-827d-084c553fa3eb tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.511771 Oct 04 18:04:19.236817 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2090/2885] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:19.242596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.243940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.251581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.252522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.253219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.254701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.255558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.256699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.279305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:19.789799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.803955 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a710a277-8c33-4344-9775-0b371be0997d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1488 microversion: 2.1 time: 0.560796 Oct 04 18:04:19.805221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2091/2886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1488 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:19.810759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.837824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.853299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.854339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.854792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.861250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.868312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.868880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.393384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:20.410199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-508def09-b08a-45d3-880a-40b67b6775ab tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.602642 Oct 04 18:04:20.411247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2092/2887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.451674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.452780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.466480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.467409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.468225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.469268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.469962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.473418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.232839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.247738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.253828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.260471 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a2b032d-117e-48d2-bd83-773ad2aad9ab tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1890 microversion: 2.42 time: 0.833385 Oct 04 18:04:21.261690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2093/2888] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1890 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:21.263502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=25 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:21.274935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6341a4f940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.337682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:21.338904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 9d22549d-4132-43f3-839e-244f47f87fef not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:04:21.339479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.339479 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef HTTP/1.1 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9d22549d-4132-43f3-839e-244f47f87fef'} Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:21.341723 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-95e9417f-bc82-4ca6-bacd-f7be74e5d0e5'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce97d8e4-b8fc-46b6-828e-2fc792f53c87 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef" status: 404 len: 194 microversion: 2.1 time: 0.080354 Oct 04 18:04:21.356005 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2094/2889] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:21.368013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.380442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.381127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.servers [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Removing options 'limit' from query {{(pid=128770) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:04:21.384955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:21.422686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.423504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.424199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.426514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.427855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.428440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.436676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:21.478638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1557644b-89fd-462b-a1ea-e0cdc68fbff2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.129706 Oct 04 18:04:21.480416 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2095/2890] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:21.491493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:21.495768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.506147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.507972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.509164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.511466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.512507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.513494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.578888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-024e789f-77d2-4f1d-9af1-345cc070211d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 200 len: 170 microversion: 2.1 time: 0.095893 Oct 04 18:04:21.580697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2096/2891] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:21 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 170 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:21.589046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "2baf4bf3-9054-4a77-a75e-67ca9f036b08"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:21.608193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.608973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.609990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.637587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] Creating event network-changed:2baf4bf3-9054-4a77-a75e-67ca9f036b08 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:21.643319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a2eaeeb2-8421-4f14-8954-7b0cb14ca2ef req-a38b0e32-71f8-4f61-9db5-7b3bd6412aca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060983 Oct 04 18:04:21.644526 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2097/2892] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:21.650702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1116479617"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:21.653677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.660370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.661115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.661948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.663620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.664546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.665052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.922760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f30d37c1-7358-497f-8626-2196e3caa7ae tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action" status: 202 len: 0 microversion: 2.1 time: 0.276606 Oct 04 18:04:21.924716 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2098/2893] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:21 2022] POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:04:21.930689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e732bbb0-5c76-400d-990e-33308de24cdf tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6341a5f5e0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.597974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e732bbb0-5c76-400d-990e-33308de24cdf tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee" status: 202 len: 0 microversion: 2.1 time: 0.671734 Oct 04 18:04:22.599106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2099/2894] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:04:21 2022] DELETE /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:22.604737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.615311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.616071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-831807955', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:22.630381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.630875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.645709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.646721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.647740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.648390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.846045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:22.999461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8df1347-4d66-48ce-a24e-a400f2cb1b56 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-831807955" status: 200 len: 345 microversion: 2.1 time: 0.398818 Oct 04 18:04:23.008918 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2100/2895] 10.222.0.33 () {58 vars in 1240 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-831807955 => generated 345 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:23.018730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.036257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.043441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.043945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.044390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.045116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.045573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.046005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.433423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.443847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b51f10e1-a4c4-4b0f-8ab0-6d87717dcdfb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.440789 Oct 04 18:04:23.446070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2101/2896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:23.452215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2053772911"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:23.455382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.463649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.465025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.465751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.467380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.468115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.468770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.570432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Cannot 'createImage' instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 while it is in task_state image_snapshot Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action HTTP/1.1 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 85 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2053772911"}} Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'createImage' instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 while it is in task_state image_snapshot Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2053772911'}}} Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:04:23.574210 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 while it is in task_state image_snapshot Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 while it is in task_state image_snapshot Oct 04 18:04:23.579127 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.582035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 409 to user: Cannot 'createImage' instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 while it is in task_state image_snapshot {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:23.583581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3defdf19-cb48-49ab-a46c-424118eeb736 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action" status: 409 len: 159 microversion: 2.1 time: 0.136010 Oct 04 18:04:23.588379 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2102/2897] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:23 2022] POST /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380/action => generated 159 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:23.597097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.601358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.611321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.611994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.612561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.613557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.614135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.615418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.376088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.389884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.392727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.394417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7824507d-964f-4e14-a2c6-3b169ba22c36 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.801344 Oct 04 18:04:24.406094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2103/2898] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:24.420811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6341c413a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.504831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:24.505091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:04:24.506071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.506071 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee HTTP/1.1 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f8db41ce-ad15-4bfa-8d0d-31fcfde70dee'} Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:24.508132 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-02730245-cbdd-408e-9d4b-aa23e1cef296'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.519009 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-25a9233b-e0a3-4a6e-b746-17a8bd1ee6ec tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee" status: 404 len: 194 microversion: 2.1 time: 0.103123 Oct 04 18:04:24.526814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2104/2899] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.528584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.537755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.538259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.538702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.570044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:04:24.658220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fde50a53-81d3-431f-8f3f-ee3ea7475b97 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "POST /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9/action" status: 202 len: 0 microversion: 2.1 time: 0.133185 Oct 04 18:04:24.662419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2105/2900] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:24 2022] POST /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:24.992514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.993345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.001962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.002505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.002944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.003712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.004166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.004587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.523965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.536181 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ccd0674-bd57-4ae8-a012-e08b1c5723ab tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.868098 Oct 04 18:04:25.537726 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2106/2901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:25.544415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4764566-28da-4e4f-9d72-03c97f367984 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f6345e28940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.739760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4764566-28da-4e4f-9d72-03c97f367984 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/images/b1ad68d1-0c35-460f-8e66-681b6b4c5f66" status: 204 len: 0 microversion: 2.1 time: 0.200411 Oct 04 18:04:25.741457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2107/2902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:25 2022] DELETE /compute/v2.1/images/b1ad68d1-0c35-460f-8e66-681b6b4c5f66 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:25.750804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "0624cb6e-d0b6-46b1-8938-44b05d9f569a"}, {"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "a449186f-440d-420b-93bc-a22bf6415010"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:25.761931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.762729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.763421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.778964 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Creating event network-changed:0624cb6e-d0b6-46b1-8938-44b05d9f569a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:25.779815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] Creating event network-changed:a449186f-440d-420b-93bc-a22bf6415010 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:25.785176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9eda0e60-1815-48e1-8cdf-7dac06923367 req-df8f8eaf-bcd0-424e-8baf-5f7bc57da247 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038287 Oct 04 18:04:25.787451 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2108/2903] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:25.793901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6e6ddf7-fb98-4bdb-b796-d75920d41c37 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f63416dd4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.415670 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6e6ddf7-fb98-4bdb-b796-d75920d41c37 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.626178 Oct 04 18:04:26.428955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2109/2904] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:26.440575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.442286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.456913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.457942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.458528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.460851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.460851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.460851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.186149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.197914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4354c7b4-1f99-4b90-abd9-81b91a9a4817 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1521 microversion: 2.1 time: 0.766956 Oct 04 18:04:27.199132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2110/2905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.205671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.206542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.215206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.216017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.216686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.217657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.218367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.218990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.652007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.678973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.700004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.701675 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37df7632-9203-4a85-86ef-6b8f3524e553 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.500715 Oct 04 18:04:27.703237 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2111/2906] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:27.710587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.711436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.737480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.741575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.743984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.748112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.748944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.751981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.829841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:28.148384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.164393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42c73e6c-f396-42f4-925c-d3c54774e378 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.459014 Oct 04 18:04:28.183234 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2112/2907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:28.193654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.196133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.204225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.204991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.205716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.206943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.207670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.208322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.494325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.508088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fb4bdfd-3242-43de-a85b-7a147e02398a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1535 microversion: 2.1 time: 0.322523 Oct 04 18:04:28.510156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2113/2908] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1535 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:28.518107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-835223b4-85b6-4aab-bc09-152c650dc78c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f63419ab670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2028239891", "description": "tempest-description-530151923"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:28.927836 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-835223b4-85b6-4aab-bc09-152c650dc78c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.415983 Oct 04 18:04:28.930255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2114/2909] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:04:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:29.041491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d3ab41-3908-42ab-b1b7-ea03f557f380", "name": "network-vif-plugged", "status": "completed", "tag": "559a78d9-1bb6-4b6d-b9a2-e67b60948967"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:29.058457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.059363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.060048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.072290 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] Creating event network-vif-plugged:559a78d9-1bb6-4b6d-b9a2-e67b60948967 for instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 on n-h1-831193-17 Oct 04 18:04:29.078832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-950467d2-d8c3-4155-b97b-61cb1c83bab1 req-22e66334-8074-40a6-83f6-85187e68bba4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145588 Oct 04 18:04:29.080322 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2115/2910] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:29.154020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-894217133", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:29.223661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] validate_networks() for [('d8be636a-741f-47ca-884f-9633e131fe0f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:29.881517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:29.882090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:29.883712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:29.884802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:29.887783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:29.901641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.903627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.904991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.906786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.907573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.908250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.939015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Getting quotas for project d0c8895b11a64131a64c7dcdb783fa25. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:29.952315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Getting quotas for user 7e2507e2df594e41a43db4c4d8c58807 and project d0c8895b11a64131a64c7dcdb783fa25. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:29.983865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:29.986591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:30.070543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-460a597d-f6fc-4837-bbff-fa128ea67c80 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988747 Oct 04 18:04:30.073025 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2116/2911] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:30.079589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.080832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.090816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.091983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.092815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.093802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.094440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.095082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.386447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.395676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-085a8848-1db9-4615-a3c6-ae651aedaa69 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.321088 Oct 04 18:04:30.397567 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2117/2912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:30.404448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.405590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.419625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.421744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.423845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.424328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.424865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.425703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.706976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.722423 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b46148bb-686f-4209-9f4f-755a6c68f9a2 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1521 microversion: 2.1 time: 0.323498 Oct 04 18:04:30.723121 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2118/2913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:30.752910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.752910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.763129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.764001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.764462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.765192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.765658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.766091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.254344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.267208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.269306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.270876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31ff2717-865e-4857-98eb-b340eabe5974 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.529665 Oct 04 18:04:31.271522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2119/2914] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:31.280508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a485c99-b4da-406f-b3c2-8691ef5537e5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f63418bedc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1498140336", "description": "tempest-description-366038829"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:31.948438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a485c99-b4da-406f-b3c2-8691ef5537e5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.675572 Oct 04 18:04:31.969038 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2120/2915] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:04:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:31.983670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.987679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:32.002529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.003590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.005566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.007320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.008159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.008956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.303368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.313434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2a6d9d7-63d7-4076-a614-602712811fca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1523 microversion: 2.1 time: 0.342592 Oct 04 18:04:32.314022 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2121/2916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:32.319138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:32.320156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:32.329455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.329957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.330395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.331557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.332209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.332708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.444445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.455602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7495a7b-99d7-4570-a1a6-064288d56dd3 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1281 microversion: 2.1 time: 0.140238 Oct 04 18:04:32.456191 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2122/2917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:32 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:32.461066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-229340483", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "89fe5a7e-7761-4d04-bb95-deb9053990c0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:32.527332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] validate_networks() for [('89fe5a7e-7761-4d04-bb95-deb9053990c0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:33.340174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:33.341800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:33.342560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:33.343365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:33.344256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:33.356977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.357534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.358168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.359175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.359631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.360053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.380749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:33.389315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:33.405419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:33.408313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:33.486260 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-380a29ff-4a21-437b-ae79-de7182b2cde8 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028982 Oct 04 18:04:33.487258 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2123/2918] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:33.492394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.493560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.501698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.502443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.502943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.503940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.504408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.504838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.760030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.769991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72f784ee-91a3-41bf-aa1c-2b50f169d633 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1521 microversion: 2.1 time: 0.281454 Oct 04 18:04:33.770889 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2124/2919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.777138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-54479578", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "87eee9de-3ed4-48dc-80c8-b4e41df1fa4b"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:33.851987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] validate_networks() for [('87eee9de-3ed4-48dc-80c8-b4e41df1fa4b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:34.724537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:34.729205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:34.729524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:34.730619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:34.731538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:34.746652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.747359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.756414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.757271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.757766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.758248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.778311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Getting quotas for project ffd16dad7b5c41b0b24c0046311ca93e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:34.784278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Getting quotas for user 8dd1ef50fcfe4ec9840921305d16dea5 and project ffd16dad7b5c41b0b24c0046311ca93e. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:34.787017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:34.803699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:34.806323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:34.872689 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e86a3d12-34f3-4560-8990-3a72fb059da5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100238 Oct 04 18:04:34.873345 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2125/2920] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:34.878171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.878770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.889917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.890749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.891520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.892729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.893473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.894189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.212270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.227598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.237796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.239440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1abd3179-3738-48b9-b698-935051a7f752 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.364922 Oct 04 18:04:35.240255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2126/2921] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:35.247005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.249775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.269471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.269989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.270497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.271461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.273196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.273634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.318666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:35.468766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2584a4a6-e7e6-4d30-a6ca-984f34cbd8ca tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 204 len: 0 microversion: 2.1 time: 0.226526 Oct 04 18:04:35.470408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2127/2922] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:35 2022] DELETE /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:35.480579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.482015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.495343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.500561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.502374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.504099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.505429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.506524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.902210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.928237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6398232-a61b-441f-b631-3939dee4185e tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1323 microversion: 2.1 time: 0.455451 Oct 04 18:04:35.929200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2128/2923] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:35.943826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.951578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.966328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.966952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.967538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.972526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.973370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.973993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.073652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.084958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ff1d517-6f27-4086-9534-9fdc0b8d7a60 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1272 microversion: 2.1 time: 0.154206 Oct 04 18:04:36.086323 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2129/2924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.091728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6", "tag": "27e6a80f-49ce-49c8-b94b-6d417abe5c95"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:36.106662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.107199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.107818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.121754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] Creating event network-changed:27e6a80f-49ce-49c8-b94b-6d417abe5c95 for instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 on n-h1-831193-17 Oct 04 18:04:36.128267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-675567c7-7b07-42a5-9f5d-1e64b218ee2d req-9cadce15-9b89-4122-a8ed-a4df7d3399d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040267 Oct 04 18:04:36.129522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2130/2925] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:36.137057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.138019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.146057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.147008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.147689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.148644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.149382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.150020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.470172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.496203 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-810629d6-efe0-458a-8e82-1ccb7a445c57 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1498 microversion: 2.1 time: 0.365085 Oct 04 18:04:36.496801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2131/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1498 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.502508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.503436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.530684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.531220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.531691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.532414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.532878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.533298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.603952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.607939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:36.613014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a7e118e-bbaa-4565-aeeb-822dc31cfd11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1266 microversion: 2.1 time: 0.114954 Oct 04 18:04:36.613616 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2132/2927] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.618918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.619691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.627207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.627684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.628156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.628868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.629326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.629760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.797774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.828558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c03f0dc-6465-4e19-97ca-a5a44617cda9 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1529 microversion: 2.1 time: 0.212309 Oct 04 18:04:36.839990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2133/2928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1529 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.867791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d3ab41-3908-42ab-b1b7-ea03f557f380", "name": "network-vif-unplugged", "status": "completed", "tag": "559a78d9-1bb6-4b6d-b9a2-e67b60948967"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:36.879518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.880007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.880557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.903310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] Creating event network-vif-unplugged:559a78d9-1bb6-4b6d-b9a2-e67b60948967 for instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 on n-h1-831193-17 Oct 04 18:04:36.909511 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b53e2478-0c13-49dc-ae50-0d2ee449a77f req-97206f93-f882-4458-96e6-74a1753856a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067966 Oct 04 18:04:36.910110 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2134/2929] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:36.916968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.917671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.924411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.924919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.925358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.926097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.926549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.926971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.527614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.540175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.542093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.543639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9012b059-e34c-4f02-8de6-6a8a31879156 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.632162 Oct 04 18:04:37.559064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2135/2930] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:37.560351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.566510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.568779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:37.577635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.578546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.579057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.579999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.580890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.581539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.617585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:37.693877 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34a4f536-6c9e-4b0e-a65b-6536b7d91dda tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.138449 Oct 04 18:04:37.695136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2136/2931] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:37.701097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.702304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.719144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.723051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.723540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.724309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.724793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.725673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.052347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.072562 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14b1a2e3-d6c1-4e63-bd88-fa0548a18574 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1323 microversion: 2.1 time: 0.376090 Oct 04 18:04:38.074004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2137/2932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.081030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.084122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.095665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.096597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.097237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.098561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.099852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.101741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.515368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.530102 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7900bd5-f006-4060-9cf5-5e6265a20fba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1314 microversion: 2.1 time: 0.453858 Oct 04 18:04:38.555444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2138/2933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.569407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.575058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.593604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.594400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.595099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.596200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.596861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.601576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.113383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.123341 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce17b810-a2f1-4497-9f67-ff47bda8d153 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1314 microversion: 2.1 time: 0.564670 Oct 04 18:04:39.124227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2139/2934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:39.129314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:39.137407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.138217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.138841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.176485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Going to try to start instance {{(pid=128770) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:04:39.235749 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61d0d3a8-e718-4c6d-9f1b-01d258253430 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "POST /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9/action" status: 202 len: 0 microversion: 2.1 time: 0.109650 Oct 04 18:04:39.236736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2140/2935] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:39 2022] POST /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:39.246680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.247876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.258430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.259978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.261404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.262939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.264031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.265825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.877247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.886154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1feb3b6c-2453-45cc-9acd-0a4695ebca49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 200 len: 1529 microversion: 2.1 time: 0.647264 Oct 04 18:04:39.886756 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2141/2936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 1529 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:39.911131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ad4c6-bf45-4578-a62c-21033d53afa8", "tag": "2486f8ae-516e-4c10-882f-28ced930e64f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:39.939339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.943924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.945439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.980164 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] Creating event network-changed:2486f8ae-516e-4c10-882f-28ced930e64f for instance 307ad4c6-bf45-4578-a62c-21033d53afa8 on n-h1-831193-17 Oct 04 18:04:39.997050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8d2ab425-47a2-44bf-9ccd-31943c0cd130 req-fb30a478-c072-4762-819f-131955ade388 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089722 Oct 04 18:04:40.001881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2142/2937] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:40.007626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.008578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.023456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.024255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.024703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.025979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.026438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.026875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.435583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.456060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.459450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.461158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59973aaa-29e7-4281-841e-2dc6367af873 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.457866 Oct 04 18:04:40.462347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2143/2938] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:40.469985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.470924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.480697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.481605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.482274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.483257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.483935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.484583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.028164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.037846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0631dd6-1d1a-4348-b3b5-47ab0f541323 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1323 microversion: 2.1 time: 0.572811 Oct 04 18:04:41.051532 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2144/2939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1323 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.059849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.062050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.071351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.072004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.073072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.074081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.074689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.075462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.333348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.342647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1fa72d4f-165f-40e4-bd33-0051267040f4 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1507 microversion: 2.1 time: 0.289803 Oct 04 18:04:41.357525 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2145/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.357525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.357525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.357525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.357525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.358985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.359444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.360000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.360520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.709823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.725135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc562962-eec6-422d-bed4-074203eba55d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1314 microversion: 2.1 time: 0.379951 Oct 04 18:04:41.727959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2146/2941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.738909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.739957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.760693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.764224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.764764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.767379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.770195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.770784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.092468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.106060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c86553b4-4aa4-4af6-8754-62ccdb6e1f02 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1314 microversion: 2.1 time: 0.372079 Oct 04 18:04:42.115575 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2147/2942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:42.129267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.132656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.166606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.168607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.169092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.170408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.174336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.175363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.194743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 HTTP/1.1 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380'} Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:42.196861 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:42.202931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:42.204743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-530d696f-b880-44a4-b1cf-8ff523a22344 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 404 len: 111 microversion: 2.1 time: 0.085285 Oct 04 18:04:42.211968 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2148/2943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:42.211968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88", "tag": "f7fac86d-e955-4d18-ac96-a7aea4a3cdcc"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.221656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.222152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.222592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.237565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] Creating event network-changed:f7fac86d-e955-4d18-ac96-a7aea4a3cdcc for instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 on n-h2-831193-17 Oct 04 18:04:42.243139 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5ef60936-8928-4624-ab60-7a45ed161527 req-0d079190-83b9-41e7-ac27-1b5ce38c52d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035906 Oct 04 18:04:42.245326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2149/2944] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:42.252578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.253780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.264196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.265211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.265879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.266824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.267581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.268229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.556241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.560952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:42.570231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.571869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.573625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c44d6c5d-34d4-4038-8492-4342af4d2da1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.326812 Oct 04 18:04:42.584011 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2150/2945] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:42.584011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d3ab41-3908-42ab-b1b7-ea03f557f380", "name": "network-vif-deleted", "tag": "559a78d9-1bb6-4b6d-b9a2-e67b60948967"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.590380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.591195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.591788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.607708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] Creating event network-vif-deleted:559a78d9-1bb6-4b6d-b9a2-e67b60948967 for instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 on n-h1-831193-17 Oct 04 18:04:42.613338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e5a6a499-0fd4-4bca-9913-9adffdecefc6 req-af3920a7-c9e3-425d-a258-4b5d6bd05705 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037942 Oct 04 18:04:42.613942 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2151/2946] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:42.619648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.620800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.626833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.627360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.627825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.628752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.629427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.630636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.786245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.794825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d955451-c38a-462d-b417-40845b4c3ee6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1323 microversion: 2.1 time: 0.179325 Oct 04 18:04:42.795445 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2152/2947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:42.800345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6", "name": "network-vif-plugged", "status": "completed", "tag": "27e6a80f-49ce-49c8-b94b-6d417abe5c95"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.810873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.811406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.811976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.824123 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] Creating event network-vif-plugged:27e6a80f-49ce-49c8-b94b-6d417abe5c95 for instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 on n-h1-831193-17 Oct 04 18:04:42.833090 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7421d429-c3ed-4066-9527-d5d16278285f req-6b95a733-01b4-405b-bfe7-4dac6f3a6c33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Oct 04 18:04:42.839509 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2153/2948] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:42.845118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-285ec5d5-0c39-45a2-9f3b-1841e867c1de tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'create', calling method: .version_select at 0x7f6341a15820>, body: {"keypair": {"name": "tempest-keypair-433355275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEGNtUQdkcfbNYICCIdJNIK4tSIA90Q9ZjZcKk7XDhgQotSLOVuv5n46iLGYoQMeSvOQ48TdxmEvAkHegEdG6CTpunBxosbhoK7Pk/rtgziA7LSwj9QyHoxRStrzrRSwQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.878654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-285ec5d5-0c39-45a2-9f3b-1841e867c1de tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for project b1173e2291ed4d7db14b3f3716222447. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:42.889164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-285ec5d5-0c39-45a2-9f3b-1841e867c1de tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for user fea98bf127544d63a6f3c65c16fafa6a and project b1173e2291ed4d7db14b3f3716222447. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:42.928458 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-285ec5d5-0c39-45a2-9f3b-1841e867c1de tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087628 Oct 04 18:04:42.931892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2154/2949] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:42.948922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.949356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.957098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.957436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.957901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.958975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.959469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.959906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.212315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.224624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed7a07b4-16e4-44bc-b7bb-54ac45e8580a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1511 microversion: 2.1 time: 0.289405 Oct 04 18:04:43.225312 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2155/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.231766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.233672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.240946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.241704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.242304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.243979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.245274 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:04:43.245970 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:04:43.247826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.248456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.291722 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23ab6f89-773c-4a2b-b082-761c0dc0c726 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/ips" status: 200 len: 146 microversion: 2.1 time: 0.064338 Oct 04 18:04:43.300321 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2156/2951] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:43.307903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.309475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.317587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.318082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.318687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.319594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.320627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.321314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.919510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.932062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47e880d4-03fd-448e-8ea5-02cf6f968434 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1314 microversion: 2.1 time: 0.629990 Oct 04 18:04:43.934034 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2157/2952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.953496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.955451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.964207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.966188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.966901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.967967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.968606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.969672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.316777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.331021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e5ce500-4075-4a86-9b14-37969fdf23eb tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1314 microversion: 2.1 time: 0.394239 Oct 04 18:04:44.335047 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2158/2953] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:44.346169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.359874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.361701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.servers [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Removing options 'limit' from query {{(pid=128770) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:04:44.363937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:44.369588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.371727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.373779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.374797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.378577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.379328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.381314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39136467-3d96-40a9-a2de-69ce37b9a1b5 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044983 Oct 04 18:04:44.386252 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2159/2954] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:44.393471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.398431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.433456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.439452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.440189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.441413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.442223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.442973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.777919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.796417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.800807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.802127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f2620603-8f51-49f1-a2ff-0e8402188ace tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.414665 Oct 04 18:04:44.804355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2160/2955] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:44.835684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.836501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.846432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.847791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.848842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.850060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.850632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.851171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.077189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.086508 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8ba968f6-98e0-4d47-879e-52026a1f35ac tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1518 microversion: 2.1 time: 0.254984 Oct 04 18:04:45.087828 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2161/2956] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1518 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.095927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.096670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.105829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.106478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.106985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.107720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.108177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.108613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.261838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.269860 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e5d30b1-6070-442c-99fa-0eee983cd9a3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1511 microversion: 2.1 time: 0.180787 Oct 04 18:04:45.270442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2162/2957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.274998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ad4c6-bf45-4578-a62c-21033d53afa8", "name": "network-vif-plugged", "status": "completed", "tag": "2486f8ae-516e-4c10-882f-28ced930e64f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:45.286805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.287327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.287779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.299936 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] Creating event network-vif-plugged:2486f8ae-516e-4c10-882f-28ced930e64f for instance 307ad4c6-bf45-4578-a62c-21033d53afa8 on n-h1-831193-17 Oct 04 18:04:45.305263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-02ce1e6a-a20f-44f1-9e34-fff843f4898a req-bff7b144-0ac8-43c9-9857-9c855daabdb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033405 Oct 04 18:04:45.305876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2163/2958] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:45.311622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.312330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.319497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.320004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.320455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.321682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.321818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.322159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.471680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.481416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-936ef048-9f53-49f7-b436-53f1baacd257 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1314 microversion: 2.1 time: 0.173667 Oct 04 18:04:45.482006 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2164/2959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.499076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1074571388", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:45.509206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:45.557661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] validate_networks() for [('7cc2a1d3-40de-4f7f-ba18-cce7344fac7e', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:45.980693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:45.981212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:45.981772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:45.982406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:45.983125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:45.992268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.992859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.993293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.994052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.994503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.994928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.012416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:46.017793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for user fea98bf127544d63a6f3c65c16fafa6a and project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:46.030771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:46.033318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:46.081397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d27ce7a4-40f9-4de5-ba85-e78ba367e5d3 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.591497 Oct 04 18:04:46.082530 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2165/2960] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:46.092312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b054812-7d09-4943-ba1a-9895ebb2f742 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1821722210", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b054812-7d09-4943-ba1a-9895ebb2f742 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 243 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1821722210", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1821722210', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd8be636a-741f-47ca-884f-9633e131fe0f'}]}}} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:46.097940 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b054812-7d09-4943-ba1a-9895ebb2f742 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b054812-7d09-4943-ba1a-9895ebb2f742 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016869 Oct 04 18:04:46.103734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2166/2961] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:46 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:46.106741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.106741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.115283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.115569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.116024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.117265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.117637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.118215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.307082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.318128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd9dbacc-e0c6-4538-872e-a0d51f43b446 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 200 len: 1512 microversion: 2.1 time: 0.215869 Oct 04 18:04:46.331076 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2167/2962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.331654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.335645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.346777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.347509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.348269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.349310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.350016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.350571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.521468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.530822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a531b70-8cf3-47a3-bb39-0f0d768d9ca7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1314 microversion: 2.1 time: 0.210243 Oct 04 18:04:46.538431 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2168/2963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.545755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.546660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.562813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.563835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.564369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.565230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.565736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.566519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.789536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.800312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.801970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.803446 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a7929d4-497a-4a9d-9173-10cd74a48243 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.263263 Oct 04 18:04:46.804220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2169/2964] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:46.809498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf26c21-a42e-486d-8392-b964f8543a2d"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:46.811939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.826041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.829889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.830571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.831544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.832629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.833312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.102509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9dbf417d-c0b8-417c-b1f5-64273b494d30 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296858 Oct 04 18:04:47.105834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2170/2965] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:04:46 2022] POST /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:47.111761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.112920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.121707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.123106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.123831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.124798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.125485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.126159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.204336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.213437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8cd96a99-a57d-428b-8ec2-c10e1522f268 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1277 microversion: 2.1 time: 0.105413 Oct 04 18:04:47.214483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2171/2966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.219354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.219978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: 95665374-10f8-4949-ad03-e2811310a9e2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.232133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] HTTP exception thrown: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/95665374-10f8-4949-ad03-e2811310a9e2/metadata HTTP/1.1 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '95665374-10f8-4949-ad03-e2811310a9e2'} Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.240815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 404 to user: Instance 95665374-10f8-4949-ad03-e2811310a9e2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-242c4ad6-1207-4842-a671-0c6d21c7ccde tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/95665374-10f8-4949-ad03-e2811310a9e2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026918 Oct 04 18:04:47.246858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2172/2967] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/95665374-10f8-4949-ad03-e2811310a9e2/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:47.257503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.257503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.257503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.257503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.258104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.259063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.259621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.261118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.278375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:47.417231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.425436 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ceb94c6f-d909-469d-89cd-44aa3ac0f669 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1512 microversion: 2.1 time: 0.181226 Oct 04 18:04:47.426046 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2173/2968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.431432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.432308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.448946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.449635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.450080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.450789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.451415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.452013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.664977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.675155 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8928e49a-20b7-42f3-b376-8b63168d7b72 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1501 microversion: 2.1 time: 0.247419 Oct 04 18:04:47.676852 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2174/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.682288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88", "name": "network-vif-plugged", "status": "completed", "tag": "f7fac86d-e955-4d18-ac96-a7aea4a3cdcc"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:47.694491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.695492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.695944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.713557 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] Creating event network-vif-plugged:f7fac86d-e955-4d18-ac96-a7aea4a3cdcc for instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 on n-h2-831193-17 Oct 04 18:04:47.720640 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-da028215-16db-472e-8cf9-e19501ee68bb req-350bca07-bc39-4dcd-9174-39338e9d9444 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042156 Oct 04 18:04:47.726339 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2175/2970] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:47.753886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-773c754b-02b8-4bd9-acb3-6c995a6368ce tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2040613668", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-773c754b-02b8-4bd9-acb3-6c995a6368ce tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 499 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2040613668", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2040613668', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd8be636a-741f-47ca-884f-9633e131fe0f'}]}}} Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:47.766038 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-773c754b-02b8-4bd9-acb3-6c995a6368ce tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.769920 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-773c754b-02b8-4bd9-acb3-6c995a6368ce tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.039524 Oct 04 18:04:47.774293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2176/2971] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:47.780405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.788044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.789398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:47.982277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.982798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.983269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.984015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.984685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.985111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.077564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:48.158560 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63861397-4cd4-4bf6-a1bf-08c2bd4bae3a tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.385629 Oct 04 18:04:48.169990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2177/2972] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:48.176535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.177615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.184842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.185341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.186226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.186519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.187005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.187435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.395121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.405535 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e46b79ab-5e00-401a-9109-5733120d3e1c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1314 microversion: 2.1 time: 0.233896 Oct 04 18:04:48.407013 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2178/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.416623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:48.419582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.427483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.427988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.428431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.429159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.429608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.430039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.493592 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-609bcb13-8d33-445e-ae98-90e831fba0fe tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.084779 Oct 04 18:04:48.494977 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2179/2974] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:48 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:48.517367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.519182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.537942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.538615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.539227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.545836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.548260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.548830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.904685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.920680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.923217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.942104 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8983f26a-e049-4f6d-81af-bc8f1fcda3b5 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.444813 Oct 04 18:04:48.943229 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2180/2975] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:48.964195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d4f408f-1dc0-417f-9df8-f3ff895c8320 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-176896171", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d4f408f-1dc0-417f-9df8-f3ff895c8320 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 499 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-176896171", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-176896171', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd8be636a-741f-47ca-884f-9633e131fe0f'}]}}} Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:48.971006 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d4f408f-1dc0-417f-9df8-f3ff895c8320 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d4f408f-1dc0-417f-9df8-f3ff895c8320 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.028121 Oct 04 18:04:48.974512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2181/2976] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:48 2022] POST /compute/v2.1/servers => generated 689 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:48.982746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.983549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.990740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.991406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.991949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.993065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.994290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.994955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.276562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:49.296335 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5082e7e6-a416-48e6-8416-09a4e93ca636 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1511 microversion: 2.1 time: 0.322248 Oct 04 18:04:49.298337 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2182/2977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.320147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.321945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.329685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.330491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.330936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.331718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.332337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.332943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.567484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:49.583274 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37d88b71-db57-4316-9cc3-53037ebdb57d tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1325 microversion: 2.1 time: 0.280868 Oct 04 18:04:49.585041 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2183/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1325 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.599922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257ff375-9f58-40f6-a266-9d26c26f5b0b tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1995904611", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257ff375-9f58-40f6-a266-9d26c26f5b0b tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 754 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1995904611", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1995904611', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd8be636a-741f-47ca-884f-9633e131fe0f'}]}}} Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:49.612059 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:49.615537 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:49.619474 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:49.619474 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:49.623082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257ff375-9f58-40f6-a266-9d26c26f5b0b tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:49.623731 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-257ff375-9f58-40f6-a266-9d26c26f5b0b tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.034888 Oct 04 18:04:49.635290 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2184/2979] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:49 2022] POST /compute/v2.1/servers => generated 1197 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:04:49.661708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.665775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.708007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.708731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.717436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.720287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.720923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.727570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.986914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.002461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fcb2e14e-3947-44f5-ad52-4306a34de029 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 200 len: 1512 microversion: 2.1 time: 0.365658 Oct 04 18:04:50.003137 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2185/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.025313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.026523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.045436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.047611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.048971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.052445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.053023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.055757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.360684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.373515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb712a41-9208-4837-887a-e8b6d7e9e45d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1503 microversion: 2.1 time: 0.353163 Oct 04 18:04:50.376561 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2186/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.390660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:50.400855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.411777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.414725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.415540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.417035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.419897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.420536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.484383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c43fa2fe-9b12-436c-b8fb-6ca34f075526 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.103079 Oct 04 18:04:50.495148 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2187/2982] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:50 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:50.501887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59731840-d05f-4f86-92f2-6ce01693b673 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1027285651", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59731840-d05f-4f86-92f2-6ce01693b673 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 1266 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1027285651", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d8be636a-741f-47ca-884f-9633e131fe0f"}]}} Oct 04 18:04:50.508307 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1027285651', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd8be636a-741f-47ca-884f-9633e131fe0f'}]}}} Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.511560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:50.513825 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:50.515939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:04:50.515939 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:50.515939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59731840-d05f-4f86-92f2-6ce01693b673 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:50.515939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59731840-d05f-4f86-92f2-6ce01693b673 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013096 Oct 04 18:04:50.515939 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2188/2983] 10.222.0.33 () {60 vars in 1148 bytes} [Tue Oct 4 18:04:50 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:04:50.518911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8541096-213d-4706-8431-c79d52ca0c3a", "tag": "449f59d3-0906-470c-af11-acb56224d7b2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:50.544949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.545438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.545877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.558174 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] Creating event network-changed:449f59d3-0906-470c-af11-acb56224d7b2 for instance f8541096-213d-4706-8431-c79d52ca0c3a on n-h1-831193-17 Oct 04 18:04:50.563655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5440159d-c55e-4812-a876-837d1ade7082 req-38d1ef7b-ffc8-4250-ac18-22b8145ef27d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048588 Oct 04 18:04:50.564478 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2189/2984] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:50.570053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.570921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.578522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.579010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.579705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.580421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.581227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.581824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.901546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.931715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.933470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.935260 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9f164ed-5802-40c6-b543-f4fa4b58c3e8 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.369218 Oct 04 18:04:50.935893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2190/2985] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:50.941279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.942055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.949671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.950371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.950823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.951574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.952090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.952516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.097294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.106050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-739b6e01-080c-4ac0-adeb-077aa2cf4cd0 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1512 microversion: 2.1 time: 0.168806 Oct 04 18:04:51.106625 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2191/2986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.111748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2028239891"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:51.112279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.118566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.119787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.120157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.120874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.121310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.121733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.254839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Adding security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 to port f7fac86d-e955-4d18-ac96-a7aea4a3cdcc Oct 04 18:04:51.601225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a2a94ad-0d64-46b4-bba5-9be6909125c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action" status: 202 len: 0 microversion: 2.1 time: 0.493256 Oct 04 18:04:51.602427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2192/2987] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:51 2022] POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:51.607913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.608430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: eea0d55c-4782-40cc-9f91-9f065665bb08] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.617648 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] HTTP exception thrown: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/eea0d55c-4782-40cc-9f91-9f065665bb08/metadata/test2 HTTP/1.1 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': 'eea0d55c-4782-40cc-9f91-9f065665bb08', 'id': 'test2'} Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:51.622100 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:51.627473 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:51.627473 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:51.627473 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. Oct 04 18:04:51.627473 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.640572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 404 to user: Instance eea0d55c-4782-40cc-9f91-9f065665bb08 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:51.641754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f73987c2-1887-45ac-9947-0b3e0497ef59 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/eea0d55c-4782-40cc-9f91-9f065665bb08/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.038440 Oct 04 18:04:51.645492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2193/2988] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/eea0d55c-4782-40cc-9f91-9f065665bb08/metadata/test2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:51.664803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.669017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.693579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.694087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.694532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.695272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.696489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.697914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.886582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.896956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-790b433a-17ce-41f8-a99b-5599b2a0af10 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1325 microversion: 2.1 time: 0.249536 Oct 04 18:04:51.898022 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2194/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.908229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.914350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.915491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:51.923275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.924059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.924672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.925609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.926082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.928460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.956394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=16 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:51.997700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:52.052492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=29 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:52.056234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.067544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.068220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.068691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.267068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-919603c8-8c16-4e0c-a646-73e97cdde409 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.367104 Oct 04 18:04:52.267677 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2195/2990] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.282585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.285001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.316181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.317308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.319751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.324206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.325767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.326311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.340861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:52.418973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc40b0c4-8b75-4880-b7a9-520a7efdcb90 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.145952 Oct 04 18:04:52.424452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2196/2991] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:52.430745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88", "tag": "f7fac86d-e955-4d18-ac96-a7aea4a3cdcc"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.448017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.448994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.449547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.473853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] Creating event network-changed:f7fac86d-e955-4d18-ac96-a7aea4a3cdcc for instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 on n-h2-831193-17 Oct 04 18:04:52.483448 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-70b41b8b-515c-4c15-9d26-178f32ca4ffc req-d11adec4-4425-49c4-afb1-8774329374b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057148 Oct 04 18:04:52.485325 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2197/2992] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:52.495159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345d5fee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.859255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use.", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:52.860095 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.860095 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 HTTP/1.1 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: exception: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '30a7b696-c5d0-431c-b93d-7e3adaf4ebd3'} Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:52.862326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 400 to user: Security Group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 in use. Oct 04 18:04:52.867419 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3a44db2c-0cb9-4d24-a170-e01ac9ebfcf4'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:52.879883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b80351f9-3a3c-4570-9e85-16f7bb55fc31 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3" status: 400 len: 185 microversion: 2.1 time: 0.391756 Oct 04 18:04:52.886719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2198/2993] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:04:52 2022] DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 => generated 185 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:52.900601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.902983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.910749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.911437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.911987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.912807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.913370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.913902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.942931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:53.043971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b77b5c5b-a893-4600-9348-4f71686add6c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 204 len: 0 microversion: 2.1 time: 0.155079 Oct 04 18:04:53.047662 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2199/2994] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:52 2022] DELETE /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:53.053399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.054298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.068245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.069116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.069756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.070814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.071532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.072185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.423419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.440505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.449643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.451158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43b5697f-1c09-470d-b84d-250823bb4cd7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.404998 Oct 04 18:04:53.452448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2200/2995] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:53.465865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.482553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.484239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:53.615112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.615820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.616470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.617781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.618413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.619078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.717533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:53.792292 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13a70475-b450-41e7-afeb-ecea18814dcf tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.332445 Oct 04 18:04:53.795367 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2201/2996] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:53.809921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:53.814866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.831588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.835532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.836198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.844827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.845888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.846501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.962529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ba18c1f-b85a-443a-952e-bc74b2d6eae6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action" status: 202 len: 0 microversion: 2.1 time: 0.164110 Oct 04 18:04:53.967137 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2202/2997] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:53 2022] POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:53.970124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.970943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.978967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.980303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.980589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.981452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.982440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.983069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.292751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.309887 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a37c1ea-5e77-4f0a-9482-34d30dc6d02b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1325 microversion: 2.1 time: 0.344390 Oct 04 18:04:54.323636 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2203/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.367525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.368869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.383907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.385241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.386133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.387789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.388453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.389058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.644971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e2507e2df594e41a43db4c4d8c58807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c8895b11a64131a64c7dcdb783fa25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.656156 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ddd3e55f-0b1e-402c-96f5-49cb0f65852c tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 200 len: 1524 microversion: 2.1 time: 0.330614 Oct 04 18:04:54.657855 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2204/2999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 1524 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.663883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.666481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.675299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.676012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.676451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.677167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.677623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.678656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.718144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f0b9665-04d9-47e2-9547-328868f126fd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.058420 Oct 04 18:04:54.721852 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2205/3000] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:54 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:54.724051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.729565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.730420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:54.736907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.737392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.738078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.738564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.739018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.739516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.836869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:54.945236 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74d361ca-760a-452b-a1b1-e9adab2d9784 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.225157 Oct 04 18:04:54.953295 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2206/3001] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.958110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.959796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.974272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.214028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.227501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a84de7ec-7111-4c6e-873b-6028b9836274 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1579 microversion: 2.1 time: 0.273078 Oct 04 18:04:55.228466 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2207/3002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1579 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.235716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.236751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.245058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.245591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.253468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.255376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.255982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.256840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.522409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.539861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.545116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.548034 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6bde025-183d-4210-86e1-13010dc0cfd6 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.318033 Oct 04 18:04:55.565860 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2208/3003] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:55.577627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.584413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.585409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:55.591018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.591566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.592024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.592927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.594018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.594645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.697992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:55.771489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d400c3df-11d6-42c1-b820-a2540d2603ce tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.204256 Oct 04 18:04:55.772510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2209/3004] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.781167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6", "name": "network-vif-deleted", "tag": "27e6a80f-49ce-49c8-b94b-6d417abe5c95"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:55.794033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.794517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.794949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.807503 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] Creating event network-vif-deleted:27e6a80f-49ce-49c8-b94b-6d417abe5c95 for instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 on n-h1-831193-17 Oct 04 18:04:55.813306 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9baf8f55-b62c-48e2-a8fa-51ba0d269c5e req-a734c810-b5d8-42b8-b9e9-47bd04091180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039428 Oct 04 18:04:55.813922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2210/3005] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:55.831955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.832467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.843815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.844938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.845389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.846167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.846666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.847163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.024694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.036565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-341ce1f7-fbdb-4c62-845b-d9b000b6e838 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1325 microversion: 2.1 time: 0.220710 Oct 04 18:04:56.045647 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2211/3006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.045647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.045647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] [instance: a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.048957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:56.054408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.055453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.056019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.057817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.058253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.059432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.066753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:56.083065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] HTTP exception thrown: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Request method failure captured: Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 HTTP/1.1 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHWrWWKAqLZR-AdXrvfuWTQvrY1mTJikyT9KALPmrurKjJHV6zj-NX8A5rb8XxRwZs9kLx0T3LkSl4ETrUBj4Dm_m-etA5fLCWjQ6rJOPaWQs-YWxkN7dPf4w9cER4XaxNqgYERf_itgP0nh3X9AAnj7Er23A8Sq5UEg-FukXKn0_hU Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d0c8895b11a64131a64c7dcdb783fa25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d0c8895b11a64131a64c7dcdb783fa25 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-558515142 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 7e2507e2df594e41a43db4c4d8c58807 Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-558515142-project Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6'} Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:56.084704 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] Returning 404 to user: Instance a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-316ee3e4-6975-42ac-b300-7faad76361a6 tempest-ServerMetadataNegativeTestJSON-558515142 tempest-ServerMetadataNegativeTestJSON-558515142-project] 10.222.0.33 "GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6" status: 404 len: 111 microversion: 2.1 time: 0.049620 Oct 04 18:04:56.097793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2212/3007] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers/a3b76dc6-c32b-4a3b-bdbe-eb606c97e5b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:56.103494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.103494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.114187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.115774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.116285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.117149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.117879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.118368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.171612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b076e64b-367d-4d4b-b0bf-7357d37ae254 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.079406 Oct 04 18:04:56.178363 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2213/3008] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:56.187358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8541096-213d-4706-8431-c79d52ca0c3a", "name": "network-vif-plugged", "status": "completed", "tag": "449f59d3-0906-470c-af11-acb56224d7b2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.205980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.206487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.206955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.223047 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] Creating event network-vif-plugged:449f59d3-0906-470c-af11-acb56224d7b2 for instance f8541096-213d-4706-8431-c79d52ca0c3a on n-h1-831193-17 Oct 04 18:04:56.232505 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0b07f87e-7da0-44b0-8858-8e3b661b912c req-f2a409c1-6255-4df7-a6c8-4ff1bc37bb16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051114 Oct 04 18:04:56.234122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2214/3009] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:56.267240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.277636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.278511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': '-831807955', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:56.297261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.297765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.298210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.298957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.303608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.304077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.437203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:56.899637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cbbb782-c089-4001-bd0f-9ea10f99b700 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-831807955" status: 200 len: 345 microversion: 2.1 time: 0.663816 Oct 04 18:04:56.908922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2215/3010] 10.222.0.33 () {58 vars in 1156 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers?name=-831807955 => generated 345 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:56.908922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.908922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.915647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.916556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.916719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.917303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.917765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.918197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.245992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.257899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1271645b-022b-499d-8b5a-f818e8b90b28 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1572 microversion: 2.1 time: 0.355116 Oct 04 18:04:57.258819 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2216/3011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1572 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:57.280153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.280575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.290154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.291257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.291733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.292511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.292988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.293456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.515451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.526070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.527780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.529067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52c1d425-9289-40e5-9227-1e5086d39b86 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.269041 Oct 04 18:04:57.529709 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2217/3012] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:57.552186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.557364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.558042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:57.563268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.563756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.564203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.564933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.565393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.565824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.662872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:57.727266 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c6f2aae-98e7-4e5f-acd3-aa87d0ff4def tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.178999 Oct 04 18:04:57.734352 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2218/3013] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:57.734352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.734352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.739669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.740174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.740622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.754145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.754145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.754145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.934296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.949916 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab3513d6-e287-4903-bb80-f31254c3c936 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1325 microversion: 2.1 time: 0.220556 Oct 04 18:04:57.950986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2219/3014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:57.961985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.969391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.975932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.976791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.977541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.978769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.979591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.982844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.066907 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-417462de-07fa-4d6f-8d8c-4a6b19dc2012 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 14 microversion: 2.1 time: 0.113901 Oct 04 18:04:58.068215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2220/3015] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:57 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:58.075594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1498140336"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.076344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:58.090258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.090457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.090738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.091577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.092040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.092993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.349958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Adding security group 59b48073-202e-4d11-97bf-0f9566efe11a to port f7fac86d-e955-4d18-ac96-a7aea4a3cdcc Oct 04 18:04:59.401815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83f4db27-639e-4cb5-88ac-94682c251ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action" status: 202 len: 0 microversion: 2.1 time: 1.332097 Oct 04 18:04:59.403550 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2221/3016] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88/action => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:59.408599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.427482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.430636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-83180795', 'deleted': False, 'project_id': 'bc89323aab614dd882a557f0798965f3'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:59.447474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.451404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.452082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.453122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.454570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.455257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.694604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:59.896034 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-304ffee9-1830-408c-8ad0-25a81c88aa1c tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-83180795" status: 200 len: 345 microversion: 2.1 time: 0.491350 Oct 04 18:04:59.896955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2222/3017] 10.222.0.33 () {58 vars in 1226 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-83180795 => generated 345 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.902488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "0624cb6e-d0b6-46b1-8938-44b05d9f569a"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "20938216-0411-47c1-b277-44f94db5f660"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "9a386d56-83a6-40eb-a509-e49e385d342d"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "a449186f-440d-420b-93bc-a22bf6415010"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.921381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.921847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.922273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.935484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Creating event network-vif-plugged:0624cb6e-d0b6-46b1-8938-44b05d9f569a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:59.935998 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Creating event network-vif-plugged:20938216-0411-47c1-b277-44f94db5f660 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:59.936502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Creating event network-vif-plugged:9a386d56-83a6-40eb-a509-e49e385d342d for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:59.937002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] Creating event network-vif-plugged:a449186f-440d-420b-93bc-a22bf6415010 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:04:59.944127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7cdc61bd-abd8-43f1-bd9e-ab2d3f793d89 req-5bd1cdea-1217-4f5f-980f-b342c49ed5f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045837 Oct 04 18:04:59.945069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2223/3018] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.952649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.953536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.966156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.966869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.967611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.968347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.969320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.969693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.328102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.354949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.362513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.365193 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e93bf03-04f9-4669-9352-9e0f8e90989f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.418799 Oct 04 18:05:00.366232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2224/3019] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:00.374041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.375145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.385451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.386612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.387826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.388819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.389512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.390824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.687258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.706813 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83cea85e-cdd1-4c93-aa2c-591efd50ef49 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1522 microversion: 2.1 time: 0.338787 Oct 04 18:05:00.714238 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2225/3020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:00.723098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.731265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.767534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.773132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.773876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.776997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.777732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.782171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.903844 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6e0f12c-d7f6-4812-b07a-39d70e2772bc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action" status: 200 len: 16399 microversion: 2.1 time: 0.187836 Oct 04 18:05:00.904613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2226/3021] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8/action => generated 16399 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:00.912192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6340ee6c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.155178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use.", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:01.156255 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.156255 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a HTTP/1.1 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: exception: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '59b48073-202e-4d11-97bf-0f9566efe11a'} Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:01.159065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] Oct 04 18:05:01.164241 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.170020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 400 to user: Security Group 59b48073-202e-4d11-97bf-0f9566efe11a in use. Oct 04 18:05:01.170020 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-91af0f42-74f2-4a50-9297-91d4ab7dfae0'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.170020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2559a9b4-a7c2-48c5-8057-5daf3a151389 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a" status: 400 len: 185 microversion: 2.1 time: 0.263233 Oct 04 18:05:01.170020 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2227/3022] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a => generated 185 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:01.179065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88", "tag": "f7fac86d-e955-4d18-ac96-a7aea4a3cdcc"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:01.192793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.193289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.193913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.209922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] Creating event network-changed:f7fac86d-e955-4d18-ac96-a7aea4a3cdcc for instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 on n-h2-831193-17 Oct 04 18:05:01.230225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d9568b26-703e-4fca-8ad4-924ba8b43676 req-7ecf3ea0-e8d6-4273-9686-9ee870478a0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055459 Oct 04 18:05:01.231846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2228/3023] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.238688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.239931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.249619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.250559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.251375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.252375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.253010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.253782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.400439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:01.586208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ba497a6-454b-4faa-b2e0-44a8c066415d tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 204 len: 0 microversion: 2.1 time: 0.352764 Oct 04 18:05:01.593836 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2229/3024] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:01 2022] DELETE /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:01.603680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.607052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.622609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.624696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.626999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.627898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.628485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.630920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.874854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.883746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5650cc9-9f31-4e7c-8f7a-d0e5def757b2 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1522 microversion: 2.1 time: 0.288168 Oct 04 18:05:01.885777 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2230/3025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:01.895415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.897068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.931404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.932207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.933300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.936128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.936897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.937557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.944736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:02.064066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:02.185407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.204766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4dd4d557-ed73-43c9-b17e-6bff22e2ef98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.317021 Oct 04 18:05:02.206221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2231/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.211255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.211994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.233014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.233527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.234040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.234823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.235364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.235858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.294463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:02.427686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f06e76a7-8730-455a-8a03-2968ed3e1a11 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 204 len: 0 microversion: 2.1 time: 0.218771 Oct 04 18:05:02.429111 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2232/3027] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:02 2022] DELETE /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:02.437644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.440551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.447941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.448882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.449504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.450730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.451249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.451700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.489176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-81eca8f5-cf08-4890-930c-4e0a19ab542f tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057961 Oct 04 18:05:02.496351 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2233/3028] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:02.502639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.503618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.510740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.511788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.512393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.513306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.513954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.514549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.908470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.922211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.923990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.925276 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42f11592-c996-4b87-8fa2-bbe67239052e tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.427491 Oct 04 18:05:02.926073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2234/3029] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:02.930714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.931978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.938906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.939462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.939907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.940649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.941111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.941544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.270568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.293404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b84e23f-b959-45f2-8ea8-e7009cb0e0d7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1518 microversion: 2.1 time: 0.366248 Oct 04 18:05:03.294309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2235/3030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1518 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:03.319200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1533303556"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:03.323160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.331091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.331894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.333929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.334918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.335595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.336230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.773664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f947b78-4ca6-4d01-815b-3bae9691ea82 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a/action" status: 202 len: 0 microversion: 2.1 time: 0.458232 Oct 04 18:05:03.775316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2236/3031] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:03 2022] POST /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:05:03.781609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "2baf4bf3-9054-4a77-a75e-67ca9f036b08"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "7fb21bea-b1f2-4e11-88c6-51799235d44a"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-plugged", "status": "completed", "tag": "287d2d07-2de6-41c9-bbc7-0e81b808dd6d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:03.793589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.794519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.796013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.826706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Creating event network-vif-plugged:2baf4bf3-9054-4a77-a75e-67ca9f036b08 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:05:03.827669 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Creating event network-vif-plugged:7fb21bea-b1f2-4e11-88c6-51799235d44a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:05:03.840600 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] Creating event network-vif-plugged:287d2d07-2de6-41c9-bbc7-0e81b808dd6d for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:05:03.854367 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d3922af9-47ce-43f3-b25b-6bf50ddc27d2 req-d83c82fc-ac0c-4f45-b7b6-b92f0acadedd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077529 Oct 04 18:05:03.857872 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2237/3032] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:03.868790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.872384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.890542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.891428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.891953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.892904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.894151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.894628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.094703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.104928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28e17e3d-2b9a-4adc-a2a1-f5118c96c5c3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.245308 Oct 04 18:05:04.105834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2238/3033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.110532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.111177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.118097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.118714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.119197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.120137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.120616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.121049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.517243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.525713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-695cc902-2685-425c-bd1e-e2117f019c3c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1647 microversion: 2.1 time: 0.419245 Oct 04 18:05:04.526309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2239/3034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1647 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.531609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.532351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.538922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.539737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.540532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.542063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.542909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.543623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.580732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bfb16f5-fd87-4bb9-9058-0389785f67b4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d" status: 200 len: 194 microversion: 2.1 time: 0.053125 Oct 04 18:05:04.581362 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2240/3035] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:04.586296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba07f2ef-76d1-4037-ab29-20ef2011a95f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f63418270d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.746099 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba07f2ef-76d1-4037-ab29-20ef2011a95f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5" status: 204 len: 0 microversion: 2.1 time: 0.163175 Oct 04 18:05:04.751805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2241/3036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] DELETE /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:04.765287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.766143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.777646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.778753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.779432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.780603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.781290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.781952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.442844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.456146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.458276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.472144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c570ffe-20e5-4368-b248-2e9e3565ffc0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1878 microversion: 2.42 time: 0.715933 Oct 04 18:05:05.472799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2242/3037] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1878 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:05.488230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.489220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.508969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.509787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.510469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.511862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.512555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.513171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.532253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.567990 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d73184b-b69e-41a4-85ca-68e52de75b83 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 1.093585 Oct 04 18:05:06.591149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2243/3038] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:06.603594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.604703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.638113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.643730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.644718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.648441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.653695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.662270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.826098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.826735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.833739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.834636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lazy-loading 'fault' on Instance uuid 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:06.989311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.004193 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce4d6d55-7f0e-4595-a103-ae43837a010e tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 200 len: 1310 microversion: 2.1 time: 0.421883 Oct 04 18:05:07.005933 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2244/3039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 1310 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.260734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1497981209", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:07.448274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:07.449459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:07.451181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:07.454533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:07.456551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:07.479551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.480908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.482045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.483954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.485274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.486367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.518889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Getting quotas for project b211967bfd394fea8c350847d5a2fe93. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:07.532954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Getting quotas for user 9dbfe0d92e4b41bc8c4bd4df83499279 and project b211967bfd394fea8c350847d5a2fe93. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:07.555553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:07.558803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:07.634241 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4853b485-4a9d-408c-942e-bf006c3a4de7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.625593 Oct 04 18:05:07.634824 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2245/3040] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:05:07.647338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fe41701-d00f-4a31-a1f6-1aa8c06c36d5 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f63418a9a60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.669889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4fe41701-d00f-4a31-a1f6-1aa8c06c36d5 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Image not found. Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fe41701-d00f-4a31-a1f6-1aa8c06c36d5 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5 HTTP/1.1 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'dc27baf1-4f83-421b-8072-d7e1d9ad82c5'} Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc27baf1-4f83-421b-8072-d7e1d9ad82c5 Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:05:07.672911 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc27baf1-4f83-421b-8072-d7e1d9ad82c5 could not be found. Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fe41701-d00f-4a31-a1f6-1aa8c06c36d5 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fe41701-d00f-4a31-a1f6-1aa8c06c36d5 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5" status: 404 len: 62 microversion: 2.1 time: 0.031722 Oct 04 18:05:07.678898 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2246/3041] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:07.686623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.688252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.697644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.698759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.699766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.700629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.701109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.701644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.743955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.745042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.745934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.746663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lazy-loading 'fault' on Instance uuid 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:07.751398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:07.812314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.824405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32b84d8d-3eb7-4212-93c2-a94642469ef4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 200 len: 1304 microversion: 2.1 time: 0.145931 Oct 04 18:05:07.847738 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2247/3042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.855720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cf54a2-0fd7-42e5-98c7-05fb09f6d983", "name": "network-vif-deleted", "tag": "85810682-5866-4809-8fa2-5f9b609f36f4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:07.871687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.872288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.872806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.885734 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] Creating event network-vif-deleted:85810682-5866-4809-8fa2-5f9b609f36f4 for instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 on n-h2-831193-17 Oct 04 18:05:07.891501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-99c9ca3c-d35b-4249-93ba-9185a70ded77 req-dfeef59a-7677-482c-bf8b-a8c47900f989 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042021 Oct 04 18:05:07.892593 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2248/3043] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:07.898755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.913112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.928804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.929840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.930556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.932443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.933252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.934492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.243368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.253599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.255142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.256548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27a38337-7a00-49f9-9619-cf669802435a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2834 microversion: 2.42 time: 0.362646 Oct 04 18:05:08.257141 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2249/3044] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2834 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:08.262536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.263172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.269236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:08.270823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.271493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.272903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.274385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.275602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.276216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.438134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.447092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b20261c-ff93-4925-a600-a427e286d2ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.188457 Oct 04 18:05:08.448534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2250/3045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:08.453549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65afbe93-ce93-4c45-8b42-246f4f86c59c"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:08.456327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.463985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.464750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.465365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.466298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.466927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.467608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.784557 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-616ada7b-3cfa-4f14-abc1-f6e54d0dcd73 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "POST /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334583 Oct 04 18:05:08.785558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2251/3046] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:05:08 2022] POST /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:08.791729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.792573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.800178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.800761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.801277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.802399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.802859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.803523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.892114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.902570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.904419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.906214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7fa8e49-b921-4c2c-94d2-48715bd47f43 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182" status: 200 len: 1330 microversion: 2.47 time: 0.119479 Oct 04 18:05:08.920030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2252/3047] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:08.930418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.934586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.942547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.943382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.944292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.945112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.945819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.946488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.087474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:09.095495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d87ab331-c887-421c-ba3f-e1651d1bd068 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1522 microversion: 2.1 time: 0.172929 Oct 04 18:05:09.096357 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2253/3048] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.100836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.101818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 75cf54a2-0fd7-42e5-98c7-05fb09f6d983] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.108161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.108661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.109101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.109813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.110268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.110696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.127981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] HTTP exception thrown: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Request method failure captured: Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 HTTP/1.1 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVkpLXE64H1EfBsi_cRtO3YMeWx9tsSgsHnS7mrHWsBzdor3EsZ7GHQuVdwXxmTkjR1bS41P8XACD9eAywmz8f9PffuY9SfocbKAAUwW1Rb0VE-f2fFNvXeBJbTWKxD5i_xF6Gv9CP5wzW8BECb9PD6jvtnAFJ0LeeVu3Iwtj9uhZ8 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc89323aab614dd882a557f0798965f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc89323aab614dd882a557f0798965f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2f1fb61079c747799838255e355bef86 Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '75cf54a2-0fd7-42e5-98c7-05fb09f6d983'} Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.129682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Returning 404 to user: Instance 75cf54a2-0fd7-42e5-98c7-05fb09f6d983 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da095289-0d0e-4481-b01f-116db0de2308 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983" status: 404 len: 111 microversion: 2.1 time: 0.034093 Oct 04 18:05:09.135600 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2254/3049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/75cf54a2-0fd7-42e5-98c7-05fb09f6d983 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:09.136876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8541096-213d-4706-8431-c79d52ca0c3a", "name": "network-vif-plugged", "status": "completed", "tag": "449f59d3-0906-470c-af11-acb56224d7b2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:09.146367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.146844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.147315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.158586 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] Creating event network-vif-plugged:449f59d3-0906-470c-af11-acb56224d7b2 for instance f8541096-213d-4706-8431-c79d52ca0c3a on n-h1-831193-17 Oct 04 18:05:09.163434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5c52a3f8-919b-4bb7-b282-723202778a72 req-c8ec34f2-22bf-4e32-a5d5-dd6db2831e10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030656 Oct 04 18:05:09.164020 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2255/3050] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:09.169421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.169886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.176510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.177031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.177468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.178368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.178697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.179165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.335137 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-299d2e33-0bb9-4531-acbe-9980e673c1c2 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.169814 Oct 04 18:05:09.336142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2256/3051] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246/os-interface => generated 1830 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:09.341462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:09.342269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.361792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.370651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.371343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.372429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.374812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.377044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.461346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Locking {{(pid=128770) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:05:09.532903 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-270fa871-b01c-43c6-b204-05ed6a08e8b1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.195329 Oct 04 18:05:09.533713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2257/3052] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:09 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:09.544124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.544840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.562180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.562721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.563181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.563906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.564486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.565027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.581814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 HTTP/1.1 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88'} Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.583721 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:09.589438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5bb87976-fe15-4302-be0f-7752ba8ca084 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 404 len: 111 microversion: 2.1 time: 0.050820 Oct 04 18:05:09.590257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2258/3053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:09.596243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1848992558", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:09.692467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:09.693130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:09.694047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:09.694550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:09.695061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:09.716394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.719530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.720269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.721289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.723448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.724224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.771639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Getting quotas for project b211967bfd394fea8c350847d5a2fe93. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:09.784339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Getting quotas for user 9dbfe0d92e4b41bc8c4bd4df83499279 and project b211967bfd394fea8c350847d5a2fe93. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:09.834742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:09.837965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:09.948643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83848d10-58aa-452e-87d3-8f7ed5ca373d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.357143 Oct 04 18:05:09.955887 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2259/3054] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:05:09.966007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.975708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.992634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.000248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.001045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.001994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.002646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.003281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.066436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:10.276200 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4b1e11e-0c7a-49d5-aa2f-854fbb56d244 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 204 len: 0 microversion: 2.1 time: 0.315812 Oct 04 18:05:10.278427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2260/3055] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:09 2022] DELETE /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:10.289980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.296540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.311236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.314010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.314558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.316531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.318203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.318677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.378634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:10.415669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:10.511830 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5ad1742-0c46-4d25-9594-c0f71c9d03d3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 204 len: 0 microversion: 2.1 time: 0.231052 Oct 04 18:05:10.512799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2261/3056] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:10 2022] DELETE /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:10.520287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.521245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.530542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.531448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.532238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.533474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.533973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.534416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.029604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.084311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6421eca7-3b92-4a8d-a2cb-eacf1485eb07 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.569391 Oct 04 18:05:11.085804 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2262/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.096425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8bce62e-91f0-41ae-ad34-0595af3434c4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6340e72310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.578893 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8bce62e-91f0-41ae-ad34-0595af3434c4 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3" status: 202 len: 0 microversion: 2.1 time: 0.490467 Oct 04 18:05:11.579933 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2263/3058] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:11 2022] DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:11.586043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88", "name": "network-vif-deleted", "tag": "f7fac86d-e955-4d18-ac96-a7aea4a3cdcc"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:11.598077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.598880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.599510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.613505 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] Creating event network-vif-deleted:f7fac86d-e955-4d18-ac96-a7aea4a3cdcc for instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 on n-h2-831193-17 Oct 04 18:05:11.621559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e9bc7a66-aaa8-4f57-b404-3359e300cb87 req-2f5388bc-28d1-4a6d-b9d0-56fbe58438d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040033 Oct 04 18:05:11.624149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2264/3059] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:11.640620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:11.643642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.653052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.653870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.654574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.655358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.655827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.656378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.705201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce96dc91-fdf2-4dad-ba3a-845011794f32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "PUT /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1048 microversion: 2.47 time: 0.071924 Oct 04 18:05:11.706593 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2265/3060] 10.222.0.33 () {62 vars in 1297 bytes} [Tue Oct 4 18:05:11 2022] PUT /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1048 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:11.711672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.712618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.721037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.722152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.722837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.724055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.725676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.726400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.918569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.927981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da587833-818c-4eff-b989-75d0127fdd15 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1528 microversion: 2.1 time: 0.220024 Oct 04 18:05:11.928782 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2266/3061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1528 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.936625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.937928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.946643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.948300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.949188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.950395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.951588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.952302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.163159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.177265 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab2409bb-22d5-46bc-ba55-f9ea7f90eeb7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 200 len: 1518 microversion: 2.1 time: 0.246945 Oct 04 18:05:12.178385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2267/3062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.189742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.201057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.201567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.202011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.263834 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action HTTP/1.1 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: {"os-stop": {}} Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9185a0f9-750a-4f7c-8f32-231bb72d2b01', 'body': {'os-stop': {}}} Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked Oct 04 18:05:12.265834 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:12.271375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 409 to user: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 is locked {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:12.271375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8d03a7a-6d2c-4c3b-8176-54f3225cbe4b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 409 len: 107 microversion: 2.1 time: 0.088098 Oct 04 18:05:12.274065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2268/3063] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 107 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:12.295361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8541096-213d-4706-8431-c79d52ca0c3a", "name": "network-vif-unplugged", "status": "completed", "tag": "449f59d3-0906-470c-af11-acb56224d7b2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.295527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.295972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.296414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.312271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] Creating event network-vif-unplugged:449f59d3-0906-470c-af11-acb56224d7b2 for instance f8541096-213d-4706-8431-c79d52ca0c3a on n-h1-831193-17 Oct 04 18:05:12.317298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f130cd64-1549-47d4-8bc7-91ce17d283b5 req-899584d0-a208-458e-a3e7-7dcf9327b408 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038263 Oct 04 18:05:12.318188 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2269/3064] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:12.324341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c5761ef-b4b0-404e-8583-a94ee3b8dfbd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345c95e50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.574041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c5761ef-b4b0-404e-8583-a94ee3b8dfbd tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a" status: 202 len: 0 microversion: 2.1 time: 0.254457 Oct 04 18:05:12.575251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2270/3065] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:12 2022] DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:12.584904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.586164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.604623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.605372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.607155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.609048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.609811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.610539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.697746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.708776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.710460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.711658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec5c99f1-91ff-4431-bf7b-55595ca5a549 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1336 microversion: 2.47 time: 0.131334 Oct 04 18:05:12.712709 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2271/3066] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1336 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:12.720002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.720895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.730654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.731400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.731839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.732543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.733105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.733537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.799212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Unlocking {{(pid=128770) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:05:12.864231 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-caeee9fc-f4bc-46c1-904d-556dba7626ba tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.150083 Oct 04 18:05:12.865635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2272/3067] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:12.872700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c7a748b-04c8-48dc-b1c2-1783dc7444af tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'create', calling method: .version_select at 0x7f6341b66b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-605831089", "description": "tempest-description-432486594"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:13.058229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c7a748b-04c8-48dc-b1c2-1783dc7444af tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.190638 Oct 04 18:05:13.059666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2273/3068] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:13.066805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:13.076850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.077427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.078040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.133168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:05:13.244858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cb5963d-083f-4ef4-bf77-f156d8d82638 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.183642 Oct 04 18:05:13.245943 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2274/3069] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:13 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:13.255220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.255701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.264188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.264726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.265182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.266053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.266354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.266838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.522367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:13.530543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70dcae6e-1e05-4f2c-9f87-7db6f38fc99b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1528 microversion: 2.1 time: 0.280271 Oct 04 18:05:13.531698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2275/3070] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1528 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:13.551287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62eda715-902c-4a8c-9e84-3cd205d4a1e6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Action: 'update', calling method: .version_select at 0x7f63416c2940>, body: {"security_group": {"name": "tempest-sg-hth-302253553", "description": "tempest-description-hth-320786043"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.005279 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62eda715-902c-4a8c-9e84-3cd205d4a1e6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9" status: 200 len: 216 microversion: 2.1 time: 0.460272 Oct 04 18:05:14.006827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2276/3071] 10.222.0.33 () {60 vars in 1290 bytes} [Tue Oct 4 18:05:13 2022] PUT /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9 => generated 216 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:14.015289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.016474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.029433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.031057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.031731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.032788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.033692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.034349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.159067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.185576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e872a55a-1454-40e2-8e69-6cdbca83abc7 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 200 len: 1476 microversion: 2.1 time: 0.176367 Oct 04 18:05:14.196209 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2277/3072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.216971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.218188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.232852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.233678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.234408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.248291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.251103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.251647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.866417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.878360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4668ec6-51ee-4ee3-b95f-1077f4c813dd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.679259 Oct 04 18:05:14.879700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2278/3073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.887593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "tag": "7fb21bea-b1f2-4e11-88c6-51799235d44a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.920661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.921431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.923964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.976233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] Creating event network-changed:7fb21bea-b1f2-4e11-88c6-51799235d44a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:05:14.993224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-11c8938a-1053-4872-bd9a-0c6448452d0d req-6ee856d2-9e7d-4613-9650-137ae656fa06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109544 Oct 04 18:05:14.999435 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2279/3074] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.015954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.018437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.038594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.039184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.041281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.042273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.043242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.045940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.072253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:15.151959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.161795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.165547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.168205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15caff52-c226-457c-922b-60f39b6281cc tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1357 microversion: 2.47 time: 0.167054 Oct 04 18:05:15.174858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2280/3075] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:15.180246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4da1fbac-1687-43af-8149-0393e2231ca6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345c95670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.347178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4da1fbac-1687-43af-8149-0393e2231ca6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9" status: 200 len: 216 microversion: 2.1 time: 0.170922 Oct 04 18:05:15.347834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2281/3076] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9 => generated 216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.356029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab978cd-e254-42dd-a4f8-cf877b56d826", "name": "network-vif-deleted", "tag": "1bbd37ce-b327-4d7f-aa71-23960fc34183"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.392917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.392917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.404531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.439295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] Creating event network-vif-deleted:1bbd37ce-b327-4d7f-aa71-23960fc34183 for instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 on n-h1-831193-17 Oct 04 18:05:15.446532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-69da3165-70bf-47d4-a75e-62f3e30a42f4 req-445f65bf-567d-4b75-8d9d-51846af79203 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097480 Oct 04 18:05:15.463961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2282/3077] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.475204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.475953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.489189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.490829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.491511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.494884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.496737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.497415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.622802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.626379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.627311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.627998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lazy-loading 'fault' on Instance uuid f8541096-213d-4706-8431-c79d52ca0c3a {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:15.676522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.689365 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b1b4642-f46c-4e45-9a59-03c3d8b70c37 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 200 len: 1315 microversion: 2.1 time: 0.223871 Oct 04 18:05:15.691886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2283/3078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.703421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.708073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.716892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.717388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.717828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.718625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.719109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.719844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.817764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:15.818183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:15.818658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:15.819086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:15.819504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:15.922146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.936426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.937401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.938213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.940207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.941627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.942883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.005196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7db31adc-1dac-4f2a-80c8-4b0d34fe3514 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "POST /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309/action" status: 202 len: 1079 microversion: 2.47 time: 0.308733 Oct 04 18:05:16.009275 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2284/3079] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309/action => generated 1079 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:05:16.015994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.016808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 2ab978cd-e254-42dd-a4f8-cf877b56d826] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.025534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.026499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.027267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.028188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.028814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.029616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.049631 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] HTTP exception thrown: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Request method failure captured: Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 HTTP/1.1 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVkpLXE64H1EfBsi_cRtO3YMeWx9tsSgsHnS7mrHWsBzdor3EsZ7GHQuVdwXxmTkjR1bS41P8XACD9eAywmz8f9PffuY9SfocbKAAUwW1Rb0VE-f2fFNvXeBJbTWKxD5i_xF6Gv9CP5wzW8BECb9PD6jvtnAFJ0LeeVu3Iwtj9uhZ8 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc89323aab614dd882a557f0798965f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc89323aab614dd882a557f0798965f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2f1fb61079c747799838255e355bef86 Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2ab978cd-e254-42dd-a4f8-cf877b56d826'} Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.051682 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. Oct 04 18:05:16.057037 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.058879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Returning 404 to user: Instance 2ab978cd-e254-42dd-a4f8-cf877b56d826 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:16.060609 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-add211c6-af2f-4158-892a-337937517423 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826" status: 404 len: 111 microversion: 2.1 time: 0.049456 Oct 04 18:05:16.061767 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2285/3080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/2ab978cd-e254-42dd-a4f8-cf877b56d826 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:16.068870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68f3d909-a2cb-41dd-913d-1a4cb0a3ac2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345d14040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.367464 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68f3d909-a2cb-41dd-913d-1a4cb0a3ac2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9" status: 202 len: 0 microversion: 2.1 time: 0.304007 Oct 04 18:05:16.376381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2286/3081] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:16 2022] DELETE /compute/v2.1/os-security-groups/f7a3f7dc-86ea-434e-a341-f139cad921e9 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:16.402887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.405517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.417300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.417921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.418562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.419432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.420028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.421032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.585191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.594778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11b7e846-b7d4-45e4-a502-86b08b5b6d28 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.216964 Oct 04 18:05:16.595650 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2287/3082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.600553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.601154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.608351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.608855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.609351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.610013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.610523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.610983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.689494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.700997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.702707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.705114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-500cfa6f-e01a-48e8-93ca-e49ac2d44980 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.108368 Oct 04 18:05:16.707109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2288/3083] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:16.710429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.710934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.731599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.732252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.732816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.733691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.734264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.734942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.767019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:16.842847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:16.869761 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cca95253-6da8-4011-bed5-991cea9b8024 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 204 len: 0 microversion: 2.1 time: 0.162817 Oct 04 18:05:16.870567 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2289/3084] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:16 2022] DELETE /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:16.876816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.877422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.883714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.889950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.891400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.891400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.891629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.892087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.907874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 HTTP/1.1 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88'} Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:16.909753 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41e8e43a-8f94-47d9-85f2-406e91b89eb0 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 404 len: 111 microversion: 2.1 time: 0.039209 Oct 04 18:05:16.915553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2290/3085] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:16 2022] DELETE /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:16.917761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.918229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.924784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.925285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.925731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.926458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.926924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.927383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.941946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a HTTP/1.1 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f8541096-213d-4706-8431-c79d52ca0c3a'} Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.943536 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d4746a1-58c9-4ca2-8306-ed9f83bb280a tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 404 len: 111 microversion: 2.1 time: 0.031902 Oct 04 18:05:16.949944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2291/3086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:16.950921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.951486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.963261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.964103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.964673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.966017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.966598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.967171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.120506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.139953 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-81fb038d-2607-42df-b83b-45489403b7d6 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1517 microversion: 2.1 time: 0.193363 Oct 04 18:05:17.140572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2292/3087] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.147690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.148326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.155786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.156288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.156925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.157456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.157919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.158357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.186853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 HTTP/1.1 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88'} Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.188462 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Instance 0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fdca6e83-a89a-4e34-b171-4cdc7cc52e2c tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88" status: 404 len: 111 microversion: 2.1 time: 0.048367 Oct 04 18:05:17.193976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2293/3088] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/0d4e1e8f-9567-4cc3-8328-bdc46e0a5b88 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:17.199375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8541096-213d-4706-8431-c79d52ca0c3a", "name": "network-vif-deleted", "tag": "449f59d3-0906-470c-af11-acb56224d7b2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:17.209257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.209740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.210175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.222359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] Creating event network-vif-deleted:449f59d3-0906-470c-af11-acb56224d7b2 for instance f8541096-213d-4706-8431-c79d52ca0c3a on n-h1-831193-17 Oct 04 18:05:17.228583 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-79e311c9-299d-462d-aae8-838d09607f6b req-ccbd5256-536b-4f11-aad3-68cb647ac6c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Oct 04 18:05:17.229556 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2294/3089] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:17.238884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1675511423", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:17.319813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] validate_networks() for [('7cc2a1d3-40de-4f7f-ba18-cce7344fac7e', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:17.754459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:17.755378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:17.755922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:17.756673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:17.757388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:17.770012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.770505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.770946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.771724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.772183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.772613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.792319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:17.798076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Getting quotas for user fea98bf127544d63a6f3c65c16fafa6a and project b1173e2291ed4d7db14b3f3716222447. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:17.812582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:17.821893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:17.878526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11941a75-b497-4bf8-bc01-d29efe02edea tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.647337 Oct 04 18:05:17.879859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2295/3090] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:17.884870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6341a151f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.913412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:17.914436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 59b48073-202e-4d11-97bf-0f9566efe11a not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:17.916542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.916542 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a HTTP/1.1 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '59b48073-202e-4d11-97bf-0f9566efe11a'} Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:17.918309 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 59b48073-202e-4d11-97bf-0f9566efe11a does not exist Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3892ce21-6ff7-498d-8833-16a21fa7602b'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3bcfd748-893d-474d-82d8-c3be5a55fee8 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a" status: 404 len: 194 microversion: 2.1 time: 0.039149 Oct 04 18:05:17.923260 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2296/3091] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:17 2022] DELETE /compute/v2.1/os-security-groups/59b48073-202e-4d11-97bf-0f9566efe11a => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:17.934706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.936627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.944722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.945226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.945673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.946617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.947116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.947544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.138599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.150090 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e1dbf228-3b73-4aa1-970f-0fa469e2d832 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.227444 Oct 04 18:05:18.150984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2297/3092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.174142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.174973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.182518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.183097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.183615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.184405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.185050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.185609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.266607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.284070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.285836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.287300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be5178e9-6f66-4b55-8074-f814840daac7 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.135046 Oct 04 18:05:18.299067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2298/3093] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:18.299067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cabb27f8-6176-4f99-a992-2d432d730991 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.299067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cabb27f8-6176-4f99-a992-2d432d730991 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.386725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cabb27f8-6176-4f99-a992-2d432d730991 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.401987 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cabb27f8-6176-4f99-a992-2d432d730991 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1225 microversion: 2.1 time: 0.112067 Oct 04 18:05:18.402863 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2299/3094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.413311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f634255dd30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.790641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:18.791285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:18.794825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.794825 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 HTTP/1.1 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '30a7b696-c5d0-431c-b93d-7e3adaf4ebd3'} Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:18.804451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 does not exist Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-88834b75-10b7-4c35-a2af-8a895acd69be'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:18.812664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce6b736b-8439-431c-a1f0-cd4dca367f3f tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3" status: 404 len: 194 microversion: 2.1 time: 0.406793 Oct 04 18:05:18.817447 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2300/3095] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:18 2022] DELETE /compute/v2.1/os-security-groups/30a7b696-c5d0-431c-b93d-7e3adaf4ebd3 => generated 194 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:18.841384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.841751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.858248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.858767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.859267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.859999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.860459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.860894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.207439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.219582 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8eaf6f1c-6d1e-43d3-a04c-5402278ecd63 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1517 microversion: 2.1 time: 0.403944 Oct 04 18:05:19.220365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2301/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1517 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.226061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345d14310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.273319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:19.274123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:19.275514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.275514 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee HTTP/1.1 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f8db41ce-ad15-4bfa-8d0d-31fcfde70dee'} Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:19.278014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group f8db41ce-ad15-4bfa-8d0d-31fcfde70dee does not exist Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-3b0696be-b5f4-445c-be93-df465f46fe09'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bd91807-6cbd-4248-9daa-6a8e16166187 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee" status: 404 len: 194 microversion: 2.1 time: 0.058225 Oct 04 18:05:19.282927 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2302/3097] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:19 2022] DELETE /compute/v2.1/os-security-groups/f8db41ce-ad15-4bfa-8d0d-31fcfde70dee => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:19.287079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.287824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.300147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.300632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.301389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.302240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.302716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.303185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.616169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.621578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:19.633588 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-683acc15-c435-4dbc-93d6-e658c3253991 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.348397 Oct 04 18:05:19.650606 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2303/3098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.662993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345d14ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.719286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:19.720197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 9d22549d-4132-43f3-839e-244f47f87fef not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:19.720858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.720858 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef HTTP/1.1 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9d22549d-4132-43f3-839e-244f47f87fef'} Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:19.723064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 9d22549d-4132-43f3-839e-244f47f87fef does not exist Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-bbde7de4-b281-47d1-93f1-ef1bc8795752'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4604754c-9d8e-43b8-93e2-d5ba5360fae3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef" status: 404 len: 194 microversion: 2.1 time: 0.075301 Oct 04 18:05:19.731698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2304/3099] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:19 2022] DELETE /compute/v2.1/os-security-groups/9d22549d-4132-43f3-839e-244f47f87fef => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:19.736311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.736964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.744538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.745496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.745933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.746963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.747545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.748303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.926194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.935329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.936927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.938465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7a5bf1a-f690-4130-aa13-58aeb48b07a1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.208729 Oct 04 18:05:19.939089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2305/3100] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:19.944260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.948071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.963820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.964353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.964803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.965538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.973658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.974461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.099856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.113602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9945e616-ba3f-4e37-9ace-28486f705879 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1283 microversion: 2.1 time: 0.172315 Oct 04 18:05:20.129573 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2306/3101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.140899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345da1040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.201980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:20.202702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group 836275f0-c190-4ae8-bb21-0da7e417fe03 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:20.203321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.203321 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03 HTTP/1.1 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '836275f0-c190-4ae8-bb21-0da7e417fe03'} Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:20.205353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group 836275f0-c190-4ae8-bb21-0da7e417fe03 does not exist Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-4e8c6a6e-34a8-4e41-ad37-c1ca3235ae2f'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f391063-9f57-4516-ba31-f366cb322cc7 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03" status: 404 len: 194 microversion: 2.1 time: 0.076321 Oct 04 18:05:20.210327 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2307/3102] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:20 2022] DELETE /compute/v2.1/os-security-groups/836275f0-c190-4ae8-bb21-0da7e417fe03 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:20.217688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a796e9-5022-4e86-8046-109cc15ae3f9", "name": "network-vif-deleted", "tag": "004dca21-3e72-4e5a-9966-e8bfab04e633"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:20.239593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.240458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.241174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.273380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] Creating event network-vif-deleted:004dca21-3e72-4e5a-9966-e8bfab04e633 for instance 35a796e9-5022-4e86-8046-109cc15ae3f9 on n-h2-831193-17 Oct 04 18:05:20.279532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b85179bf-13ab-4a5b-8cea-f3013fa60dea req-4dcc5ce9-bc83-4070-8173-5802b73b7409 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068442 Oct 04 18:05:20.280239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2308/3103] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:20.285938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345da14c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.349871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG neutronclient.v2_0.client [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist", "detail": ""}} {{(pid=128770) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:20.350780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Neutron security group ec4f327f-7daf-421a-a05d-06459bab3fd0 not found {{(pid=128770) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:05:20.351378 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.351378 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 HTTP/1.1 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: exception: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ec4f327f-7daf-421a-a05d-06459bab3fd0'} Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:20.353383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] Oct 04 18:05:20.358328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:20.362483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Security group ec4f327f-7daf-421a-a05d-06459bab3fd0 does not exist Oct 04 18:05:20.362483 n-d-831193-17 devstack@n-api.service[128770]: Neutron server returns request_ids: ['req-9d376c36-b332-4a92-bf0c-54cbb4428092'] {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:20.363416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13569ecf-a498-46dc-8e2f-8b7cb90550da tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0" status: 404 len: 194 microversion: 2.1 time: 0.081799 Oct 04 18:05:20.363987 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2309/3104] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:20 2022] DELETE /compute/v2.1/os-security-groups/ec4f327f-7daf-421a-a05d-06459bab3fd0 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:20.369746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.370483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.378350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.378838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.379376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.380097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.380551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.380974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.426802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.427633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.428326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.429089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lazy-loading 'fault' on Instance uuid 35a796e9-5022-4e86-8046-109cc15ae3f9 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:20.512429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1fb61079c747799838255e355bef86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc89323aab614dd882a557f0798965f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.522985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5dfbff9-352a-4554-981c-c740bae1d5a8 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 200 len: 1310 microversion: 2.1 time: 0.157546 Oct 04 18:05:20.523913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2310/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.530022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.531485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.540750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.541513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.542145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.543334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.543966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.544952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.587928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:20.744813 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e374321-0500-4abd-8181-eaf1db86f0b9 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 204 len: 0 microversion: 2.1 time: 0.216701 Oct 04 18:05:20.751282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2311/3106] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:20 2022] DELETE /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:20.771155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.771536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.780134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.781178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.781635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.782418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.783084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.783527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.972797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.981947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c459d0d5-db11-46bd-99a7-a06cef484c7e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.228880 Oct 04 18:05:20.982539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2312/3107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.988378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.989256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.996100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.996846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.997285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.998000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.998461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.998885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.200784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.209546 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-486db639-8834-4723-8d0b-94d2624f01c6 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1645 microversion: 2.1 time: 0.225118 Oct 04 18:05:21.210132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2313/3108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1645 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.215254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.215861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.221973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.222464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.223011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.223743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.224201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.224619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.295418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.304101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.305552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.306736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91014ebd-1a9f-461c-808d-7342eb4e178e tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.095670 Oct 04 18:05:21.307626 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2314/3109] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:21.311923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.312531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.318713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.319327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.319874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.320655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.321688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.322283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.480756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.489055 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-181a2178-ff7b-445d-bc6c-d21cb8e39828 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.180476 Oct 04 18:05:21.490030 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2315/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.557961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.558653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] [instance: 35a796e9-5022-4e86-8046-109cc15ae3f9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.565386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.565880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.566319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.567068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.567517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.568447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.583939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] HTTP exception thrown: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Request method failure captured: Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 HTTP/1.1 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVkpLXE64H1EfBsi_cRtO3YMeWx9tsSgsHnS7mrHWsBzdor3EsZ7GHQuVdwXxmTkjR1bS41P8XACD9eAywmz8f9PffuY9SfocbKAAUwW1Rb0VE-f2fFNvXeBJbTWKxD5i_xF6Gv9CP5wzW8BECb9PD6jvtnAFJ0LeeVu3Iwtj9uhZ8 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc89323aab614dd882a557f0798965f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc89323aab614dd882a557f0798965f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc89323aab614dd882a557f0798965f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: bc89323aab614dd882a557f0798965f3 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1983856736 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2f1fb61079c747799838255e355bef86 Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServerFiltersTestJSON-1983856736-project Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '35a796e9-5022-4e86-8046-109cc15ae3f9'} Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:21.585794 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] Returning 404 to user: Instance 35a796e9-5022-4e86-8046-109cc15ae3f9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:21.591531 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-629aed00-2276-41d8-9a2f-a7b7a83527f3 tempest-ListServerFiltersTestJSON-1983856736 tempest-ListServerFiltersTestJSON-1983856736-project] 10.222.0.33 "GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9" status: 404 len: 111 microversion: 2.1 time: 0.033256 Oct 04 18:05:21.592241 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2316/3111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/35a796e9-5022-4e86-8046-109cc15ae3f9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:22.005814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.006586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.023294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.023912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.024478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.025451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.025921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.026659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.355700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.372615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd63ff73-64c1-4269-9194-138bec141df0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.370941 Oct 04 18:05:22.373221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2317/3112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:22.395460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.396486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.409682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.410497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.411158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.420192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.421097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.421862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.922638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.932681 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d483d60-c0a1-4f0f-a4d4-13850b400476 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1645 microversion: 2.1 time: 0.555005 Oct 04 18:05:22.933290 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2318/3113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1645 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.962038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.962773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.985755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.986652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.988009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.989547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.990200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.990837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.183601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.210967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.213278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.218721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54a536c3-ea18-47ab-92a3-d4c77818c18b tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.276063 Oct 04 18:05:23.218721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2319/3114] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:23.221744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.223547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.236431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.237327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.239058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.240634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.241765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.243858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.706355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.719602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a20163d7-6ba9-4ab1-a35b-d400039c8e6f tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.500163 Oct 04 18:05:23.720293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2320/3115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:23.731528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.732406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.738642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.739182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.739783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.740560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.741038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.741541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.110532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.123227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c41579ff-f871-47dc-884e-0775214ef33a tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.396576 Oct 04 18:05:24.123867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2321/3116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.132729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.141575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.152288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.153495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.155069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.157029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.157839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.158582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.201492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:24.214689 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c5b78cf-1edd-455a-8272-c28a56a03deb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087829 Oct 04 18:05:24.215748 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2322/3117] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:24.243703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5440add-518a-4360-9443-9ec69a1ca6a8", "name": "network-vif-deleted", "tag": "75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:24.260113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.261848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.262491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.278542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] Creating event network-vif-deleted:75bba58a-8b0b-4bb9-bf7e-f7d8e92bb069 for instance c5440add-518a-4360-9443-9ec69a1ca6a8 on n-h1-831193-17 Oct 04 18:05:24.286002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-71de3b8a-8b4f-4ad9-ac2c-3e56fa8cc440 req-e5c83e66-2c1c-4c16-a82d-6de394faec28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068772 Oct 04 18:05:24.286626 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2323/3118] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:24.297387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.298419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.306798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.307422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.307883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.308619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.309092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.310297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.352887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.353842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.355171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.355836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lazy-loading 'fault' on Instance uuid c5440add-518a-4360-9443-9ec69a1ca6a8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:24.467631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd1ef50fcfe4ec9840921305d16dea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd16dad7b5c41b0b24c0046311ca93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.482514 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39220e6f-c5f9-42ce-ba30-438182c2cbd2 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 200 len: 1305 microversion: 2.1 time: 0.188557 Oct 04 18:05:24.484485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2324/3119] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.494293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f273801-77ea-4e1e-b703-85857e0f4cc8", "tag": "af94ca3c-4655-4723-b2e9-019fc365f565"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:24.513609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.514326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.515298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.539918 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] Creating event network-changed:af94ca3c-4655-4723-b2e9-019fc365f565 for instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 on n-h1-831193-17 Oct 04 18:05:24.551342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3b37d5d3-3f6e-49bb-9ed0-4637e9275b59 req-84e8979a-2942-4cd7-91bf-6b2d3150b2f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064899 Oct 04 18:05:24.551974 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2325/3120] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:24.558392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.559432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.566329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.567331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.567918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.568773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.569364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.569915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.689997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.703193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.705609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.707843 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2d9a29e-ad3e-42b0-9cfc-d9e7d6ca1a3c tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.153553 Oct 04 18:05:24.708768 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2326/3121] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:24.714281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.715295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.723202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.724304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.725067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.725950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.726696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.727167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.770701 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3938f9c7-6329-466c-8ca3-203519d0f2a4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d" status: 200 len: 194 microversion: 2.1 time: 0.060499 Oct 04 18:05:24.772031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2327/3122] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:24.777339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.778351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.788130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.791426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.792357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.793176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.793870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.794553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.282115 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:05:25.282698 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:05:25.457303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.470176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48cb2699-6d54-459b-9c34-c0239fdbe3b6 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.696808 Oct 04 18:05:25.483123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2328/3123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.483123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.483123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.489705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.490214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.490659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.491419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.491885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.492315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.592394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lazy-loading 'services' on Instance uuid 37b1da11-20b7-4aa4-a317-d6bb0db9027c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:25.728994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9ffef88-9324-4b13-a34f-101519022704 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d" status: 202 len: 0 microversion: 2.1 time: 0.253647 Oct 04 18:05:25.744485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2329/3124] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:05:25 2022] DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/caf26c21-a42e-486d-8392-b964f8543a2d => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:25.753491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.754206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.757990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.763384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.763735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.764178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.764897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.765768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.766207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.043549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.052864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc077275-197f-4fdf-b59e-4dae3f22256e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1654 microversion: 2.1 time: 0.306850 Oct 04 18:05:26.053741 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2330/3125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1654 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.058710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.059452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] [instance: c5440add-518a-4360-9443-9ec69a1ca6a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.065702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.066485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.067464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.068584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.069466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.070616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.096286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] HTTP exception thrown: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Request method failure captured: Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 HTTP/1.1 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVepSX1p2GHTsHyWBKvTiNXDyl7uYHYhud5jxZDz7NIGxKWl17HlavS6FDkJpPNRsAr3q-MUuJI_HummyA_GvlMXD6KbiEAC23V__WpLezu-ScMyohu-AZCTLBgw8B2t4ajhs8qG9Hgc3-w8u7pXs2c4hhzEG5GkPJM4MrUtoL6HbI Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ffd16dad7b5c41b0b24c0046311ca93e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ffd16dad7b5c41b0b24c0046311ca93e Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1645519751 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8dd1ef50fcfe4ec9840921305d16dea5 Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-SecurityGroupsTestJSON-1645519751-project Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c5440add-518a-4360-9443-9ec69a1ca6a8'} Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:26.100039 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Returning 404 to user: Instance c5440add-518a-4360-9443-9ec69a1ca6a8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-041fccf5-ff6d-4ac9-8991-759db18fd9d5 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8" status: 404 len: 111 microversion: 2.1 time: 0.049356 Oct 04 18:05:26.109419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2331/3126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/c5440add-518a-4360-9443-9ec69a1ca6a8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:26.113867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.114528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.131168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.131168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.131168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.132050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.135317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.135911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.237504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.248014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.249921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.251407 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df300fc1-4c20-4327-a649-cf812725e39a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.141799 Oct 04 18:05:26.252410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2332/3127] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:26.257299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:26.265795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.266560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.267231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.296989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Going to try to start instance {{(pid=128770) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:05:26.360996 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b831ee60-0832-4752-ad45-2846a43fb81e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.107071 Oct 04 18:05:26.365887 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2333/3128] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:26 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:26.373559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11c35b3a-749d-4f47-8be7-3024ba4b97c3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f63417f9ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.372756 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11c35b3a-749d-4f47-8be7-3024ba4b97c3 tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f86269f5-b43c-41e3-a8e5-b72c928e5bcf" status: 202 len: 0 microversion: 2.1 time: 1.004556 Oct 04 18:05:27.376976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2334/3129] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:26 2022] DELETE /compute/v2.1/os-security-groups/f86269f5-b43c-41e3-a8e5-b72c928e5bcf => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:27.384918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.385964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.394272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.395093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.396179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.397654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.398756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.400233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.780515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:27.904877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.919604 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e38b946b-3a12-43c4-914e-229717007478 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1663 microversion: 2.1 time: 0.539664 Oct 04 18:05:27.920988 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2335/3130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1663 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.927633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.928487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.939157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.960277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.961543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.963170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.965706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.968048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.393125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=20 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:28.537571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.546982 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1252e18-e093-42b5-b7ae-b15deecc60a7 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.624749 Oct 04 18:05:28.551402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2336/3131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.556999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.557871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:28.572462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.573915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.574558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.575615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.576258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.576895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.743343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.770663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.780650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.787422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46ad9581-c998-4999-857b-75603edf3ce9 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.234445 Oct 04 18:05:28.788156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2337/3132] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:28.802566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9981cd8-1f2c-4f6d-81e7-3b8fc9b2e23d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] Calling method '.version_select at 0x7f6345c84310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.676726 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9981cd8-1f2c-4f6d-81e7-3b8fc9b2e23d tempest-SecurityGroupsTestJSON-1645519751 tempest-SecurityGroupsTestJSON-1645519751-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/129381db-c7fd-4052-aa0f-9cfdc6c054db" status: 202 len: 0 microversion: 2.1 time: 0.887287 Oct 04 18:05:29.679125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2338/3133] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:28 2022] DELETE /compute/v2.1/os-security-groups/129381db-c7fd-4052-aa0f-9cfdc6c054db => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:29.687479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.688233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.695918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.697159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.697798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.705756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.706517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.707192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.082115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.092498 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8061978-fa75-4a88-a43a-a94e6a6bf4d7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.412022 Oct 04 18:05:30.097446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2339/3134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:30.112733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.115790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.133006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.136566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.138065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.139584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.142658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.143977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.614604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.632806 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d87fd7e1-76ae-4347-a5bf-4b82d3ce3a76 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.528933 Oct 04 18:05:30.635918 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2340/3135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:30.643803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.644768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.662267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.662735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.663350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.664196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.664892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.665450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.727251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:30.822409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.838948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.840662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.841932 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df201531-cda0-41e7-87ef-18dee59adca6 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.203319 Oct 04 18:05:30.842847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2341/3136] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:30.859151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.860175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.870270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.871140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.871797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.872920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.873556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.874209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.282386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.299533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd31582a-224a-41d8-b464-4ec978b6ede0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.447851 Oct 04 18:05:31.300572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2342/3137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.314249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f273801-77ea-4e1e-b703-85857e0f4cc8", "name": "network-vif-plugged", "status": "completed", "tag": "af94ca3c-4655-4723-b2e9-019fc365f565"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:31.333473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.334554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.335286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.364012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] Creating event network-vif-plugged:af94ca3c-4655-4723-b2e9-019fc365f565 for instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 on n-h1-831193-17 Oct 04 18:05:31.378061 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7587e78b-a339-40c9-a86e-8a3e3bcd95db req-d268966f-b687-4e31-8ccf-c0765f8a81ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073462 Oct 04 18:05:31.381456 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2343/3138] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:31.393254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:31.393884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.434628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.435399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.435937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.436801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.439641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.441177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.550787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Unlocking {{(pid=128770) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:05:31.631672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2741242-226f-4a95-9b2b-63c25973bd18 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.248723 Oct 04 18:05:31.636436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2344/3139] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:31 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:31.652100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.653170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.663938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.664652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.665834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.666911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.667591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.668252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.503784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.544136 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba7445b6-6be3-4490-80be-53cb91dd5902 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.892678 Oct 04 18:05:32.547762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2345/3140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.576574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.579661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.596370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.596892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.597347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.599301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.601276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.602861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.051527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.064175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21cb74f3-0bc1-4740-8000-5fa22359896e tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1325 microversion: 2.1 time: 0.506947 Oct 04 18:05:33.066834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2346/3141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.083941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.092620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.104664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.105226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.107189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.108008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.111465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.112210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.422001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.442423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.444657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.446950 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92e9256d-02e3-4198-86c7-05fe1e65a994 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.375829 Oct 04 18:05:33.448462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2347/3142] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:33.453742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.454665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.475232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.475839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.477296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.479584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.480365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.480923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.922259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.937657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62ecbf40-7e6b-4566-809f-75ef0a14fbeb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.487536 Oct 04 18:05:33.938475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2348/3143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.945627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.946188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.958006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.958822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.959479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.960375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.961003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.962165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.013138 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdb127f0-d9ab-4776-aafa-6ac7edf59ff5 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/65afbe93-ce93-4c45-8b42-246f4f86c59c" status: 200 len: 194 microversion: 2.1 time: 0.071581 Oct 04 18:05:34.014343 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2349/3144] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/65afbe93-ce93-4c45-8b42-246f4f86c59c => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:34.021427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.022329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.031469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.032664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.033854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.035329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.036529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.037473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.383897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.393579 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f55bb71f-a7a9-42e1-aaea-99f28bb1dbcc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.377102 Oct 04 18:05:34.415863 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2350/3145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.422608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.427086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.442056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.442843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.443544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.451213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.451957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.452685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.685334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lazy-loading 'services' on Instance uuid 37b1da11-20b7-4aa4-a317-d6bb0db9027c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:34.879437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c8ecd8c-7086-4904-9d93-2d8ab079b837 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/65afbe93-ce93-4c45-8b42-246f4f86c59c" status: 202 len: 0 microversion: 2.1 time: 0.459408 Oct 04 18:05:34.882880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2351/3146] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:05:34 2022] DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments/65afbe93-ce93-4c45-8b42-246f4f86c59c => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:34.908825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.910112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.955823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.956425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.963648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.964861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.965519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.966579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.804035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.817637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbb783ad-2192-4507-86e1-b2389543bc7b tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1522 microversion: 2.1 time: 0.930101 Oct 04 18:05:35.819765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2352/3147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.839521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:35.842073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.871944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.873135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.874184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.877517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.878246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.879378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.082135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-222a3fb7-5c33-4db2-99dc-e34f1c8e89f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.257991 Oct 04 18:05:36.099667 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2353/3148] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:35 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:36.126604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.127963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.149995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.151105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.156142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.158015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.159057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.159701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.706342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.710699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:36.719948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.721854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.723120 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4d0d0bc-e7a2-494a-b95a-207cb65d7e32 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.615258 Oct 04 18:05:36.742058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2354/3149] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:36.752890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.753846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.764070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.764872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.765571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.766740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.767410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.769008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.825981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:37.037680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c166af98-a090-49ad-9245-196fdad4f117 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 204 len: 0 microversion: 2.1 time: 0.294199 Oct 04 18:05:37.038788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2355/3150] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:36 2022] DELETE /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:37.048853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.049828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.057950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.061337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.061337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.061337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.061846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.062297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.491250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.504658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cd4363d-3857-40a6-b289-d5ef29581199 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1652 microversion: 2.1 time: 0.463597 Oct 04 18:05:37.515600 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2356/3151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1652 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.515600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.515600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.531885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.532388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.532830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.533538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.533998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.534425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.875941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.891834 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c364e627-620b-41d9-8f34-e254e9ed4703 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1528 microversion: 2.1 time: 0.385504 Oct 04 18:05:37.892746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2357/3152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1528 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.182997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1538660110", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:38.284388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] validate_networks() for [('27b360d5-6ad4-4265-a4f6-b437f29e4393', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:39.510023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:39.513468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:39.514339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:39.515775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:39.516465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:39.528791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.529704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.530396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.532907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.534936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.535887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.601722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Getting quotas for project 91c2761fdd7343368c59940180353f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:39.628144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Getting quotas for user 357dac18752041d2a242b03ebf31287f and project 91c2761fdd7343368c59940180353f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:39.725696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:39.739168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:39.866819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aec8cbf7-85f8-44cb-8ea5-a64a97caa436 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.972781 Oct 04 18:05:39.867510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2358/3153] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:39.917567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:39.918118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.957252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.958527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.960025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.963517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.965986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.966618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.328834 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fafa79c4-ba75-4c24-9df0-3e5509284e9f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.450215 Oct 04 18:05:40.334182 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2359/3154] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:39 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:40.349938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.354262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.374337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.374840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.375308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.376026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.376486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.376914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.488414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.498827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.500491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.501837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0a3d3aa-d577-475e-90da-6cd0bb5f2273 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.163804 Oct 04 18:05:40.502701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2360/3155] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:40.516224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.518873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.597514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.607407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.608441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.609996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.610829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.619593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.720293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.721467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.724783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.725577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lazy-loading 'fault' on Instance uuid 7f273801-77ea-4e1e-b703-85857e0f4cc8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:40.869454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea98bf127544d63a6f3c65c16fafa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1173e2291ed4d7db14b3f3716222447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.878883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5a9205bd-e0f9-4380-b86e-c5c8303b4831 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 200 len: 1315 microversion: 2.1 time: 0.374305 Oct 04 18:05:40.902667 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2361/3156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.909763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58fced1e-4df8-4395-a857-a9778b98acb4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.918628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58fced1e-4df8-4395-a857-a9778b98acb4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.034225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58fced1e-4df8-4395-a857-a9778b98acb4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.051634 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58fced1e-4df8-4395-a857-a9778b98acb4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1214 microversion: 2.1 time: 0.147254 Oct 04 18:05:41.058876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2362/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.069019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f273801-77ea-4e1e-b703-85857e0f4cc8", "name": "network-vif-deleted", "tag": "af94ca3c-4655-4723-b2e9-019fc365f565"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:41.132892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.135066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.137172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.171746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] Creating event network-vif-deleted:af94ca3c-4655-4723-b2e9-019fc365f565 for instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 on n-h1-831193-17 Oct 04 18:05:41.192864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1e9c6ae7-2efc-4702-bd40-85763a9440d8 req-2a012400-01ea-4412-a857-528811882441 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125529 Oct 04 18:05:41.200020 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2363/3158] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:41.207124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.208391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.217522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.218742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.219669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.220727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.221614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.222342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.417197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.450717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3478c67-6a5d-4292-a3e2-60d5ac8d5d8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.242492 Oct 04 18:05:41.464858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2364/3159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.502181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.504096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.543124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.546052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.547863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.553159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.558961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.560122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.890644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.910121 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-558e69a2-9432-412b-9270-391ba016b8cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.413457 Oct 04 18:05:41.951147 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2365/3160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.967355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.967979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.979592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.980100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.980551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.985343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.987219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.989057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.131664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.149523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.153588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.160229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b69970af-cacb-4d13-b4cb-ad86be07d4fe tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.206570 Oct 04 18:05:42.161469 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2366/3161] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:42.172480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.173327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: 7f273801-77ea-4e1e-b703-85857e0f4cc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.188592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.189417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.190065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.191156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.193420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.195174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.218778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 HTTP/1.1 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7f273801-77ea-4e1e-b703-85857e0f4cc8'} Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.221199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. Oct 04 18:05:42.226389 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.229484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance 7f273801-77ea-4e1e-b703-85857e0f4cc8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:42.230645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55e2d2e3-afaa-466e-8e6e-d5ff92643a07 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8" status: 404 len: 111 microversion: 2.1 time: 0.067643 Oct 04 18:05:42.236251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2367/3162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/7f273801-77ea-4e1e-b703-85857e0f4cc8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:42.243322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.244372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.251415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.252410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.253201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.260322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.261551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.262424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.498032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.540465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9168f892-321e-40bb-9909-121ca3f117ee tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.302315 Oct 04 18:05:42.541285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2368/3163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.576048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.576667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.603135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.609630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.610364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.612618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.615683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.616253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.796209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.809113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0027a1eb-d7d4-4349-a361-9703c41d1c66 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1274 microversion: 2.1 time: 0.244516 Oct 04 18:05:42.810303 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2369/3164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.832687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbea1f2d-eacd-458a-ba33-fc6803aaf163 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f6340c41280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.868167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cbea1f2d-eacd-458a-ba33-fc6803aaf163 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Image not found. Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbea1f2d-eacd-458a-ba33-fc6803aaf163 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5 HTTP/1.1 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'dc27baf1-4f83-421b-8072-d7e1d9ad82c5'} Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc27baf1-4f83-421b-8072-d7e1d9ad82c5 to delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc27baf1-4f83-421b-8072-d7e1d9ad82c5 could not be found. Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:42.876285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbea1f2d-eacd-458a-ba33-fc6803aaf163 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbea1f2d-eacd-458a-ba33-fc6803aaf163 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5" status: 404 len: 62 microversion: 2.1 time: 0.066275 Oct 04 18:05:42.881815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2370/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] DELETE /compute/v2.1/images/dc27baf1-4f83-421b-8072-d7e1d9ad82c5 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:42.896403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.897183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.903203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:42.922336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.922907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.924793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.927352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.927952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.928485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.353972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.372328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c328a667-82f3-4e72-9dac-b361da534587 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.488173 Oct 04 18:05:43.373685 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2371/3166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.391331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.392219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.406780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.407766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.409643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.410852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.412949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.418431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.449176 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a HTTP/1.1 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f8541096-213d-4706-8431-c79d52ca0c3a'} Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:43.456917 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:43.463646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.468557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:43.469824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fe5d8afb-562c-40e9-b880-4c138a9e2457 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 404 len: 111 microversion: 2.1 time: 0.094583 Oct 04 18:05:43.473335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2372/3167] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:43 2022] DELETE /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:43.482475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.488818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.500741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.505709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.506444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.507595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.508290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.509512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.517750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:43.648757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.661609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.667928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.669672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b13c9167-1ab0-4b91-8df9-fb32c8eb80ae tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.194779 Oct 04 18:05:43.674074 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2373/3168] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:43.679705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.681136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.733162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.736358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.737164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.746143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.747019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.748315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.304346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.317636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37e62505-795b-48b5-92f8-cab55734821c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.642118 Oct 04 18:05:44.320843 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2374/3169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:44.326395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.327312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: f8541096-213d-4706-8431-c79d52ca0c3a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.349527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.351690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.353715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.354708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.357029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.357642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.392599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a HTTP/1.1 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f8541096-213d-4706-8431-c79d52ca0c3a'} Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.397622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance f8541096-213d-4706-8431-c79d52ca0c3a could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:44.409091 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-432ee47f-ad14-45a9-acc2-679c520da814 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a" status: 404 len: 111 microversion: 2.1 time: 0.077048 Oct 04 18:05:44.412259 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2375/3170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/f8541096-213d-4706-8431-c79d52ca0c3a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:44.417648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.443300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.464812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.465591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.466239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.467196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.467858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.468456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.061864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.089241 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70c57cb6-8305-4e83-8239-ecafc530e644 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.675566 Oct 04 18:05:45.102031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2376/3171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.102830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.104251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.139903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.140808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.141616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.142908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.156176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.157205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.515966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.531939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0727451d-cf8d-49f1-abad-2de8b3d114f0 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.436430 Oct 04 18:05:45.533520 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2377/3172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.549475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ada086c-6616-4062-81bc-93e678868279 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f634181b280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.608146 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ada086c-6616-4062-81bc-93e678868279 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433355275" status: 202 len: 0 microversion: 2.1 time: 0.072260 Oct 04 18:05:45.608766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2378/3173] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:05:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433355275 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:45.619202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.619837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.640654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.641600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.642441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.643676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.644942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.645713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.792932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.808213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.810273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.813060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e330a26-d067-458c-bde8-fd6fc838f3d1 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.201524 Oct 04 18:05:45.814082 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2379/3174] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:45.831725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.843437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.872807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.873347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.873822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.874910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.877314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.877878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.924341 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9a012ca-023c-4dc1-8662-757385c6b625 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106931 Oct 04 18:05:45.925222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2380/3175] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:05:46.081986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.085208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.093873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.094390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.094956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.096042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.097187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.098135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.176073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0c07f27-e485-4c31-8e37-85abcaf38a93 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096307 Oct 04 18:05:46.177238 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2381/3176] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:05:46.186867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.188200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.200458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.201247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.202323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.203369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.204073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.205003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.906423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.924420 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76e3032b-8ef8-428d-9235-d62168ff7e55 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.745530 Oct 04 18:05:46.926382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2382/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.944504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.948050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.973154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.974321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.975712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.977547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.979838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.980740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.066477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:47.294256 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ded532c9-335d-47e8-bfd0-578015cab0ce tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 204 len: 0 microversion: 2.1 time: 0.364489 Oct 04 18:05:47.297119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2383/3178] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:46 2022] DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:47.332539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.336115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.356732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.359949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.363834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.366892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.368512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.371017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.678771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.718327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.731062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.733302 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9055718d-d861-4460-9e7c-69ab3b762750 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1366 microversion: 2.47 time: 0.421167 Oct 04 18:05:47.739308 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2384/3179] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:47.769655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be146c5-4cde-4cd8-9f31-65e1d056cb8c", "tag": "053986dc-0979-40fc-93f8-4e01cfa4f1c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:47.814066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.814347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.815150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.856791 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] Creating event network-changed:053986dc-0979-40fc-93f8-4e01cfa4f1c6 for instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c on n-h2-831193-17 Oct 04 18:05:47.878364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-84bd5562-86e9-4be9-b1b2-c278d9fb71cb req-846d5e5c-3427-49cf-9e0d-9aaaeb635083 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136597 Oct 04 18:05:47.879783 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2385/3180] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:47.889200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.890449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.926170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.927056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.927864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.929121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.940964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.942314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.425537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.444672 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa5c66fa-200e-4251-b12e-3b5834e0b0f6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1675 microversion: 2.1 time: 0.562625 Oct 04 18:05:48.485229 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2386/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1675 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.493143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.495155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.506228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.507860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.509400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.510749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.512144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.512974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.741116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.753716 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17761e5d-5c28-407d-b2e9-07de6d3d0338 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.267034 Oct 04 18:05:48.764746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2387/3182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.777031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-127b5606-70b4-4d32-89d3-5782ff056c60 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '.version_select at 0x7f6345d77040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.807641 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-127b5606-70b4-4d32-89d3-5782ff056c60 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Image not found. Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-127b5606-70b4-4d32-89d3-5782ff056c60 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/images/b1ad68d1-0c35-460f-8e66-681b6b4c5f66 HTTP/1.1 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: exception: Image not found. Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b1ad68d1-0c35-460f-8e66-681b6b4c5f66'} Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b1ad68d1-0c35-460f-8e66-681b6b4c5f66 to delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1ad68d1-0c35-460f-8e66-681b6b4c5f66 could not be found. Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.810289 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:05:48.815725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.820320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-127b5606-70b4-4d32-89d3-5782ff056c60 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Image not found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:48.820320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-127b5606-70b4-4d32-89d3-5782ff056c60 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/images/b1ad68d1-0c35-460f-8e66-681b6b4c5f66" status: 404 len: 62 microversion: 2.1 time: 0.052362 Oct 04 18:05:48.821436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2388/3183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] DELETE /compute/v2.1/images/b1ad68d1-0c35-460f-8e66-681b6b4c5f66 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:48.827703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.828563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.865524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.866530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.867232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.868935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.869653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.870292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.997043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.014339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.016177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.017918 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-293e2c68-bf3e-4b0c-8210-9237d25aed91 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1372 microversion: 2.47 time: 0.195173 Oct 04 18:05:49.019218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2389/3184] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:49.040313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.040919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.061307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.062241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.064985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.066053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.069993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.071303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.100145 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 HTTP/1.1 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380'} Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:49.104929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.110455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.115615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:49.116786 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb31d441-e23c-4e0a-af96-2f84b3ba8773 tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 404 len: 111 microversion: 2.1 time: 0.095048 Oct 04 18:05:49.121569 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2390/3185] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:49 2022] DELETE /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:49.159477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.160328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] [instance: e3d3ab41-3908-42ab-b1b7-ea03f557f380] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.168752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.169255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.169737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.170661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.171405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.172051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.191091 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] HTTP exception thrown: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Request method failure captured: Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 HTTP/1.1 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVrwlmfYRQIUDZwXD1K2hQqLiJYH-dI_91qIH5JD-LTqDnYmCUB6NVK1kP5Wg6oaVld8L9RoQRKX7uU-2y8xmSHQW-xCjUXzPDpSaihfccUebD8h6ntTYpHjhM41Bir6mSqDJ8GhlLuUCeIaB6JShkw72aL3SlW9JtxYM7jEKfvsvM Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b1173e2291ed4d7db14b3f3716222447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b1173e2291ed4d7db14b3f3716222447 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-914423148 Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fea98bf127544d63a6f3c65c16fafa6a Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-914423148-project Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e3d3ab41-3908-42ab-b1b7-ea03f557f380'} Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.194740 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. Oct 04 18:05:49.201030 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.202924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] Returning 404 to user: Instance e3d3ab41-3908-42ab-b1b7-ea03f557f380 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:49.204303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29a789db-b8c8-4c7d-b474-9b9b1bbf49cb tempest-ImagesOneServerNegativeTestJSON-914423148 tempest-ImagesOneServerNegativeTestJSON-914423148-project] 10.222.0.33 "GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380" status: 404 len: 111 microversion: 2.1 time: 0.072536 Oct 04 18:05:49.205452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2391/3186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/e3d3ab41-3908-42ab-b1b7-ea03f557f380 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:49.484048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.484765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.498640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.499311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.500830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.501858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.503997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.506089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.576474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:50.443577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.447363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:50.456417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-661565cc-4aa4-4468-9f3c-5798a2902d20 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1675 microversion: 2.1 time: 0.977049 Oct 04 18:05:50.470809 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2392/3187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1675 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.488740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.490328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.511793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.512697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.513851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.514958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.515902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.516504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.018283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.033827 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1f00664-cee0-435b-acd1-f0d1e9945972 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.560478 Oct 04 18:05:51.034489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2393/3188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.058874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.061520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.063765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:51.069027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.069556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.070177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.072178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.072444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.072882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.223584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.240340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.241802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.244007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51702149-77ae-4144-b010-0f93aaab5d30 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1357 microversion: 2.47 time: 0.190096 Oct 04 18:05:51.245043 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2394/3189] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:51.277774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.284117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.292124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Searching by: {'deleted': False, 'project_id': 'b211967bfd394fea8c350847d5a2fe93'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:05:51.313472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.314843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.326336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.328267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.329215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.330321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.675411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:05:51.909395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.921825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.922628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.923478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.959804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.962119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.213579 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8287f527-8e7f-401b-be8a-8d0b979ec11d tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.940092 Oct 04 18:05:52.214196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2395/3190] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:52.220171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.221166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.244806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.245329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.245782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.251995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.252752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.253123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.354566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.355687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.357024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.361237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lazy-loading 'fault' on Instance uuid 37b1da11-20b7-4aa4-a317-d6bb0db9027c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:52.706225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ac7eefa95467d9a4ba25125244af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a84ce584f8e4f58a25a6129f2ed125a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.722020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32fb98cf-901c-47f4-bd3e-316ecaa425c4 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 200 len: 1328 microversion: 2.1 time: 0.506499 Oct 04 18:05:52.757793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2396/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 1328 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.764073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b1da11-20b7-4aa4-a317-d6bb0db9027c", "name": "network-vif-deleted", "tag": "587acfa3-030c-46d7-9652-30925db16335"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:52.774777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.775279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.775900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.805994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] Creating event network-vif-deleted:587acfa3-030c-46d7-9652-30925db16335 for instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c on n-h1-831193-17 Oct 04 18:05:52.816804 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0114c463-e7c1-444e-93b0-7dd437eda4d5 req-5cb3bd1e-c092-45c3-8dcb-678a17bb1e70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056740 Oct 04 18:05:52.817414 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2397/3192] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:52.835015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.835720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.852603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.853116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.853537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.857848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.858554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.862428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.916747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.927159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ece0e89-d8a6-43b7-9980-684a95bc6f28 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 1.108468 Oct 04 18:05:53.967419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2398/3193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.976343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.976931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.990735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.999872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.000597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.002580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.003604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.006135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.100401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:54.347705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05fcd031-798c-4675-9b83-0dd58de457f8 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 204 len: 0 microversion: 2.47 time: 0.378774 Oct 04 18:05:54.349007 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2399/3194] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:05:53 2022] DELETE /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:05:54.358637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.362159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.380229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.381024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.381641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.382571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.384844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.385647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.422845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c HTTP/1.1 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '37b1da11-20b7-4aa4-a317-d6bb0db9027c'} Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.425196 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:05:54.430950 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.432396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:54.434041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67dab11c-edb8-4e99-800a-1280181fca54 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 404 len: 111 microversion: 2.1 time: 0.083137 Oct 04 18:05:54.441640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2400/3195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:54.452271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.453885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.470070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.474021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.474950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.475943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.477882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.478739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.596761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.606810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.619502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.621817 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ab8cda1-6996-48d6-8669-e0363e6a2580 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1363 microversion: 2.47 time: 0.177969 Oct 04 18:05:54.640376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2401/3196] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:54.647607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-149f9efe-fe53-460d-89ce-0da8757fc8cb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '.version_select at 0x7f6340d639d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.674852 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-149f9efe-fe53-460d-89ce-0da8757fc8cb tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993464551" status: 202 len: 0 microversion: 2.1 time: 0.033216 Oct 04 18:05:54.675646 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2402/3197] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993464551 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:54.962908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.963698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.982888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.983420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.990827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.991811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.004413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.006021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.027955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.048442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5c4416d-1d02-4f87-813f-6bf9dea0296c tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 1.086615 Oct 04 18:05:56.060932 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2403/3198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:56.079290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.080207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.087671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.088733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.089388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.090569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.091481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.092087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.208735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.225281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.229202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.233018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2fa9e086-17fc-4ee5-be2d-2f612b4da8d5 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1363 microversion: 2.47 time: 0.169540 Oct 04 18:05:56.252056 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2404/3199] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:56.262415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.263577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.270863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.271833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.272581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.274119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.274834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.275682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.591676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.619495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.627767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.641975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b53d92ae-dc30-4463-bd29-0525e4023ef7 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2952 microversion: 2.42 time: 0.381184 Oct 04 18:05:56.659068 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2405/3200] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2952 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:56.676451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.677268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.714157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.714680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.715629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.716503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.716971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.717397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.044271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfe00f15-ec7b-4155-b531-0761635f4df1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.374243 Oct 04 18:05:57.046400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2406/3201] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246/os-interface => generated 1830 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:57.091122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.092093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.100444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.101212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.102628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.104335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.105225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.106223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.805913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.817320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64b08acc-e339-4894-bcf7-2314b8d0464d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.736890 Oct 04 18:05:57.823138 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2407/3202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:57.848520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.849175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.855664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.856194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.856674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.857392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.857893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.858329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.941369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.941878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.942316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.955779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lazy-loading 'fault' on Instance uuid 82a33c9e-e622-47ed-ad92-4de357540309 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:58.153275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.174295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.176152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.177584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef2f99e5-d3e2-4ff9-ac90-fb8d5ae600f2 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 200 len: 1368 microversion: 2.47 time: 0.353212 Oct 04 18:05:58.178369 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2408/3203] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 1368 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:58.256348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be146c5-4cde-4cd8-9f31-65e1d056cb8c", "name": "network-vif-plugged", "status": "completed", "tag": "053986dc-0979-40fc-93f8-4e01cfa4f1c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:58.272828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.274014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.274728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.278998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:58.304814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] Creating event network-vif-plugged:053986dc-0979-40fc-93f8-4e01cfa4f1c6 for instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c on n-h2-831193-17 Oct 04 18:05:58.311767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b4d9ffa6-f46a-45d6-9c9b-2e642aa3acd4 req-e3c95239-50b4-4174-a140-aa50f2b69d94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058836 Oct 04 18:05:58.318641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2409/3204] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:58.850178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.853006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.872061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.872576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.873027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.873757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.874229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.879138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.652129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.664642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9953d3bc-64ab-4166-8432-34555e75d377 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1314 microversion: 2.1 time: 0.818677 Oct 04 18:05:59.675426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2410/3205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.688791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.689485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 82a33c9e-e622-47ed-ad92-4de357540309] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.695808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:59.697875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.698584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.699244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.703007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.704197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.704837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.752393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] HTTP exception thrown: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Request method failure captured: Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 HTTP/1.1 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHXQ_Jn7GWEq8U4jR_qwl_NV164cxicKhJzqYbrzv5UqFzT0a9ft6pX2ZbZUiDK-5E0sWh_JtpoBjoxhagL8ieUjhSPOVHTmuIPHBetS8dSKnc_h2bUAK6IAhmzzHq-6ymnQh96PLIsWXGblPT2bapZTybAEykXz8iAeuEOoFtGVSV8 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b211967bfd394fea8c350847d5a2fe93 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerShowV247Test-2076742003 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerShowV247Test-2076742003 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b211967bfd394fea8c350847d5a2fe93 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerShowV247Test-2076742003 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerShowV247Test-2076742003-project Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9dbfe0d92e4b41bc8c4bd4df83499279 Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerShowV247Test-2076742003-project Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '82a33c9e-e622-47ed-ad92-4de357540309'} Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:59.754093 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Returning 404 to user: Instance 82a33c9e-e622-47ed-ad92-4de357540309 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-decab706-8ee3-4d81-9a68-48b14b5d78ea tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309" status: 404 len: 111 microversion: 2.47 time: 0.078711 Oct 04 18:05:59.760666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2411/3206] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/82a33c9e-e622-47ed-ad92-4de357540309 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:59.765104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.765614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.772629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.773238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.773718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.774809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.775310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.775799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.824051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:00.037752 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f173b6de-b61d-4ca4-9817-2b14bb0623b0 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182" status: 204 len: 0 microversion: 2.47 time: 0.276547 Oct 04 18:06:00.042790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2412/3207] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:05:59 2022] DELETE /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:06:00.051656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.055284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.079004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.079851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.080816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.081748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.082395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.088300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.286699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.316673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.328537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.330225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30bbe9d4-1efe-45ea-b5b6-2794886c9e63 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182" status: 200 len: 1363 microversion: 2.47 time: 0.285829 Oct 04 18:06:00.337026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2413/3208] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:01.020542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cec7ec6e-96fe-4728-b5c6-755fc1e3125d tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6340c1f820>, body: {"keypair": {"name": "tempest-keypair-376596668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKjH3Ewvm/ER9K7ulHFI+TcJpCJcbaCPJ2dxleE/xCHKDZ3GcmMg4P/Pq/gBSY0QKl4bKmLQdew6LiCN2N11pPnGYvzP3K5vFalrDsFnQQ0urAsTkrUyFClw9S4VOjqA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:01.076020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-cec7ec6e-96fe-4728-b5c6-755fc1e3125d tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:01.092407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-cec7ec6e-96fe-4728-b5c6-755fc1e3125d tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:01.152599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cec7ec6e-96fe-4728-b5c6-755fc1e3125d tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.477429 Oct 04 18:06:01.153844 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2414/3209] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:01.170625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.171306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.211445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.211767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.212200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.212953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.213455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.213904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.474983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:01.955545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.968787 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a94470f9-5308-46ae-9b68-8a81d5c2e13e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1500 microversion: 2.1 time: 0.812420 Oct 04 18:06:01.972077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2415/3210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1500 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.977304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55cad4d4-0ff6-4148-838c-124c50d44cce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340d5fd30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.030690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55cad4d4-0ff6-4148-838c-124c50d44cce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-376596668" status: 200 len: 497 microversion: 2.1 time: 0.057425 Oct 04 18:06:02.031368 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2416/3211] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-376596668 => generated 497 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:02.054914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.055575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.084871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.085404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.085860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.087240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.087715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.088199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.175718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.186392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.192099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dbfe0d92e4b41bc8c4bd4df83499279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b211967bfd394fea8c350847d5a2fe93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.194974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40ff6a4b-e391-4130-82c1-caf015870f21 tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182" status: 200 len: 1363 microversion: 2.47 time: 0.143994 Oct 04 18:06:02.196516 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2417/3212] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:02.202594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:02.205772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.237461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.240320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.242931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.245076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.246780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.248008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.285935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lazy-loading 'flavor' on Instance uuid 4be146c5-4cde-4cd8-9f31-65e1d056cb8c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:02.411396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06a36d87-8222-434a-8619-9f78d13798f5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "POST /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c/action" status: 200 len: 32 microversion: 2.1 time: 0.213055 Oct 04 18:06:02.415462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2418/3213] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:02.445618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4bc5b99a-3b70-4bdf-90c6-2cfb91376139 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f634181b280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.512457 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4bc5b99a-3b70-4bdf-90c6-2cfb91376139 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376596668" status: 202 len: 0 microversion: 2.1 time: 0.094181 Oct 04 18:06:02.522104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2419/3214] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376596668 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:02.529844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.531122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.540942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.541850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.542607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.543764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.544448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.545096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.962890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.973101 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b97a6196-3335-42d6-9095-3b352475a496 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.447439 Oct 04 18:06:02.976093 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2420/3215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.990111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8adb5ca4-f927-4ae9-ac7b-57cd7922c2d4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6343299310>, body: {"keypair": {"name": "tempest-keypair-1791794002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE63Lr/TafqcL3rgxVeWXfx0xIqEhzSJ1yQlYFbQcDCzP3n8yBk1Mf87ZOzupibNZbPiRVQMhr0mR5sNFCo5NDNpvHQOhldyJGeC5XQb0DDoDIx1yppegoBuqHd+1Dz34A=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.015441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8adb5ca4-f927-4ae9-ac7b-57cd7922c2d4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:03.021911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8adb5ca4-f927-4ae9-ac7b-57cd7922c2d4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:03.087585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8adb5ca4-f927-4ae9-ac7b-57cd7922c2d4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109805 Oct 04 18:06:03.088257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2421/3216] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.114048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b3614559-1f1c-49ba-b876-15cfd7962347 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340c02b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.170069 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b3614559-1f1c-49ba-b876-15cfd7962347 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791794002" status: 202 len: 0 microversion: 2.1 time: 0.065687 Oct 04 18:06:03.171798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2422/3217] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791794002 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:03.191453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6f956e2-5d31-4a71-b2f9-5affbdf1b2f5 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6340c20790>, body: {"keypair": {"name": "tempest-keypair-383173384", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.244547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a6f956e2-5d31-4a71-b2f9-5affbdf1b2f5 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:03.250723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a6f956e2-5d31-4a71-b2f9-5affbdf1b2f5 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:03.290438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6f956e2-5d31-4a71-b2f9-5affbdf1b2f5 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.112751 Oct 04 18:06:03.291535 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2423/3218] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.296818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.297436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] [instance: 0937ee51-190c-4958-a22f-9f3a0541b182] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.306561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.307233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.307723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.308655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.309124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.309648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.329438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] HTTP exception thrown: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Request method failure captured: Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 HTTP/1.1 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHXQ_Jn7GWEq8U4jR_qwl_NV164cxicKhJzqYbrzv5UqFzT0a9ft6pX2ZbZUiDK-5E0sWh_JtpoBjoxhagL8ieUjhSPOVHTmuIPHBetS8dSKnc_h2bUAK6IAhmzzHq-6ymnQh96PLIsWXGblPT2bapZTybAEykXz8iAeuEOoFtGVSV8 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b211967bfd394fea8c350847d5a2fe93 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerShowV247Test-2076742003 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b211967bfd394fea8c350847d5a2fe93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerShowV247Test-2076742003 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b211967bfd394fea8c350847d5a2fe93 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerShowV247Test-2076742003 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerShowV247Test-2076742003-project Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9dbfe0d92e4b41bc8c4bd4df83499279 Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerShowV247Test-2076742003-project Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0937ee51-190c-4958-a22f-9f3a0541b182'} Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:03.332894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] Returning 404 to user: Instance 0937ee51-190c-4958-a22f-9f3a0541b182 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-174acdb0-231f-4bbd-9977-ad63df0a339a tempest-ServerShowV247Test-2076742003 tempest-ServerShowV247Test-2076742003-project] 10.222.0.33 "GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182" status: 404 len: 111 microversion: 2.47 time: 0.041350 Oct 04 18:06:03.338451 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2424/3219] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/0937ee51-190c-4958-a22f-9f3a0541b182 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:06:03.344278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-300f1a1a-1a06-4ba8-9d55-acc0ff6c91f8 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340c02160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.370293 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-300f1a1a-1a06-4ba8-9d55-acc0ff6c91f8 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383173384" status: 202 len: 0 microversion: 2.1 time: 0.030288 Oct 04 18:06:03.371539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2425/3220] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383173384 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:03.387387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ed557f2-d15f-48ed-892d-9ebafb35f283 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6340c20700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1345795449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe9qHfSbO58YXrQG5Coj51v15TzRbxVc/gBZka9vCmVzcWWLCEmO3z4DGku1pz6ZHEsroo5HT0x9YvOj/gpBNPejr5aqXnDwfCXRJ7Oym88fY1BCtV9998f0wgk3mE6Rg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.426155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ed557f2-d15f-48ed-892d-9ebafb35f283 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:03.435269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5ed557f2-d15f-48ed-892d-9ebafb35f283 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:03.478502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ed557f2-d15f-48ed-892d-9ebafb35f283 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.098537 Oct 04 18:06:03.480068 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2426/3221] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.497392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-22d5a7f5-93cd-42a2-82bb-38d8ae04346a tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6340c1f5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1160783427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjDLkWRPLqhaxK4e/Uo7iCTuF5lBS7d2LbpbKZwGYPafyiyz7v5zn1HD/FHffnTIAqRCZxaDNoQAq8k8jpG02x1azNUTbSgzxIEooJAB9+EDCsDYnc92V1xeLfcHngsqw=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.528882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-22d5a7f5-93cd-42a2-82bb-38d8ae04346a tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:03.547455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-22d5a7f5-93cd-42a2-82bb-38d8ae04346a tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:03.590768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-22d5a7f5-93cd-42a2-82bb-38d8ae04346a tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.098636 Oct 04 18:06:03.592249 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2427/3222] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.610952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90ca74db-ba61-42cf-9dbd-ab2ab0a9c5ce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Action: 'create', calling method: .version_select at 0x7f6340c02b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1890331978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJghZWrdqwg9ErrJweccpcKjjuW69KzLPRG1AMxb/k63tXKF9Bm8lrSvldbFJWm9A7VrZdumurBYe19w/tZWwDE7ls5T/kFNCjLdmrRLz9r0mDDYgqTF31pSK5YYibM4Yg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.656583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-90ca74db-ba61-42cf-9dbd-ab2ab0a9c5ce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:03.670562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:03.705228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-90ca74db-ba61-42cf-9dbd-ab2ab0a9c5ce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Getting quotas for user 0e9419a6a2cd45eea0b425f460379119 and project 9f5bad1a2a474bc5958181b992d88811. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:03.796282 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90ca74db-ba61-42cf-9dbd-ab2ab0a9c5ce tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.192439 Oct 04 18:06:03.805331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2428/3223] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:03.813372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31d4bbee-d176-4e8e-acf2-4212ed0ae0b6 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340e5b940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.819904 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-31d4bbee-d176-4e8e-acf2-4212ed0ae0b6 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:06:03.826904 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31d4bbee-d176-4e8e-acf2-4212ed0ae0b6 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.019710 Oct 04 18:06:03.828196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2429/3224] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.842660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f686defc-c10f-443e-8218-8bcd25cc94d8 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340d63430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.878424 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f686defc-c10f-443e-8218-8bcd25cc94d8 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1890331978" status: 202 len: 0 microversion: 2.1 time: 0.040835 Oct 04 18:06:03.879340 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2430/3225] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1890331978 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:03.888577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b890dda6-8aca-46b3-8c2e-c6a894bc1260 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f63416dd040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.949883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b890dda6-8aca-46b3-8c2e-c6a894bc1260 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1160783427" status: 202 len: 0 microversion: 2.1 time: 0.064259 Oct 04 18:06:03.951642 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2431/3226] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1160783427 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:03.973488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f7fd11c-56f9-4eff-ad54-1968fcf3b3f4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] Calling method '.version_select at 0x7f6340c26dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.033147 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f7fd11c-56f9-4eff-ad54-1968fcf3b3f4 tempest-KeyPairsV2TestJSON-1701695399 tempest-KeyPairsV2TestJSON-1701695399-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1345795449" status: 202 len: 0 microversion: 2.1 time: 0.073838 Oct 04 18:06:04.034651 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2432/3227] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1345795449 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:04.046208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.048825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.070787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.071656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.072118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.073249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.073351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.073751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.482824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.491449 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c5a501c-d392-4b67-afb8-f2c40c168e96 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.455401 Oct 04 18:06:04.496043 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2433/3228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:05.525475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.526104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.561617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.562249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.562711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.563632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.563971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.566049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.091004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:06.113477 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b897d7b-f728-493a-8158-8e003cc906b1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.594624 Oct 04 18:06:06.129596 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2434/3229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:07.149263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.149962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.166531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.167069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.168446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.171602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.172032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.173494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.532042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.548096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01c83afb-7f43-43ce-8e99-5200c5a8ebcd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.404899 Oct 04 18:06:07.564489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2435/3230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:08.578582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.580635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.597987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.599654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.604113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.609239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.612137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.612958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.941550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.960111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91f9d81c-1ce6-4edc-8817-c2ecfabe5edd tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.386926 Oct 04 18:06:08.978492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2436/3231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.986053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.987006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.000251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.000773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.001213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.001933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.002393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.013081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.496373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.507571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3555a8a-00d4-4ed8-9cbc-f2bcc0297985 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 1.525566 Oct 04 18:06:11.526544 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2437/3232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:11.549374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.550176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.570633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.571907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.574423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.575706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.578667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.579149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.593839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:11.627733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c HTTP/1.1 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '37b1da11-20b7-4aa4-a317-d6bb0db9027c'} Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:11.647544 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.653422 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.655964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:11.657539 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5a4ac82a-cc45-4868-bfcc-4c101093fba6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 404 len: 111 microversion: 2.1 time: 0.128325 Oct 04 18:06:11.658304 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2438/3233] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:11 2022] DELETE /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:11.673293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.676095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 37b1da11-20b7-4aa4-a317-d6bb0db9027c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.690350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.697855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.698620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.701786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.702495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.703517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.760662 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c HTTP/1.1 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '37b1da11-20b7-4aa4-a317-d6bb0db9027c'} Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.768468 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. Oct 04 18:06:11.773990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.777293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 37b1da11-20b7-4aa4-a317-d6bb0db9027c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:11.781171 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8ce8fa7-54cc-41be-93a4-51c686f1842e tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c" status: 404 len: 111 microversion: 2.1 time: 0.116449 Oct 04 18:06:11.783429 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2439/3234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/37b1da11-20b7-4aa4-a317-d6bb0db9027c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:12.537452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.538373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.558564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.568056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.569946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.571778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.573679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.588559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.362558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.382003 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-adc748dd-e1e2-49fb-a783-b5659ed9b2e1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.849539 Oct 04 18:06:13.386104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2440/3235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.410502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.411250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.420436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=26 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:14.436371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.439020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.439710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.440650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.442449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.446540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.766979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.781435 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed95ad2d-268e-45d3-b40b-bd0fd3dc1e53 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.375372 Oct 04 18:06:14.807208 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2441/3236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:15.819391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.820222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.840228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.840913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.841501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.842355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.847127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.848038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.053846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.064873 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a9dcb14-f078-4bfc-983d-05aec0a59b84 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.250664 Oct 04 18:06:16.066092 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2442/3237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.092189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.092882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.123136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.405448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.410275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2816b1a9-230b-4ac2-bd37-06562340c685 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.323848 Oct 04 18:06:17.415376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2443/3238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.565948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.567111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.579498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.588257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.591520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.592495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.594369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.598798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.669577 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 HTTP/1.1 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8bc6ddeb-263c-43aa-8c2e-87193a5c93a8'} Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:17.672455 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:17.677216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-627e550b-3ff0-4022-af0c-a1c27d6769a6 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 404 len: 111 microversion: 2.1 time: 0.112382 Oct 04 18:06:17.681429 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2444/3239] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:17 2022] DELETE /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:06:17.690027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.690917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] [instance: 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.697801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.698677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.699337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.700741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.701579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.702191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.744265 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] HTTP exception thrown: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Request method failure captured: Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 HTTP/1.1 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHRlhx3ms-CBVSluYHM5HH7UeMnP3GgtxbgKGEbAZnQxBie-7D1vNI2N5qMGB-nZ_fjRxCf9sh0Z64acj_rKezdoPVKU8MQdkhCDFRHvvKV15zlHU3Pey9hojByupqLrzvxa4YXnGKLSWGwKSpbCsgF2VXvVZLTJ1B1QBtLYsdqazHI Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a84ce584f8e4f58a25a6129f2ed125a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3a84ce584f8e4f58a25a6129f2ed125a Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeTestJSON-498768461 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 552ac7eefa95467d9a4ba25125244af3 Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeTestJSON-498768461-project Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8bc6ddeb-263c-43aa-8c2e-87193a5c93a8'} Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.747960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. Oct 04 18:06:17.753587 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.757142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] Returning 404 to user: Instance 8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:17.763728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-137e3c99-944b-4638-880e-b5c738e5df08 tempest-AttachVolumeTestJSON-498768461 tempest-AttachVolumeTestJSON-498768461-project] 10.222.0.33 "GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8" status: 404 len: 111 microversion: 2.1 time: 0.079188 Oct 04 18:06:17.764628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2445/3240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/8bc6ddeb-263c-43aa-8c2e-87193a5c93a8 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:17.837651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:17.840279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.861590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.861851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.862289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.863017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.863508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.863940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.073374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c48668e-bea2-4f45-b439-7b6d1c4294fc tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.240293 Oct 04 18:06:18.075856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2446/3241] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:17 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:18.110180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.114039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.148507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.154416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.155203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.156208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.159099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.160540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.290452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.304073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8f736c6-f0df-4a7f-bfbf-59ab290b190d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1669 microversion: 2.1 time: 1.210210 Oct 04 18:06:19.306734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2447/3242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1669 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.324894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.330127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.355585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.359467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.365790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.370034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.371496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.375854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.220849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.230918 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c162daf-078c-4ae0-a6fc-626085e49321 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.921750 Oct 04 18:06:20.247436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2448/3243] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.333502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.334829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.343541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.350820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.351552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.352649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.357697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.362624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.578656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.595208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-503a505e-69fb-45d5-ad48-10117615eb8e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1669 microversion: 2.1 time: 1.265895 Oct 04 18:06:21.598714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2449/3244] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1669 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:21.949005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c5ff4c0-22cc-4566-8e8f-86f0c45b96f0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Action: 'create', calling method: .version_select at 0x7f6343299280>, body: {"keypair": {"name": "tempest-keypair-1979477957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD9So2EvVacDhI0X2xyvbecRvJ7RF5CPuIWZvcBM/ODjmg8FylUVnQ2/wGEOvDWK7VLfPM/dZaKbyzKqKzsc0XPqAyO5V+ICE59WPtsxx7PukeVwvsdFRG9967va655xQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:21.997968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0c5ff4c0-22cc-4566-8e8f-86f0c45b96f0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for project 6dec7c37c13640f398452d758418fe91. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:22.007958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0c5ff4c0-22cc-4566-8e8f-86f0c45b96f0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for user 252ad175b2714c8e99eac27dbc0fc969 and project 6dec7c37c13640f398452d758418fe91. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:22.069396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c5ff4c0-22cc-4566-8e8f-86f0c45b96f0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.468416 Oct 04 18:06:22.071106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2450/3245] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:06:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:22.088953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.105966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.139616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.142844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.145515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.147316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.148601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.150660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.560053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.576145 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee4c65dc-2650-4dd0-9604-4186c85e3296 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.503842 Oct 04 18:06:22.577331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2451/3246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.648721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1343787908", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:22.748871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:23.183799 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:06:23.185422 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:06:24.004605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:24.005141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:24.005511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:24.005927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:24.006340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:24.032432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.040132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.046004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.046858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.048272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.054197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.104944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:24.131622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:24.180809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:24.184489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:24.302252 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1afc20ca-4854-4d9b-b2ec-0e1cfc33e7cd tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717331 Oct 04 18:06:24.306992 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2452/3247] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:24.329662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.348611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.410533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.411347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.416438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.420570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.421832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.426100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.123012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.146997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-97987b40-b87f-4c1e-a635-bb21f66eda8c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1674 microversion: 2.1 time: 0.836827 Oct 04 18:06:25.153311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2453/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1674 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.161450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.163056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.181972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.185844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.186627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.188053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.188871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.189816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.554838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.573180 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-03698608-89c4-43d8-a43a-69315a322058 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.418163 Oct 04 18:06:25.575473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2454/3249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.580664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.588032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.603188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.605880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.607236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.608886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.618190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.619257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.856524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.891685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-182cb7bd-df48-467a-9ecc-7bc14dec4950 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1189 microversion: 2.1 time: 0.314131 Oct 04 18:06:25.892940 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2455/3250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1189 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.903167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1142170971", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a6d39212-a32c-438c-8f7b-36f94060bd26"}], "security_groups": [{"name": "tempest-securitygroup--82150038"}], "key_name": "tempest-keypair-1979477957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:26.185585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] validate_networks() for [('a6d39212-a32c-438c-8f7b-36f94060bd26', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:28.660853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for project 6dec7c37c13640f398452d758418fe91. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:28.668453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for user 252ad175b2714c8e99eac27dbc0fc969 and project 6dec7c37c13640f398452d758418fe91. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:28.672624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:28.690815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:28.690815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:28.690815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:28.691333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:28.691499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:28.718143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.719277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.726381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.734259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.748793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.748793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.779210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for project 6dec7c37c13640f398452d758418fe91. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:28.786473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Getting quotas for user 252ad175b2714c8e99eac27dbc0fc969 and project 6dec7c37c13640f398452d758418fe91. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:28.805467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:28.808154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:28.975564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c1e2cf2-7fa5-4a84-b5b5-fcc5001f9398 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.079234 Oct 04 18:06:28.981572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2456/3251] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 3088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:29.000738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.004787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.027673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.028196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.029955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.032165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.033022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.033974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.757692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:29.780411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e422d0e-4191-4246-bf96-c242f7439a8f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.789074 Oct 04 18:06:29.783074 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2457/3252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:29.790911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.793272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.817653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.828808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.831095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.832195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.837633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.838497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.548504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.555310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:30.574534 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7d84087a-e021-41fa-bf40-2e986160bf32 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.787886 Oct 04 18:06:30.589784 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2458/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.615092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.620309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.658099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.659690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.661658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.663759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.665783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.667630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.242495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.266290 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ecfe4f1b-26f2-4a87-855a-a6de53799674 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.669700 Oct 04 18:06:31.271241 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2459/3254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.291428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.297358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.312218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.312734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.313187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.314100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.314869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.339764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.604796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.633249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a71a979-9c32-4d5e-bc50-49851300c8bc tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1322 microversion: 2.1 time: 0.358700 Oct 04 18:06:31.633858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2460/3255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.646607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.649026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.673130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.674998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.675988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.677933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.681466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.683705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.325973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.337902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d13aba8-e609-4728-aacf-376d2a16f232 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.697818 Oct 04 18:06:32.353586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2461/3256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.360261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.361325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.377688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.378583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.387711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.389714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.390461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.391317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.911718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.930015 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31f203c9-9428-49e0-9631-186e5afc9da1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.573914 Oct 04 18:06:32.932741 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2462/3257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.948109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.948777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.966745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.967599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.968221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.969119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.969757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.970183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.206876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.243981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5bb67e16-e200-4cbd-8504-20efc3ffaa5b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1328 microversion: 2.1 time: 0.309046 Oct 04 18:06:33.271528 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2463/3258] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1328 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.330981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d382fedf-935d-4cd7-9428-1c74b26f4dfb", "tag": "7b06551f-2737-436e-bf47-72c3b2049c5f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:33.355714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.357019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.358312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.391924 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] Creating event network-changed:7b06551f-2737-436e-bf47-72c3b2049c5f for instance d382fedf-935d-4cd7-9428-1c74b26f4dfb on n-h1-831193-17 Oct 04 18:06:33.408837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-dacc8592-54c8-450b-9c95-51fa9df89559 req-36623d49-c546-4f6d-9672-a3878ff9226e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080139 Oct 04 18:06:33.411994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2464/3259] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:33.428331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.429269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.452716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.453746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.455296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.456593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.459015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.461092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.978835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.993972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c5ab346-a05c-4150-ad40-57c261819658 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.573110 Oct 04 18:06:33.994891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2465/3260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.237596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f3f5885-8835-4621-ae66-f3fc1a660d35 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Action: 'create', calling method: .version_select at 0x7f63403b2c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-755997580"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:34.929018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f3f5885-8835-4621-ae66-f3fc1a660d35 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.927940 Oct 04 18:06:34.930166 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2466/3261] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Oct 4 18:06:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 934 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:06:34.939197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.949229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.962374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.963551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.965572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.968473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.970441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.971830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.275945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.295173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5047baf-235c-4746-9e96-dfc84e321a92 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.363228 Oct 04 18:06:35.296902 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2467/3262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.320795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.324962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.356063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.356793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.357425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.358333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.358970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.359637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.798804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.811413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85aef37b-d14e-4458-a41e-ae19550f264e tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1394 microversion: 2.1 time: 0.511236 Oct 04 18:06:35.826498 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2468/3263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1394 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.839858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f9cae0-8338-4236-9ca6-891795c7a5be", "tag": "b4e65e31-94f2-4e74-b432-5bf00844e97b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:35.865179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.865677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.866122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.898868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] Creating event network-changed:b4e65e31-94f2-4e74-b432-5bf00844e97b for instance 26f9cae0-8338-4236-9ca6-891795c7a5be on n-h1-831193-17 Oct 04 18:06:35.908979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-22540acb-2857-4f27-a551-49a239b3c99d req-c797278c-94d3-480c-b547-e4a4f95f5728 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073498 Oct 04 18:06:35.909607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2469/3264] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:35.923855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bd9d2af-a25c-49f6-8511-80f96381c868 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340b81af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.052407 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7bd9d2af-a25c-49f6-8511-80f96381c868 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 200 len: 344 microversion: 2.1 time: 0.139876 Oct 04 18:06:36.054757 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2470/3265] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:36.071784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.073428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.102512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.103369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.103827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.104601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.105075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.105515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.331423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.341159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2ebd2b2-5303-401f-8c70-1414b11be06d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.284726 Oct 04 18:06:36.342426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2471/3266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.347678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.348295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.355268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.356114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.356760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.357696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.358333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.358934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.587645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.596422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9dd3d33-441d-45ef-966e-ca6ebd61aab3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.252898 Oct 04 18:06:36.597573 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2472/3267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.837769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.838661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.849515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.850637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.852387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.853209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.854074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.854760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.074050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.082954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c65e39cd-ad0a-44d8-beea-1413ec63908b tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1394 microversion: 2.1 time: 0.252665 Oct 04 18:06:37.084169 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2473/3268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1394 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:37.104080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5036401-4d8c-4bc0-b126-bb6cb3c5e0c3 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340c26dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.168657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5036401-4d8c-4bc0-b126-bb6cb3c5e0c3 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 200 len: 345 microversion: 2.1 time: 0.083083 Oct 04 18:06:37.171120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2474/3269] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:37.184758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00c41d80-5ca5-434b-af37-8c7063165c5d tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Action: 'create', calling method: .version_select at 0x7f6340c261f0>, body: {"snapshot": {"volume_id": "8b15024b-6327-4da1-8e26-cd34a6c55a79", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-572963780"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:37.393896 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00c41d80-5ca5-434b-af37-8c7063165c5d tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.213995 Oct 04 18:06:37.395088 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2475/3270] 10.222.0.33 () {60 vars in 1162 bytes} [Tue Oct 4 18:06:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:37.405797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.406430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.420606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.421119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.421568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.422304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.422774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.423249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.645230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.662231 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a55dcd61-4583-4f31-ad13-6ef3f7b4c6de tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.265744 Oct 04 18:06:37.676426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2476/3271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.680976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55299fbb-ae24-408e-956c-d15d5837d428 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340c26b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.737005 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55299fbb-ae24-408e-956c-d15d5837d428 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 200 len: 286 microversion: 2.1 time: 0.065782 Oct 04 18:06:37.737588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2477/3272] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:37.748357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.749438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.757776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.758344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.758736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.759724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.760195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.760610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.053512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.091537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47e62f78-82c3-47ac-809d-723f6eb9a5b5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.352530 Oct 04 18:06:38.092257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2478/3273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.099540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39e9eca5-8f9b-47df-b789-3f6b03964982 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340c26550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.157690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39e9eca5-8f9b-47df-b789-3f6b03964982 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.064385 Oct 04 18:06:38.158293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2479/3274] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:38.167222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.170899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.196897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.198013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.198721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.201144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.202503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.204635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.392640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.404101 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a717b4ac-593a-44f0-abcf-64049be16fd2 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1394 microversion: 2.1 time: 0.243960 Oct 04 18:06:38.419159 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2480/3275] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1394 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.419159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b84da82b-8674-45ea-a242-39ec3ceb124d tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6345e2c700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.452021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b84da82b-8674-45ea-a242-39ec3ceb124d tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 200 len: 286 microversion: 2.1 time: 0.045799 Oct 04 18:06:38.452991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2481/3276] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:38.691570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.692529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.702551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.704634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.708375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.709532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.710260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.710898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.773342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:38.811810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=20 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:39.048431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.058323 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a2b8723-0459-4197-b3c6-b2b9dba2c706 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1506 microversion: 2.1 time: 0.371217 Oct 04 18:06:39.059135 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2482/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.131160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.132511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.148383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.150559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.151727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.154381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.154381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.154381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.552359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.557731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:39.590510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df6cdfaa-6294-456d-a7fd-ae1bd97e66f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.475077 Oct 04 18:06:39.591635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2483/3278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:39.596760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d382fedf-935d-4cd7-9428-1c74b26f4dfb", "name": "network-vif-plugged", "status": "completed", "tag": "7b06551f-2737-436e-bf47-72c3b2049c5f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:39.608715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.609244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.610359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.672337 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] Creating event network-vif-plugged:7b06551f-2737-436e-bf47-72c3b2049c5f for instance d382fedf-935d-4cd7-9428-1c74b26f4dfb on n-h1-831193-17 Oct 04 18:06:39.691798 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-33c91c9b-899e-41fd-8d56-f3ffc3569f37 req-012d464f-aabb-475a-ab75-1fb386d65932 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097791 Oct 04 18:06:39.693300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2484/3279] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:39.726996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.728043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.737282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.737788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.738221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.738935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.739423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.740065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.985353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.995671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4d885a4-2e54-4729-8d02-5f5d1bb8b225 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1394 microversion: 2.1 time: 0.299096 Oct 04 18:06:39.996279 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2485/3280] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1394 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:40.021037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d996aaa-16ca-41ef-8618-df8edd03021a tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340b818b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.059779 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d996aaa-16ca-41ef-8618-df8edd03021a tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 200 len: 287 microversion: 2.1 time: 0.053709 Oct 04 18:06:40.060584 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2486/3281] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:40.076827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0def0596-ca2d-42f8-96e8-d88346f18b66 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6345e2c280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.198493 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0def0596-ca2d-42f8-96e8-d88346f18b66 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 202 len: 0 microversion: 2.1 time: 0.126113 Oct 04 18:06:40.201168 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2487/3282] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 18:06:40 2022] DELETE /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:40.213222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.214068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.228492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.229334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.230078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.234956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.236373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.237683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.606264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:40.617690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac8c1e5c-b4a7-4d14-8a91-476f1ee50257 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1486 microversion: 2.1 time: 0.414709 Oct 04 18:06:40.635230 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2488/3283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:40.647944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1631653-bf99-4cc9-8f56-806f37b2c585 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340bccd30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.713968 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1631653-bf99-4cc9-8f56-806f37b2c585 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 200 len: 286 microversion: 2.1 time: 0.070111 Oct 04 18:06:40.714742 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2489/3284] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:40.719302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.719918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.737023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.737543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.737999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.738967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.739797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.740559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.101213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.114678 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55c56bde-c015-475c-a8fe-c6413aa0cb59 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1293 microversion: 2.1 time: 0.398968 Oct 04 18:06:41.115307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2490/3285] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1293 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:41.120614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-561282497", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:41.233853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] validate_networks() for [('27b360d5-6ad4-4265-a4f6-b437f29e4393', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:41.832540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:41.833127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:41.833608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:41.834213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:41.834827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:41.847672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.848380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.849596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.851115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.851795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.852798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.874942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Getting quotas for project 91c2761fdd7343368c59940180353f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:41.881887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Getting quotas for user 357dac18752041d2a242b03ebf31287f and project 91c2761fdd7343368c59940180353f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:41.899241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:41.901811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:41.958152 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7bc443c1-54a0-4e07-9b87-c8b0f1af9ac1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.841530 Oct 04 18:06:41.959178 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2491/3286] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:41.964509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.965808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.972996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.973776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.974396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.975801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.976429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.977025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.201511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.236295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3af565f4-e937-46df-be2f-67b129960c64 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1394 microversion: 2.1 time: 0.275697 Oct 04 18:06:42.237819 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2492/3287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1394 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.245943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8becfcb6-a65a-47e1-b42b-5a9aac0f17db tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340b81940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.327737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8becfcb6-a65a-47e1-b42b-5a9aac0f17db tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 200 len: 286 microversion: 2.1 time: 0.085638 Oct 04 18:06:42.328790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2493/3288] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:42.342683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f9cae0-8338-4236-9ca6-891795c7a5be", "name": "network-vif-plugged", "status": "completed", "tag": "b4e65e31-94f2-4e74-b432-5bf00844e97b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:42.359728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.360377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.361021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.378755 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] Creating event network-vif-plugged:b4e65e31-94f2-4e74-b432-5bf00844e97b for instance 26f9cae0-8338-4236-9ca6-891795c7a5be on n-h1-831193-17 Oct 04 18:06:42.388319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7b571db9-f2ab-458e-a35d-cb08eed372f9 req-a92763c5-d798-42ca-a75a-2065325fd30b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057927 Oct 04 18:06:42.389538 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2494/3289] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:42.395437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d2ca028-f2e8-4a96-8701-612a32fd63cc tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.396255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d2ca028-f2e8-4a96-8701-612a32fd63cc tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.508006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d2ca028-f2e8-4a96-8701-612a32fd63cc tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.542249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d2ca028-f2e8-4a96-8701-612a32fd63cc tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1213 microversion: 2.1 time: 0.149862 Oct 04 18:06:42.544451 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2495/3290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.558496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.566235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.588277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.589171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.589925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.591281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.592129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.592929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.906637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.923201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a111927b-576d-4a11-8e4f-5e3080a8dd16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1474 microversion: 2.1 time: 0.376828 Oct 04 18:06:42.924614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2496/3291] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.104370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1110608297", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:43.169953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:44.368552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:44.369174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:44.369458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:44.369876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:44.370297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:44.383523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.384098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.384844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.385882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.386357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.387057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.411455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:44.418190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:44.422680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:44.437947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:44.441707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:44.512895 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc4ab22d-f5eb-46c0-9af8-0b4966441036 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413337 Oct 04 18:06:44.522817 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2497/3292] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:06:44.529481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.535455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.544230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.544854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.545443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.547344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.547911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.548421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.779508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.793202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3fb3338a-b043-4f15-bb54-ff073bd0a1a0 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1576 microversion: 2.1 time: 0.265220 Oct 04 18:06:44.793857 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2498/3293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.807002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39706aec-e98d-470a-8b53-777d641b3a03 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6343299280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.867613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-39706aec-e98d-470a-8b53-777d641b3a03 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] HTTP exception thrown: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39706aec-e98d-470a-8b53-777d641b3a03 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Request method failure captured: Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae HTTP/1.1 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYpvBv16lYpBvVFRALg3KCSnMSJattzV0cG5TPIK9IexwGwyRQX9KsJD_SAqel5iO6Jf4H5PllJhx38SZbWpsoDGlho13kgL82hqdj4GlwekdLOjZRkcYxzDA_BRAxgR3r6HsSaODKayDsaOaTE6FeEv33DzwoY8pLUNICaHP4za1Y Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b0099825cc4735b20e5a81f3928840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c0ba946e6c9c404a8b56581f4718741f Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: exception: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '27556f93-2eb2-4f84-9f4e-c204112c7aae'} Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. (HTTP 404) (Request-ID: req-7c8db2a2-556b-44e4-a8ed-44cfaa811476) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:44.883459 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39706aec-e98d-470a-8b53-777d641b3a03 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Returning 404 to user: Snapshot 27556f93-2eb2-4f84-9f4e-c204112c7aae could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39706aec-e98d-470a-8b53-777d641b3a03 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae" status: 404 len: 111 microversion: 2.1 time: 0.091322 Oct 04 18:06:44.892733 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2499/3294] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/os-snapshots/27556f93-2eb2-4f84-9f4e-c204112c7aae => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:44.899061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.899416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.919115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.919840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.921440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.922281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.923492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.925192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.023941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.037060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-599d606d-535e-4f98-b937-83d3c05f670b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1271 microversion: 2.1 time: 0.146605 Oct 04 18:06:45.039402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2500/3295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.049967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5db0c7e7-275a-4272-8911-4f40c1edc48b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.052300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5db0c7e7-275a-4272-8911-4f40c1edc48b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.094446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5db0c7e7-275a-4272-8911-4f40c1edc48b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:45.606389 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.scheduler.client.report [None req-5db0c7e7-275a-4272-8911-4f40c1edc48b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Deleted allocations for instance e4e82252-df33-4334-a638-164e0f8cb151 Oct 04 18:06:45.650700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5db0c7e7-275a-4272-8911-4f40c1edc48b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151" status: 204 len: 0 microversion: 2.1 time: 0.609627 Oct 04 18:06:45.654857 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2501/3296] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:45 2022] DELETE /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:45.660183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.660770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.670381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.860020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-801a4a9c-0dc9-4b4c-bb6c-146e1c2df1d5 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203820 Oct 04 18:06:45.860820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2502/3297] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:45.867094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4eb40224-2fb3-4523-9940-a04b23adf107 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340b81550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.966046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4eb40224-2fb3-4523-9940-a04b23adf107 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 202 len: 0 microversion: 2.1 time: 0.103585 Oct 04 18:06:45.966680 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2503/3298] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:06:45 2022] DELETE /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:45.974401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.975332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.984068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.984831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.985445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.986640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.987527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.988328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.014404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 HTTP/1.1 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e4e82252-df33-4334-a638-164e0f8cb151'} Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:46.016685 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:06:46.022477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:46.024507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:46.025649 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ec64b7e-83bf-4fb1-8998-70abae9f749d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151" status: 404 len: 111 microversion: 2.1 time: 0.057621 Oct 04 18:06:46.037395 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2504/3299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:46.037395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32ffbc4f-d1e6-4498-9164-fa7317a13e8a tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340352dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.201319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32ffbc4f-d1e6-4498-9164-fa7317a13e8a tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 200 len: 344 microversion: 2.1 time: 0.172950 Oct 04 18:06:46.207010 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2505/3300] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:46.215701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.216794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.226525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.227562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.228263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.229265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.229980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.231285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.610587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.624312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a84574e6-e487-44e4-b326-6b696d3aa402 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.415483 Oct 04 18:06:46.625246 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2506/3301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:46.631883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-922934141", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:46.747703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:47.998690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:47.999426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:48.000277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:48.000864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:48.001718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:48.017928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.018417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.026146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.027283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.028602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.029219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.073657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:48.081810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:48.096629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:48.099265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:48.169945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-654079b9-de9c-4646-ab3f-38a55dce59e3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543125 Oct 04 18:06:48.171230 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2507/3302] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:48.177530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72c5b0a8-de53-4e99-9d3b-9b19181438fc tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6340311670>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.247766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72c5b0a8-de53-4e99-9d3b-9b19181438fc tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 200 len: 344 microversion: 2.1 time: 0.074595 Oct 04 18:06:48.255649 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2508/3303] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:48.261045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bbe368-5485-4b89-94df-aa3a724db489", "tag": "b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:48.289366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.292876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.293560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.306986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] Creating event network-changed:b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06 for instance e6bbe368-5485-4b89-94df-aa3a724db489 on n-h2-831193-17 Oct 04 18:06:48.316358 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b7bc6bc2-9d3f-40a6-bf7c-aa210f5f2557 req-084922fe-6197-4260-ab20-fbd75496273a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058388 Oct 04 18:06:48.318416 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2509/3304] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:48.329372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.331125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.349448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.360208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.373584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.385694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.386126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.386572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.729441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.740503 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d48e87a2-fca6-4f68-bbe8-0ea7e1e30f29 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1576 microversion: 2.1 time: 0.419542 Oct 04 18:06:48.755430 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2510/3305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1576 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:48.756537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f9cae0-8338-4236-9ca6-891795c7a5be", "tag": "b4e65e31-94f2-4e74-b432-5bf00844e97b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:48.781339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.783276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.784051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.804439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] Creating event network-changed:b4e65e31-94f2-4e74-b432-5bf00844e97b for instance 26f9cae0-8338-4236-9ca6-891795c7a5be on n-h1-831193-17 Oct 04 18:06:48.810982 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-48347e5a-31cf-4060-8eaf-5f8631d13936 req-7bc2e8db-0df1-49ef-9fcb-3b2fe1e39327 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058981 Oct 04 18:06:48.812762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2511/3306] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:48.825067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.826374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.834084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.835121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.835815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.837566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.838315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.839075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.156613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.166182 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-732c64c7-ec5c-4fcc-8cd3-c69fd210925d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.350595 Oct 04 18:06:49.166786 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2512/3307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.183753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dffc7840-6b37-4d74-941b-70e076e3be12 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.184431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dffc7840-6b37-4d74-941b-70e076e3be12 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.288588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dffc7840-6b37-4d74-941b-70e076e3be12 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.309763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dffc7840-6b37-4d74-941b-70e076e3be12 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1220 microversion: 2.1 time: 0.141163 Oct 04 18:06:49.312675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2513/3308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.331643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe0d2e55-1cde-4c74-a517-5bcea6192745 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f63403528b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.402853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fe0d2e55-1cde-4c74-a517-5bcea6192745 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] HTTP exception thrown: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe0d2e55-1cde-4c74-a517-5bcea6192745 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Request method failure captured: Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 HTTP/1.1 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYpvBv16lYpBvVFRALg3KCSnMSJattzV0cG5TPIK9IexwGwyRQX9KsJD_SAqel5iO6Jf4H5PllJhx38SZbWpsoDGlho13kgL82hqdj4GlwekdLOjZRkcYxzDA_BRAxgR3r6HsSaODKayDsaOaTE6FeEv33DzwoY8pLUNICaHP4za1Y Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b0099825cc4735b20e5a81f3928840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c0ba946e6c9c404a8b56581f4718741f Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: exception: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8b15024b-6327-4da1-8e26-cd34a6c55a79'} Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. (HTTP 404) (Request-ID: req-beecd3b2-aa64-4e44-807f-025be7fcb5e8) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:49.405679 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.410597 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.415126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fe0d2e55-1cde-4c74-a517-5bcea6192745 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Returning 404 to user: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:49.416548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fe0d2e55-1cde-4c74-a517-5bcea6192745 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 404 len: 109 microversion: 2.1 time: 0.099276 Oct 04 18:06:49.417612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2514/3309] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:49.436748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-382e72c7-ccf6-4dcd-a677-7b7cdf029d29 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f6345d774c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.506437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-382e72c7-ccf6-4dcd-a677-7b7cdf029d29 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] HTTP exception thrown: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-382e72c7-ccf6-4dcd-a677-7b7cdf029d29 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Request method failure captured: Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 HTTP/1.1 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYpvBv16lYpBvVFRALg3KCSnMSJattzV0cG5TPIK9IexwGwyRQX9KsJD_SAqel5iO6Jf4H5PllJhx38SZbWpsoDGlho13kgL82hqdj4GlwekdLOjZRkcYxzDA_BRAxgR3r6HsSaODKayDsaOaTE6FeEv33DzwoY8pLUNICaHP4za1Y Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b0099825cc4735b20e5a81f3928840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c0ba946e6c9c404a8b56581f4718741f Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: exception: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8b15024b-6327-4da1-8e26-cd34a6c55a79'} Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. (HTTP 404) (Request-ID: req-c5ff1316-2617-48a9-a212-561eff24b388) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:49.508964 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-382e72c7-ccf6-4dcd-a677-7b7cdf029d29 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Returning 404 to user: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-382e72c7-ccf6-4dcd-a677-7b7cdf029d29 tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 404 len: 109 microversion: 2.1 time: 0.083335 Oct 04 18:06:49.515356 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2515/3310] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:06:49 2022] DELETE /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:49.521527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcc58ad1-c411-4d50-91cd-f8ccdf89e14c tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Calling method '.version_select at 0x7f63403200d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.629106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-bcc58ad1-c411-4d50-91cd-f8ccdf89e14c tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] HTTP exception thrown: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcc58ad1-c411-4d50-91cd-f8ccdf89e14c tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Request method failure captured: Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 HTTP/1.1 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYpvBv16lYpBvVFRALg3KCSnMSJattzV0cG5TPIK9IexwGwyRQX9KsJD_SAqel5iO6Jf4H5PllJhx38SZbWpsoDGlho13kgL82hqdj4GlwekdLOjZRkcYxzDA_BRAxgR3r6HsSaODKayDsaOaTE6FeEv33DzwoY8pLUNICaHP4za1Y Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26b0099825cc4735b20e5a81f3928840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26b0099825cc4735b20e5a81f3928840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 26b0099825cc4735b20e5a81f3928840 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1092518090 Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c0ba946e6c9c404a8b56581f4718741f Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1092518090-project Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: exception: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '8b15024b-6327-4da1-8e26-cd34a6c55a79'} Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. (HTTP 404) (Request-ID: req-16acc41f-cc6f-41ca-9f23-0dc2db8b1126) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:49.632080 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. Oct 04 18:06:49.638403 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:06:49.646383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcc58ad1-c411-4d50-91cd-f8ccdf89e14c tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] Returning 404 to user: Volume 8b15024b-6327-4da1-8e26-cd34a6c55a79 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:49.648197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bcc58ad1-c411-4d50-91cd-f8ccdf89e14c tempest-VolumesSnapshotsTestJSON-1092518090 tempest-VolumesSnapshotsTestJSON-1092518090-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79" status: 404 len: 109 microversion: 2.1 time: 0.131070 Oct 04 18:06:49.649306 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2516/3311] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/os-volumes/8b15024b-6327-4da1-8e26-cd34a6c55a79 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:50.196445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.197802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.226179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.232928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.234762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.244160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.244663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.245114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.780013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.798901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2bb16479-56a5-4ee5-a656-4751e10f6adb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.605347 Oct 04 18:06:50.801859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2517/3312] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:50.830318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.830957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.837874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.843373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.844427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.845366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.846016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.847278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.986211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.001611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c35a4107-4c6a-4e38-9550-858bc26f0cf2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1278 microversion: 2.1 time: 0.193628 Oct 04 18:06:51.004218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2518/3313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.855209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.855895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.884326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.896646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.897957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.903398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.905609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.907930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.192727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.209115 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3896f1d8-9fbf-4bd7-b59c-2e035489774d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.377586 Oct 04 18:06:52.212121 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2519/3314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:52.231711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.238657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.260986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.268003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.268853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.272238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.276399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.277172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.368141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:52.562086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.576153 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa19db40-eda8-42cf-ada2-43a936c1c871 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.362632 Oct 04 18:06:52.577448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2520/3315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.237548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.237548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.245067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.245585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.246025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.246752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.247314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.247801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.845567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.854510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-343db4be-9656-470e-83f8-bda2b48adbf1 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.622611 Oct 04 18:06:53.855913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2521/3316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:53.868289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.869592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.877724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.878777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.879789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.882731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.883897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.884592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.103702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.118750 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-479433cf-f912-4c21-8ec8-2e2a9bff5b6d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.258567 Oct 04 18:06:54.119880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2522/3317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.127361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bbe368-5485-4b89-94df-aa3a724db489", "name": "network-vif-plugged", "status": "completed", "tag": "b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:54.146137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.146903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.147853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.162027 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] Creating event network-vif-plugged:b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06 for instance e6bbe368-5485-4b89-94df-aa3a724db489 on n-h2-831193-17 Oct 04 18:06:54.168020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1158bc2e-b2b2-4306-a09c-9e87a1c35663 req-1f9cfa87-de2e-4881-8850-405ab0b4d229 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046538 Oct 04 18:06:54.172955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2523/3318] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:54.179156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7", "tag": "968d3405-1a87-4b9e-93ba-534488154b81"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:54.189633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.190121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.190750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.228961 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] Creating event network-changed:968d3405-1a87-4b9e-93ba-534488154b81 for instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 on n-h1-831193-17 Oct 04 18:06:54.240441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-90549323-e5c8-4b9b-bb98-a74ed478da26 req-97f45cec-7000-4ede-abe1-970e1c7a0a15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065779 Oct 04 18:06:54.242959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2524/3319] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:54.888507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.889793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.898602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.899969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.900419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.901140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.901599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.902246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.152302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.163680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34b36393-5ca4-44e6-b103-2efdd7b781e4 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1313 microversion: 2.1 time: 0.282985 Oct 04 18:06:55.164975 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2525/3320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.170873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.171791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.180030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.180828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.181552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.182463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.183128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.184745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.437169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.452385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cd34fba-3c54-4328-871f-961509c86231 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.285748 Oct 04 18:06:55.453155 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2526/3321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.189850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.192439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.208296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.209186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.210433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.211874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.217934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.218719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.851433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.876262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e23ccd90-e866-41b9-a7f3-edc67a61556d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1500 microversion: 2.1 time: 0.689974 Oct 04 18:06:56.878057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2527/3322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1500 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:56.891585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.892441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.907167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.910826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.911636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.914681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.918426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.919559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.560724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.590607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e21538bd-b4af-4f9e-9fff-445871c440af tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.710347 Oct 04 18:06:57.591766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2528/3323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.618424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:57.624613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.661369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.661885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.662333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.663635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.664101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.664542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.759959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lazy-loading 'flavor' on Instance uuid e6bbe368-5485-4b89-94df-aa3a724db489 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:58.001187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e638f0b-2e8a-41e0-a947-9515d66585d9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "POST /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489/action" status: 200 len: 32 microversion: 2.1 time: 0.399271 Oct 04 18:06:58.001938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2529/3324] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:57 2022] POST /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:58.025991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.030891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.051139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.052628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.070461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.072177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.072695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.075375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.076629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:58.753613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.766749 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b96ea14-d4cb-4777-a07d-5de284155298 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.751692 Oct 04 18:06:58.770475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2530/3325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.780815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.786338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.799969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.806111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.806797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.807756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.808398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.809022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.302482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=24 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:59.436723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.462216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f10c690-5074-40be-8efb-7ba5922dcdab tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.689949 Oct 04 18:06:59.463210 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2531/3326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.801802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.802802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.837555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.839398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.842145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.843299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.844486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.847627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.562520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.576573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-859d62e1-bd26-4627-ba6f-2030c30498eb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.777154 Oct 04 18:07:00.578664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2532/3327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:00.596208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.597130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.606342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.608648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.610680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.614975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.615984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.616627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.122361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.141365 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64d0468d-2e48-485c-a35e-2b3b579edee4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.558284 Oct 04 18:07:01.142587 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2533/3328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.150388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7", "name": "network-vif-plugged", "status": "completed", "tag": "968d3405-1a87-4b9e-93ba-534488154b81"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:01.174973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.177141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.177894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.206279 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] Creating event network-vif-plugged:968d3405-1a87-4b9e-93ba-534488154b81 for instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 on n-h1-831193-17 Oct 04 18:07:01.218956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4186bd9c-f579-4525-80c8-aa7457b87c86 req-8cc3f33f-aee4-4a97-8703-634aef250201 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074234 Oct 04 18:07:01.221390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2534/3329] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:01.604612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.605328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.612864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.614026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.614813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.615570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.617141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.617745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.862364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.871461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b7ff488-0bc5-456d-bda2-aeabe94046e5 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.271547 Oct 04 18:07:01.883644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2535/3330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:01.886429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b51c356-f891-415e-8916-bd7304162cb9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Action: 'create', calling method: .version_select at 0x7f63402dbe50>, body: {"keypair": {"name": "tempest-keypair-2110894610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxKycAqrXB49Qp3tzp43n2i974khwdTig8ryImspjkvzNbWRPbwjLVn7gj0xU2ddOBDH0njjwASjxv4cnAidIfKAiqHM+E8N6RMl9jHf1jADsNoWipeW0ZXHV/X7EtQnw=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:01.898334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:01.924594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b51c356-f891-415e-8916-bd7304162cb9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Getting quotas for project 5e65f5db8d314ebb8ccc0d1f517cc3a5. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:01.931937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b51c356-f891-415e-8916-bd7304162cb9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Getting quotas for user d608be5dc41f4cc486dfe306b72ab8da and project 5e65f5db8d314ebb8ccc0d1f517cc3a5. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:01.969790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1b51c356-f891-415e-8916-bd7304162cb9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.092777 Oct 04 18:07:01.971705 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2536/3331] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 18:07:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:07:01.981378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.982029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.990113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.991064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.991522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.992245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.993746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.994366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.232186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.234937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:02.246376 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17787ea1-27e4-4225-ab5d-f04413474c54 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.269176 Oct 04 18:07:02.265197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2537/3332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.277941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.278728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.286158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.286905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.287663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.289184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.289859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.290512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.505939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.525612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e357d14a-89d6-464c-b766-3e673f544db6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1320 microversion: 2.1 time: 0.258861 Oct 04 18:07:02.526901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2538/3333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.533505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.534727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.559144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.559494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.560253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.561299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.561944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.562657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.866808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.875582 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0d213c9-a0d7-4558-bef2-1b03e8bb250d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.347158 Oct 04 18:07:02.887259 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2539/3334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.900555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.901174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.908598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.909091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.909936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.910840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.911511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.911937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.201013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.219444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-928ef539-17c4-4def-88b3-625aec43af3b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.323223 Oct 04 18:07:03.238829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2540/3335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.246539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.247469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.259791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.261335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.262761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.264675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.265869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.266977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.578695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.587484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9bd3239-71bd-4c87-880d-45f5d5ba0d74 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.346509 Oct 04 18:07:03.594502 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2541/3336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.611088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.612076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.620929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.623214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.623667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.624468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.624976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.628762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.962995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.982558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d0d436e-1859-4192-8998-e30edca3eaf0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1501 microversion: 2.1 time: 0.385339 Oct 04 18:07:03.983234 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2542/3337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.988446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.989842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.996539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.997462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.998231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.999359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.000644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.001859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.233674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.241922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fdc40322-89ef-4bfa-bdf6-0bbcbbd1ff73 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.257595 Oct 04 18:07:04.243120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2543/3338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:04.253277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.253847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.270099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.270897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.271577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.273072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.273719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.275254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.963872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.979312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c100f5d-8b3a-4f55-98fc-78479b8f51a5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 200 len: 1501 microversion: 2.1 time: 0.734155 Oct 04 18:07:04.980871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2544/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 1501 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:04.990086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.991691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.001081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.003019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.004464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.005424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.006292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.008157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.227076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.238780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cee73a7-f670-46b6-bdcc-7903a93913cb tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.255932 Oct 04 18:07:05.250382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2545/3340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:05.264299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1647290158", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "89fe5a7e-7761-4d04-bb95-deb9053990c0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:05.343060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] validate_networks() for [('89fe5a7e-7761-4d04-bb95-deb9053990c0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:05.785530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:05.786007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:05.786496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:05.786911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:05.787500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:05.798694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.799277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.799836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.800699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.801386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.801655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.824503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:05.831760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:05.847249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:05.850796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:05.905331 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eabe7b18-175c-4df8-9643-ff4d8e254a5f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654375 Oct 04 18:07:05.914031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2546/3341] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:05.922391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:05.923094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.932364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.932364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.932364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.933477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.933477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.933477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.974358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:06.104721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d035fe5-ad14-48c9-9592-0f5ad4700ad2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 204 len: 0 microversion: 2.1 time: 0.191860 Oct 04 18:07:06.105445 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2547/3342] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:05 2022] DELETE /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:06.113671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1374101806", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1bb5d19f-6f12-4c45-acf9-ba01e617576c"}, {"port": "221dcea7-bb25-4ec6-9a42-c8b92651d758", "tag": "port-1"}, {"port": "a9d193dc-3032-412e-b7ce-9b340178f836", "tag": "port-2"}, {"uuid": "e07ba20c-0a74-4cf7-829c-f7d87c8794ec", "tag": "net-1"}, {"uuid": "e07ba20c-0a74-4cf7-829c-f7d87c8794ec"}, {"uuid": "d51f2676-2bda-48ff-bb0b-c3362d93a6a4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d51f2676-2bda-48ff-bb0b-c3362d93a6a4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "765c6f07-ecc8-4f2c-bbc0-3c83f1afefad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0fc66fea-7c24-4072-a09f-d6a0c9f15675", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "66b59bd5-dd9d-49b3-9b8d-de588b50ff5a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1018586493"}], "key_name": "tempest-keypair-2110894610", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:06.259343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] validate_networks() for [('1bb5d19f-6f12-4c45-acf9-ba01e617576c', None, None, None, None, None), (None, None, '221dcea7-bb25-4ec6-9a42-c8b92651d758', None, None, None), (None, None, 'a9d193dc-3032-412e-b7ce-9b340178f836', None, None, None), ('e07ba20c-0a74-4cf7-829c-f7d87c8794ec', None, None, None, None, None), ('e07ba20c-0a74-4cf7-829c-f7d87c8794ec', None, None, None, None, None), ('d51f2676-2bda-48ff-bb0b-c3362d93a6a4', '10.2.2.100', None, None, None, None), ('d51f2676-2bda-48ff-bb0b-c3362d93a6a4', '10.2.2.200', None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:09.616389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:09.617092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:09.617311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:09.617725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:09.618132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:09.630385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.631214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.632455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.633408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.634260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.635409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.659334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Getting quotas for project 5e65f5db8d314ebb8ccc0d1f517cc3a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:09.666878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Getting quotas for user d608be5dc41f4cc486dfe306b72ab8da and project 5e65f5db8d314ebb8ccc0d1f517cc3a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:09.985921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:09.989334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='765c6f07-ecc8-4f2c-bbc0-3c83f1afefad',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0fc66fea-7c24-4072-a09f-d6a0c9f15675',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66b59bd5-dd9d-49b3-9b8d-de588b50ff5a',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:10.624732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aad70e4e-6a93-4880-9520-3e566c86e66b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.517802 Oct 04 18:07:10.627257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2548/3343] 10.222.0.33 () {62 vars in 1189 bytes} [Tue Oct 4 18:07:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 4521 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:07:10.632577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.643005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.651426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.651930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.653174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.654009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.654681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.655309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.394285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.411972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c451515-1a7d-4f53-a307-4e728aa91366 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1315 microversion: 2.1 time: 0.783032 Oct 04 18:07:11.413981 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2549/3344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:11.420129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.421484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:11.431333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.432627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.434229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.435248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.436152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.437015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.461668 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 HTTP/1.1 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7'} Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:11.466545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:07:11.470622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:11.472157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:11.474455 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3a76803-93e9-455b-b48f-ee3917058fe3 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 404 len: 111 microversion: 2.1 time: 0.058725 Oct 04 18:07:11.476486 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2550/3345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:11.492376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.493282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:11.504794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.505546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.506374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.508793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.510080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.511503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.946917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.960006 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7d55aa3-f21e-4aed-8474-2e7139a96380 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.480483 Oct 04 18:07:11.965421 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2551/3346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:11.976882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7", "name": "network-vif-deleted", "tag": "968d3405-1a87-4b9e-93ba-534488154b81"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.003995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.004973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.005862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.030645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] Creating event network-vif-deleted:968d3405-1a87-4b9e-93ba-534488154b81 for instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 on n-h1-831193-17 Oct 04 18:07:12.039707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3e009e79-bfb6-4c89-b223-af898c54b6d1 req-593dc39e-0ff5-4c33-8647-3e718f88c599 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070302 Oct 04 18:07:12.041284 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2552/3347] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.052015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.054203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.166787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.176498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.179618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.181346 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b46b45e5-26b3-4697-8d78-5e7a94ab457a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1286 microversion: 2.32 time: 0.137421 Oct 04 18:07:12.182127 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2553/3348] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:12.196469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3590b482-7fc7-4bbb-9cf5-96f5ab88b508 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: .version_select at 0x7f63402ed3a0>, body: {"keypair": {"name": "tempest-key-2075814689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXwxd/Ib5+q7FgZ9T+nUAqH6ymkQfJ2RAX1ceLXKznkDENiledgiMB7n1pDDQfUDodWJwHqYjQcdwTe0la73vXMQSzZVy2RP5oYCe2jnLF/s/QPbuSkXrHGMS3ycmi11w=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.220447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3590b482-7fc7-4bbb-9cf5-96f5ab88b508 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:12.233341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3590b482-7fc7-4bbb-9cf5-96f5ab88b508 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:12.272489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3590b482-7fc7-4bbb-9cf5-96f5ab88b508 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.089066 Oct 04 18:07:12.273307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2554/3349] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:07:12 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.278381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c50aba5-e3bc-4cee-a446-910e3fe4e07e", "tag": "050ef49a-33b3-47d1-b077-6af28b7148ee"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.291919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.292414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.292847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.312044 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] Creating event network-changed:050ef49a-33b3-47d1-b077-6af28b7148ee for instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e on n-h1-831193-17 Oct 04 18:07:12.317475 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b440bcc1-0aa4-456e-8439-52c001a1d577 req-908636d5-c700-429f-adf9-56d21ae31738 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042705 Oct 04 18:07:12.318690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2555/3350] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.324538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69148e46-553a-4f80-a8b9-0a261c989e5b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '.version_select at 0x7f6345d87d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.329888 n-d-831193-17 devstack@n-api.service[128770]: WARNING oslo_db.sqlalchemy.utils [None req-69148e46-553a-4f80-a8b9-0a261c989e5b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:07:12.336164 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69148e46-553a-4f80-a8b9-0a261c989e5b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015964 Oct 04 18:07:12.336751 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2556/3351] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.440722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.441492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.444757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:12.455812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.456322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.456772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.457499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.459754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.461407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.648340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.659490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1359422a-2c68-4cd7-a8b4-864a6146e2e9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1315 microversion: 2.1 time: 0.223116 Oct 04 18:07:12.660670 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2557/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:12.667174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1945471975", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-key-2075814689", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.731331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:13.237359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:13.237973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:13.239147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:13.239566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:13.239981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:13.250856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.251519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.251970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.252712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.253183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.253618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.273837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:13.279953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:13.316354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:13.319017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:13.394327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-229a5ae9-935f-49e7-b4c0-8f067a40ad6c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732094 Oct 04 18:07:13.395479 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2558/3353] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:13.401326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.401886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.415367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.415876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.416370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.417107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.417565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.417990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.764352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.766640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:13.779516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64694883-429d-4b57-bab2-b4fda17f508b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.382876 Oct 04 18:07:13.783607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2559/3354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.794080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.796786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.811662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.812348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.812958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.814134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.814811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.815447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.096843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.123633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.125421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.134992 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af924c27-1ac1-4347-90be-6b084204782c tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1576 microversion: 2.32 time: 0.348701 Oct 04 18:07:14.137309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2560/3355] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1576 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:14.167265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-09f4d37c-fb9b-4b21-8649-6840b4fd13c9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.179919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-09f4d37c-fb9b-4b21-8649-6840b4fd13c9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.478599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09f4d37c-fb9b-4b21-8649-6840b4fd13c9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.488089 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-09f4d37c-fb9b-4b21-8649-6840b4fd13c9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1229 microversion: 2.1 time: 0.347840 Oct 04 18:07:14.489850 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2561/3356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1229 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.503130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.504443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.544089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.544609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.557639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.559985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.560473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.561110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.165113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.179435 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9699418b-a8f2-4541-9f5c-d487206d1216 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1315 microversion: 2.1 time: 0.684696 Oct 04 18:07:15.196214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2562/3357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:15.216540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.217216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.235980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.236828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.241224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.247157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.248741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.251973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.592378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.617961 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf2a0f90-090f-48a1-ba3c-01cc4eeb5b57 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.418423 Oct 04 18:07:15.620091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2563/3358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:15.633830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.635101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.655353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.656110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.659810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.660985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.661692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.662301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.822118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.842503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.864155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.877898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c54d995-de5e-4785-9b98-8665e0301478 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1594 microversion: 2.32 time: 0.256158 Oct 04 18:07:15.879917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2564/3359] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1594 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:15.889784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.890919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.913598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.913973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.914903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.923759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.927322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.928815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.102283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.118788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bd2f2e3-1ede-4f1a-b404-9e7144789685 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1289 microversion: 2.1 time: 0.235427 Oct 04 18:07:16.119627 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2565/3360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1289 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.207008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.208465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.223240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.224015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.224652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.226147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.228680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.230365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.799930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.818144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f663894-768d-4f16-aabf-8f53985aa36e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1315 microversion: 2.1 time: 0.613468 Oct 04 18:07:16.822425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2566/3361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:16.837225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.840731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.858326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.859493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.861888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.863139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.865454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.867826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.285148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.304419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70ba9360-1476-473b-8c73-23fb0bdaa335 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.480506 Oct 04 18:07:17.305261 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2567/3362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:17.310423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.316857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.329617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.330583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.331652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.334610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.335324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.337948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.658360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.678584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.681304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.723286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14b194ce-eea8-474f-b673-456221a68748 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1662 microversion: 2.32 time: 0.395184 Oct 04 18:07:17.748129 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2568/3363] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1662 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:17.761096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.765763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.789268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.789771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.790236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.790995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.791661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.792249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.172842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.185237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-342e2777-4a0e-4137-9043-527cde26fd10 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1329 microversion: 2.1 time: 0.434642 Oct 04 18:07:18.200696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2569/3364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1329 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.211913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c50aba5-e3bc-4cee-a446-910e3fe4e07e", "name": "network-vif-plugged", "status": "completed", "tag": "050ef49a-33b3-47d1-b077-6af28b7148ee"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:18.229496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.232128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.232986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.270258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] Creating event network-vif-plugged:050ef49a-33b3-47d1-b077-6af28b7148ee for instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e on n-h1-831193-17 Oct 04 18:07:18.283455 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5336934a-9eda-485e-aeb3-2a9d2af6af65 req-5b723249-4cc7-47ae-8ed3-f391e71f51af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077441 Oct 04 18:07:18.284761 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2570/3365] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:18.325366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.326156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.373579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.374158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.376814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.382339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.386465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.389042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.995238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.009873 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac3c51bd-11a9-45af-aa66-ba687327dbef tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1315 microversion: 2.1 time: 0.723563 Oct 04 18:07:19.020566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2571/3366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.032003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.033187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.048309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.048987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.049478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.050168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.050629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.054577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.549091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.562737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a79f9bb0-410b-4e94-b78e-93c945a1ba7d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.541964 Oct 04 18:07:19.580482 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2572/3367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.594242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.594870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.608068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.609357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.610045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.612126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.613058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.613693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.026412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.045051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.046596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.056106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cb4576f-e041-4851-a695-3ced954ec4ef tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1756 microversion: 2.32 time: 0.473982 Oct 04 18:07:20.057067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2573/3368] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1756 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:20.076616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.077254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.088835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.089578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.092880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.093834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.094693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.095457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.835197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.854164 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a5e52fd-3c25-45ce-a385-759ede326c33 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1329 microversion: 2.1 time: 0.782745 Oct 04 18:07:20.854857 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2574/3369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1329 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:20.861607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.862234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.890673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.892761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.893519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.898764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.904454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.905253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.446437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.460082 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b99e543b-0441-45fe-b3a4-938fddce0f30 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1502 microversion: 2.1 time: 0.601608 Oct 04 18:07:21.460704 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2575/3370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:21.471660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.472559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.488059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.490299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.491329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.495774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.498046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.499700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.232766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.248603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d771006-8cd3-45b0-ad42-06cc59b7843d tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.786792 Oct 04 18:07:22.249212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2576/3371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.259865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c068d3b-1bd6-435a-96f9-11685a80e750", "tag": "fee1d8e7-c8c2-41ed-befe-ada6c0d7532d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:22.304157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.304641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.305077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.335682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] Creating event network-changed:fee1d8e7-c8c2-41ed-befe-ada6c0d7532d for instance 6c068d3b-1bd6-435a-96f9-11685a80e750 on n-h2-831193-17 Oct 04 18:07:22.343529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-565f6478-1ba1-4c51-8255-8811dfdf3eb5 req-3ffc2fea-e751-4a40-96ca-16d92818e9d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092661 Oct 04 18:07:22.344916 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2577/3372] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:22.357459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.359438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.368052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.368978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.372180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.374741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.375934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.377100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.678698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.681505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:22.695787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.696759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.698235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-53e8354b-87a7-4350-8182-c7cd4d731f00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1850 microversion: 2.32 time: 0.351992 Oct 04 18:07:22.700119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2578/3373] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1850 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:22.707116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:22.707969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.717069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.717857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.718472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.719816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.720479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.721103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.921923 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Removing security group e6cbc5b6-cb91-4894-816c-fcfb930861b8 from port 050ef49a-33b3-47d1-b077-6af28b7148ee Oct 04 18:07:23.261672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:23.851273 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9523f39c-e6ec-4198-b7c0-c0b4c9ad547d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e/action" status: 202 len: 0 microversion: 2.1 time: 1.149144 Oct 04 18:07:23.851895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2579/3374] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:22 2022] POST /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:23.858075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.858904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.876609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.879253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.879770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.880536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.884380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.885076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.485742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=30 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:24.499369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.518740 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc62609e-af42-48f3-9d07-e8a634a3ebe2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1329 microversion: 2.1 time: 0.665413 Oct 04 18:07:24.524521 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2580/3375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1329 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:24.549089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "0f7f691a-70c9-4c81-9bdf-3ee37b61118f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:24.605521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.611493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.614568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.655758 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] Creating event network-changed:0f7f691a-70c9-4c81-9bdf-3ee37b61118f for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:24.663627 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fec328ec-049d-48b6-a854-50a02893574a req-64cf8d66-ea4d-4a30-84de-6daa7b49461c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136300 Oct 04 18:07:24.666499 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2581/3376] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:24.685906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.690504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.715667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.723677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.725589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.727800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.728795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.730163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.264931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.278346 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a095cb79-ad7b-491f-b561-7d274193d7c9 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.610051 Oct 04 18:07:25.297089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2582/3377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.313537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.326864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.330736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Searching by: {'deleted': False, 'project_id': '6dec7c37c13640f398452d758418fe91'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:07:25.341846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.342581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.343167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.344172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.344847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.345578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.399014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:07:25.436710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-adb8288b-20f6-4bee-b33b-9278fd67ed4d tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.138211 Oct 04 18:07:25.437381 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2583/3378] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers => generated 334 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:25.443542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.445062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.452437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.453057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.453579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.454556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.455396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.456138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.777304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.795359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.800976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.802557 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4345ac51-2ce1-4724-b190-75b264965dbb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 0.364213 Oct 04 18:07:25.804024 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2584/3379] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:25.813018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.838175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.852279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.853103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.855947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.856990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.858360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.861242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.234610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.260784 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-180abcaf-b31f-47e0-a858-0e33726b085e tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1460 microversion: 2.1 time: 0.454571 Oct 04 18:07:26.269714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2585/3380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1460 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:26.281305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c50aba5-e3bc-4cee-a446-910e3fe4e07e", "tag": "050ef49a-33b3-47d1-b077-6af28b7148ee"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:26.315462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.317186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.317738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.350263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] Creating event network-changed:050ef49a-33b3-47d1-b077-6af28b7148ee for instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e on n-h1-831193-17 Oct 04 18:07:26.356612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a5b5bd30-a83b-4612-840d-c48d7d697a30 req-f9c0ae7e-d62f-417e-a580-2b26d26f6628 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084634 Oct 04 18:07:26.357258 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2586/3381] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:26.362507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.370076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.371550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Searching by: {'deleted': False, 'project_id': '6dec7c37c13640f398452d758418fe91'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:07:26.379217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.380542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.381710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.384491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.385994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.386680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.423988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:07:26.510003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.531123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.535672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.539183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.911677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cac3b306-e35f-4043-9de7-cdc8c51e0b3a tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.553153 Oct 04 18:07:26.912857 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2587/3382] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:26.918505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.919374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.933041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.933918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.934538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.935977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.936774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.938101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.400886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.436641 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88f8e46f-5bb7-48f0-819d-b08fe0db92f4 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1329 microversion: 2.1 time: 0.522336 Oct 04 18:07:27.441376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2588/3383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1329 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:27.454152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c068d3b-1bd6-435a-96f9-11685a80e750", "name": "network-vif-plugged", "status": "completed", "tag": "fee1d8e7-c8c2-41ed-befe-ada6c0d7532d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:27.493560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.494448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.495261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.521198 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] Creating event network-vif-plugged:fee1d8e7-c8c2-41ed-befe-ada6c0d7532d for instance 6c068d3b-1bd6-435a-96f9-11685a80e750 on n-h2-831193-17 Oct 04 18:07:27.531524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-10e039e5-8276-408d-a228-b3d144357565 req-27367319-ec1f-4a65-aebe-a5e5e6fb113a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086493 Oct 04 18:07:27.532132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2589/3384] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:27.543331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.544057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.560451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.560959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.565424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.566406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.567046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.567631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.865881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.876608 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85ae0dbe-0735-4fbd-a388-5d8a071354fb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.343165 Oct 04 18:07:27.877759 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2590/3385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:27.899950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.900738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.907698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.908734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.910287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.911307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.912272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.914016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.246374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.256212 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-556268ff-313b-4712-b5a5-5908a11a829e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.376619 Oct 04 18:07:28.256924 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2591/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:28.265346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "221dcea7-bb25-4ec6-9a42-c8b92651d758"}, {"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "a9d193dc-3032-412e-b7ce-9b340178f836"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:28.276352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.276905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.277344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.295282 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Creating event network-changed:221dcea7-bb25-4ec6-9a42-c8b92651d758 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:28.295811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] Creating event network-changed:a9d193dc-3032-412e-b7ce-9b340178f836 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:28.303871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f13ecdb5-515a-4515-8b51-deeaf74d9604 req-2accb0e8-86e4-42f1-98f0-f3de3d670888 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044655 Oct 04 18:07:28.308946 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2592/3387] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:28.322525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.324641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.349449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.350514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.350961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.351722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.352182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.352611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.788104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.806776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.832713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.834701 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a61f78d4-7143-44bf-a66a-4646d8e65b00 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 0.523890 Oct 04 18:07:28.836005 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2593/3388] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:28.852322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-944e573e-7b4e-4fee-92eb-58116f79ca0f tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.861126 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-944e573e-7b4e-4fee-92eb-58116f79ca0f tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023747 Oct 04 18:07:28.862417 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2594/3389] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:28.868118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.869033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.877146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.878000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.878720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.879711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.880823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.881515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.167390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.179781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b25dc7af-f44f-4de9-bc53-8048525d7259 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 1.315926 Oct 04 18:07:30.196004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2595/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.210297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.211334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.219754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.220511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.221156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.222164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.222781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.223564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.430566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.443353 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40e26fa5-8fbd-4fe5-8044-83af34f033c6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1510 microversion: 2.1 time: 0.245553 Oct 04 18:07:30.444614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2596/3391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.463290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.464118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.470924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:30.473111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.473877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.474532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.476665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.477173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.477611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.515300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:30.550997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:30.658698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5694b9b-ec0c-40ea-9af6-7ca86e428f53 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "DELETE /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 204 len: 0 microversion: 2.1 time: 0.212134 Oct 04 18:07:30.660041 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2597/3392] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:30 2022] DELETE /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:30.667082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.669505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.676772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.677433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.678539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.679449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.680000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.680811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.905620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.918612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40c40385-103f-4ca8-987c-0cdfd0a3b6c3 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1486 microversion: 2.1 time: 0.256824 Oct 04 18:07:30.919790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2598/3393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1486 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.936777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.940868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.958865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.960159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.960595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.961317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.963612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.963612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.338790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.352233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.355872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.358205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-422baf77-6556-41ed-b172-1c77fb45dd58 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 0.437139 Oct 04 18:07:31.358802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2599/3394] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:31.370616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.374258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.388447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.392255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.392882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.393929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.394655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.395299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.723150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.741433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdef181d-9d26-41c2-aabb-da268f4815d1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.377090 Oct 04 18:07:31.743581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2600/3395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:31.754574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "dbaf9de8-4490-44cd-8050-c66a830aa234"}, {"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "faa992a7-5058-4ea9-a4f0-2b9848cbf70a"}, {"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "ad62896c-72ad-460e-977d-df032390cb99"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:31.772652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.773944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.774714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.794491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Creating event network-changed:dbaf9de8-4490-44cd-8050-c66a830aa234 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:31.794802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Creating event network-changed:faa992a7-5058-4ea9-a4f0-2b9848cbf70a for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:31.797379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] Creating event network-changed:ad62896c-72ad-460e-977d-df032390cb99 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:31.805927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e1679e05-01ae-4366-82bc-7f205c32378c req-2d86d769-d510-41ad-ab38-f926859c62a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.058775 Oct 04 18:07:31.807479 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2601/3396] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:31.815706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.816763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.827201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.828056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.828625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.829527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.830102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.830643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.449985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.463119 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6c7a7cd-dfa9-4285-b6c6-7569dec0ec5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1510 microversion: 2.1 time: 0.653009 Oct 04 18:07:32.464871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2602/3397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:32.495594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.495594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:32.511724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.512911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.513366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.514100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.515511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.515511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.213813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252ad175b2714c8e99eac27dbc0fc969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dec7c37c13640f398452d758418fe91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.227444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae2cec94-f3d9-463c-af9f-c49a796fa414 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 200 len: 1701 microversion: 2.1 time: 0.760640 Oct 04 18:07:33.228448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2603/3398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 1701 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:33.264197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.267320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.290384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.445605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f10a59d6-3d0d-48a8-ba16-e31e1e21e42b tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "POST /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489/action" status: 202 len: 0 microversion: 2.1 time: 0.188261 Oct 04 18:07:33.447416 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2604/3399] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:33.462345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.465802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.478770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.479994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.481001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.482674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.484390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.485445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.670282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.692254 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-002ef169-d9da-4ac1-87b1-b162fa4ae971 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 1.240499 Oct 04 18:07:34.697354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2605/3400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:33 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.744687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.751734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:34.786357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.787817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.788596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.789878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.790716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.791518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.695456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.721374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.729149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.731600 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0c577bd-d212-4359-840c-5696c70c85cb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 1.032440 Oct 04 18:07:35.734104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2606/3401] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:35.753877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.755014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.769223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.770534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.771165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.786754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.788344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.788998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.825911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:35.956894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c2bf55f-4edc-4a36-ae17-608a5ace308a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 204 len: 0 microversion: 2.1 time: 0.220631 Oct 04 18:07:35.958170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2607/3402] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:35 2022] DELETE /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:35.966371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.967539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.980278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.980983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.981976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.983058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.984102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.984717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.404242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:36.506181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:36.785233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.796550 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-661c7a94-a7fb-4997-80b9-9d18a98206f2 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1494 microversion: 2.1 time: 0.835299 Oct 04 18:07:36.796881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2608/3403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1494 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.808534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "acd4770c-3b15-4922-a6b2-3bd6ed249eca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:36.870387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.871691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.872774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.923831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] Creating event network-changed:acd4770c-3b15-4922-a6b2-3bd6ed249eca for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:07:36.949487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e80e1e06-d247-490b-b01d-2190d774b9d5 req-49773fda-e241-4227-89f2-709d0b0be20d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149775 Oct 04 18:07:36.951343 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2609/3404] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:36.964211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.965380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] [instance: 26f9cae0-8338-4236-9ca6-891795c7a5be] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.980749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.982708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.984068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.985707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.986834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.987949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.017468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] HTTP exception thrown: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Request method failure captured: Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be HTTP/1.1 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdJpunXULZkFupsQCbomjULb-4kPZDigh1djZiC0yA3h2LWb8D97abX7S8ofOPtBEtLDRe4gZgYroqG4xsxa3vezSR9twuin7u1NRq0gLgSuuD6s2__fxm704MU5LyCS-_uTp8P2USzV_2bpQQPqiVfzn8Hho47e-KKrBGWZ4KaQc Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 6dec7c37c13640f398452d758418fe91 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-784974949 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6dec7c37c13640f398452d758418fe91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6dec7c37c13640f398452d758418fe91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6dec7c37c13640f398452d758418fe91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6dec7c37c13640f398452d758418fe91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-784974949 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 6dec7c37c13640f398452d758418fe91 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-784974949 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-784974949-project Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 252ad175b2714c8e99eac27dbc0fc969 Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-784974949-project Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '26f9cae0-8338-4236-9ca6-891795c7a5be'} Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:37.020338 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. Oct 04 18:07:37.024965 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:37.026978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Returning 404 to user: Instance 26f9cae0-8338-4236-9ca6-891795c7a5be could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:37.027728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8bdd483e-5f8e-4220-b0a5-44085c14a781 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be" status: 404 len: 111 microversion: 2.1 time: 0.074507 Oct 04 18:07:37.028732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2610/3405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/26f9cae0-8338-4236-9ca6-891795c7a5be => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:37.034438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1596437863", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "89fe5a7e-7761-4d04-bb95-deb9053990c0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:37.114513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] validate_networks() for [('89fe5a7e-7761-4d04-bb95-deb9053990c0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:38.511529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:38.513013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:38.513660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:38.514229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:38.514799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:38.525410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.526247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.526900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.527894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.528897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.529544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.550444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:38.559170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Getting quotas for user 76b85216915b4f62a9792a82adffc05c and project 2ba6215ca0f94666914353478323a7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:38.593378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:38.603548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:38.699922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae2c85ce-a989-4906-99b0-204a745f659d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669795 Oct 04 18:07:38.700907 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2611/3406] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:38.713011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.716939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.726412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.727428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.728068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.729396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.730136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.730814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.229199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.245736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29ab3821-66e9-482a-8f69-8f9f41db7eb2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 200 len: 1516 microversion: 2.1 time: 0.543462 Oct 04 18:07:39.263604 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2612/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 1516 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.269151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.270089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.277487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.278351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.279007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.279973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.280652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.281304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.311982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:39.997456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.027268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.030737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.033796 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fdbf9151-8548-41e2-aef1-e51803fc8131 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 0.768703 Oct 04 18:07:40.036051 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2613/3408] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:40.067775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c21f28b9-b7fd-44a1-acf1-a4bd40892a34 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] Calling method '.version_select at 0x7f63402bf4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.119774 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c21f28b9-b7fd-44a1-acf1-a4bd40892a34 tempest-ServersTestJSON-784974949 tempest-ServersTestJSON-784974949-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979477957" status: 202 len: 0 microversion: 2.1 time: 0.082237 Oct 04 18:07:40.120891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2614/3409] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979477957 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:40.128704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.135761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.143270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.144802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.145503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.147657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.148347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.148993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.050153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.071849 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e8d9a85-5275-4b32-ab65-6085cc0d400e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1500 microversion: 2.1 time: 0.944890 Oct 04 18:07:41.075413 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2615/3410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1500 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.109411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.111095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.145508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.148463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.150928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.155423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.159853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.162434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.466611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.492813 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11c7db31-1222-4b4d-b77c-6615b3146778 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1273 microversion: 2.1 time: 0.411277 Oct 04 18:07:41.507746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2616/3411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.513802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f9cae0-8338-4236-9ca6-891795c7a5be", "name": "network-vif-deleted", "tag": "b4e65e31-94f2-4e74-b432-5bf00844e97b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:41.557908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.562055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.565250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.594585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] Creating event network-vif-deleted:b4e65e31-94f2-4e74-b432-5bf00844e97b for instance 26f9cae0-8338-4236-9ca6-891795c7a5be on n-h1-831193-17 Oct 04 18:07:41.603574 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a61aacbe-ac8c-4e25-96e8-54323e564349 req-d958080f-bc75-4ab4-ba1c-b6ae03e422f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093457 Oct 04 18:07:41.604737 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2617/3412] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:41.611806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c068d3b-1bd6-435a-96f9-11685a80e750", "name": "network-vif-deleted", "tag": "fee1d8e7-c8c2-41ed-befe-ada6c0d7532d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:41.625788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.626543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.627342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.643362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] Creating event network-vif-deleted:fee1d8e7-c8c2-41ed-befe-ada6c0d7532d for instance 6c068d3b-1bd6-435a-96f9-11685a80e750 on n-h2-831193-17 Oct 04 18:07:41.649578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-45b77a25-c974-43bf-9888-1c75320921e7 req-86d00816-8c27-45e2-807d-c42e9e4e0106 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043071 Oct 04 18:07:41.652269 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2618/3413] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:41.659454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.660383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.669643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.670391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.671136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.672565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.673474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.673916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.691653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 HTTP/1.1 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6c068d3b-1bd6-435a-96f9-11685a80e750'} Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:41.694167 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d17084c9-d2c7-4876-befd-fbd18f6c5067 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 404 len: 111 microversion: 2.1 time: 0.041874 Oct 04 18:07:41.697558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2619/3414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:41.701789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.702411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.713125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.713935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.715421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.716649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.717478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.718249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.326721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.343136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.344905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.346146 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9870606f-d14a-4b47-bc51-ba4812d10288 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1892 microversion: 2.32 time: 0.648488 Oct 04 18:07:42.347747 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2620/3415] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1892 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:42.353227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.354013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.361857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.362777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.363539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.365252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.365984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.366629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.396296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:42.524544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5461aa9-2b95-4194-a071-e6a77d1fb24f tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 204 len: 0 microversion: 2.1 time: 0.172343 Oct 04 18:07:42.525285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2621/3416] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:42 2022] DELETE /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:42.848451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1341896992", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "4800f1b2-443c-4aed-ac71-5f3a1ae4efea"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:42.944723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] validate_networks() for [('4800f1b2-443c-4aed-ac71-5f3a1ae4efea', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:44.109033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:44.110563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:44.111175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:44.111597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:44.112312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:44.123370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.123861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.124292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.125286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.125749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.126278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.148373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Getting quotas for project 0a52c4aa12b342eea9763b6e8b11ba06. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:44.155362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Getting quotas for user 8c54ba1766f446cca985dd529b3f5c66 and project 0a52c4aa12b342eea9763b6e8b11ba06. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:44.171833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:44.175953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:44.239362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f81eb1f-8e5e-454f-a4fc-ea41b0185dbe tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712205 Oct 04 18:07:44.240492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2622/3417] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:44.247557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35f14840-8320-42e6-b7f4-5a933ea52242 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '.version_select at 0x7f634024baf0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.263414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:44.279284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35f14840-8320-42e6-b7f4-5a933ea52242 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-2075814689" status: 202 len: 0 microversion: 2.1 time: 0.036903 Oct 04 18:07:44.280566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2623/3418] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 18:07:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2075814689 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:44.308012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.309035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.324127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.324507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.327226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.327976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.328454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.328896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.720319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.730663 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51dad04e-86c9-4007-8575-1901d7210539 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1506 microversion: 2.1 time: 0.448426 Oct 04 18:07:44.732916 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2624/3419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.740147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.740768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.750724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.751321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.751788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.752628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.753064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.753505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.028796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.037660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7fc09e0b-817a-4313-929a-2c9bd35ecdf9 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1315 microversion: 2.1 time: 0.303525 Oct 04 18:07:45.052142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2625/3420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:45.060502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.061130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.067785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.068836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.069448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.070341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.070813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.071259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.378323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.390654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.392679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.394142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c5200cd-9894-49bd-a5d3-f099ac5f481a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.340344 Oct 04 18:07:45.394919 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2626/3421] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:45.400123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8fa404-2e8b-4bc1-9a7e-755d5992adf0", "tag": "dfcf0a9b-e581-47f4-96bb-3b43632e90ca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:45.412855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.413722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.414376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.445644 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] Creating event network-changed:dfcf0a9b-e581-47f4-96bb-3b43632e90ca for instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 on n-h1-831193-17 Oct 04 18:07:45.453671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8b152df0-705a-4e72-97d3-30d5a29ac17f req-2450200b-dafd-4b24-9f1b-0e81a770204d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056222 Oct 04 18:07:45.455203 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2627/3422] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:45.462365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.463097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.469761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.470473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.470924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.471687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.472713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.473154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.592271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.607426 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b598f245-fdfe-425f-a330-4a247c14e3d0 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1267 microversion: 2.1 time: 0.150341 Oct 04 18:07:45.609368 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2628/3423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:45.617046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1106273984", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:45.758544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:47.351231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:47.352923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:47.353656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:47.354367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:47.355569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:47.369597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.370376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.370991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.371944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.372570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.373428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.399599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:47.410841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:47.435758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:47.439942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:47.519809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e726b78f-ee8a-4dfb-a548-035053bf76bf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908786 Oct 04 18:07:47.520983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2629/3424] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:47.536355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.538547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.569917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.572546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.573716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.575439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.576690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.577256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.644949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.647008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.647919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.648619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lazy-loading 'fault' on Instance uuid e6bbe368-5485-4b89-94df-aa3a724db489 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:47.801831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.824623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0aaf1ef-f75b-4da5-9f16-5d10ccfda34e tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 200 len: 1303 microversion: 2.1 time: 0.300523 Oct 04 18:07:47.828461 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2630/3425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 1303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:47.847642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.850487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.867240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.868999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.871669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.872635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.873877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.875444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.471800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.484277 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6868dd57-c8c4-4043-9110-1cd6aa6d8035 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1315 microversion: 2.1 time: 0.649382 Oct 04 18:07:48.489673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2631/3426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.501789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.502511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.515062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.515852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.516233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.516975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.517501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.517957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.067387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.091316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.094371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.096374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5b16cd0e-f774-48f7-a4ff-1e409cba1360 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.605027 Oct 04 18:07:49.111271 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2632/3427] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:49.115145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.117941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.136670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.156341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.158529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.162012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.163100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.163796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.426899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.454581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15656ee4-83a9-43f7-bfef-1ed60f7dc2ca tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.346154 Oct 04 18:07:49.458217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2633/3428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.467646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bbe368-5485-4b89-94df-aa3a724db489", "name": "network-vif-deleted", "tag": "b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:49.488601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.490401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.491094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.502767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:49.505567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] Creating event network-vif-deleted:b6168a9a-f7f9-4d4d-9c02-cb2ad8baaf06 for instance e6bbe368-5485-4b89-94df-aa3a724db489 on n-h2-831193-17 Oct 04 18:07:49.511524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-46a4b012-cced-4f4e-8b58-576469debc22 req-5e2d6cea-08d5-4f3f-b903-fd5cbfbeeb66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051619 Oct 04 18:07:49.513210 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2634/3429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:49.520902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.521938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.530809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.531688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.532371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.533544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.534244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.535404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.654000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.663850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5310bb11-e41b-4fbf-8ef1-aa19490daa3e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1269 microversion: 2.1 time: 0.148964 Oct 04 18:07:49.668125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2635/3430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.680254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.682905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: e6bbe368-5485-4b89-94df-aa3a724db489] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.707888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.711070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.711631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.711631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.717459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.718505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.733584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] HTTP exception thrown: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Request method failure captured: Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 HTTP/1.1 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHXwf8ZNpIP8BqyKlqWtkoCgQBiuHgeoxem3DRa-CD8HVs9nBasxssJLdkL__Mais0mpBrfuAKa4OHwaxzaMUpnDJqVEw7i9KhZ6ZXJ2RqXmxW6w92TFPIiDSWo6iUI5rU1i1pDBRpXHF7GdhU7hmk2u7Ke4F4X4snrGnYM3Xlq1-MI Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91c2761fdd7343368c59940180353f7a Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91c2761fdd7343368c59940180353f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91c2761fdd7343368c59940180353f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91c2761fdd7343368c59940180353f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91c2761fdd7343368c59940180353f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91c2761fdd7343368c59940180353f7a Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueTestJSON-135048376-project Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 357dac18752041d2a242b03ebf31287f Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueTestJSON-135048376-project Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e6bbe368-5485-4b89-94df-aa3a724db489'} Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.735576 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Returning 404 to user: Instance e6bbe368-5485-4b89-94df-aa3a724db489 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:49.741513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9359cb0-79c1-4680-8cb4-3a7cb48bd96a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489" status: 404 len: 111 microversion: 2.1 time: 0.067450 Oct 04 18:07:49.743414 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2636/3431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/e6bbe368-5485-4b89-94df-aa3a724db489 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:49.746419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8fa404-2e8b-4bc1-9a7e-755d5992adf0", "name": "network-vif-plugged", "status": "completed", "tag": "dfcf0a9b-e581-47f4-96bb-3b43632e90ca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:49.756663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.757157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.757593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.771603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] Creating event network-vif-plugged:dfcf0a9b-e581-47f4-96bb-3b43632e90ca for instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 on n-h1-831193-17 Oct 04 18:07:49.776504 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bdeaedf5-f409-41cf-a3bc-fa79025c1e45 req-f931fa60-00aa-439d-99ca-54f99d699d1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Oct 04 18:07:49.778400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2637/3432] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:49.785804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.787350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.794630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.795472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.796058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.797559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.798418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.799131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.323559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.336814 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0acb86ed-5bbf-4fdb-aa04-37364f0d5136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1315 microversion: 2.1 time: 0.556403 Oct 04 18:07:50.337867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2638/3433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:50.372689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.373683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.385481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.386102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.386637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.388058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.389074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.389977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.430548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:50.534879 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9eac693-4c27-4604-b436-06671796906a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 204 len: 0 microversion: 2.1 time: 0.179690 Oct 04 18:07:50.538384 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2639/3434] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:50 2022] DELETE /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:50.547583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.548552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.556901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.557891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.558586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.559557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.560200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.560896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.240371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.260087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.261893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.263744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf9ee0d3-7796-4dce-99e9-e2195b5489e5 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.722958 Oct 04 18:07:51.264499 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2640/3435] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:51.274464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.276568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.288971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.289758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.290200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.290992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.291484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.292122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.586494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.607211 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-815e3a86-557a-49a3-9daa-e336be76b720 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.340986 Oct 04 18:07:51.632007 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2641/3436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:51.643966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.645097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.657534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.658391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.661827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.662914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.664056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.679932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.113979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.122825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ba6c605-3a99-44ce-a7f7-e25c888ab13a tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1492 microversion: 2.1 time: 0.487303 Oct 04 18:07:52.132007 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2642/3437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1492 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.143560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.144194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.152044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.153239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.153986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.154841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.155495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.156106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.403610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.413392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f171c8a0-56f9-4514-b545-9f3ebd843bbf tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1309 microversion: 2.1 time: 0.274430 Oct 04 18:07:52.414007 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2643/3438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.421443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.422141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.432560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.433350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.434308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.435805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.436846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.437631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.952215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.961660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b53f0685-a12c-4ef5-8028-1fcefd3e5219 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1502 microversion: 2.1 time: 0.546417 Oct 04 18:07:52.962252 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2644/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1502 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.972432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a6ad37-b660-42ab-b925-85bb6a819ed3", "tag": "d14436ef-6f67-4cb7-940e-5612dc42ae07"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:52.984363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.985156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.985670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.999402 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] Creating event network-changed:d14436ef-6f67-4cb7-940e-5612dc42ae07 for instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 on n-h2-831193-17 Oct 04 18:07:53.006599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-099b4b8e-19d2-41cf-b1df-b9ad980f893a req-88deae4f-9715-4742-a36d-10f93486716e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042377 Oct 04 18:07:53.007776 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2645/3440] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:53.343308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1135043939", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:53.436654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:53.437416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:53.438527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:53.439302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:53.439868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:53.454366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.455228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.455876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.457566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.458201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.459109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.485119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Getting quotas for project b8fe748234334012b45a6447135b9880. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:53.492414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Getting quotas for user 51cc393d442a40e8a27ebb181640d7ee and project b8fe748234334012b45a6447135b9880. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:53.510322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:53.513779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:53.573891 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d294c8a8-7f8b-4729-9565-98df114da19e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.564819 Oct 04 18:07:53.574807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2646/3441] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:07:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:07:53.579657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:53.580452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:53.591528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.592697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.593596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.594999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.596058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.597398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.024989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.042095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.043970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.046050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d823211-e8f2-4c89-9a54-2e2bf0862510 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.469697 Oct 04 18:07:54.047113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2647/3442] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:53 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:54.052083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.052761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.059226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.059719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.060181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.060876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.061610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.062196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.261741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.292770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42a8d6a6-979b-4b4c-ba0c-17f0279c2129 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.244151 Oct 04 18:07:54.297787 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2648/3443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:54.308017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:54.308874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.322166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.323063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.324796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.325843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.328072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.329128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.466376 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-487132e3-60df-48b7-91b0-d75f54df1cf7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0/action" status: 202 len: 0 microversion: 2.1 time: 0.166104 Oct 04 18:07:54.467420 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2649/3444] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:54 2022] POST /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:54.485267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.486099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.500436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.501227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.501863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.502833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.503386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.503797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.545246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.546425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.547346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.547851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lazy-loading 'fault' on Instance uuid 4be146c5-4cde-4cd8-9f31-65e1d056cb8c {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:54.649838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357dac18752041d2a242b03ebf31287f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c2761fdd7343368c59940180353f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.659665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29a963b7-641c-4922-b6d1-9fe6ae576cdf tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 200 len: 1304 microversion: 2.1 time: 0.189572 Oct 04 18:07:54.659853 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2650/3445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:54.675143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.675143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.682400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.722705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:55.384611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.393705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dcc36ca4-4999-4c9b-a003-9d21af9ac3fe tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1309 microversion: 2.1 time: 0.732823 Oct 04 18:07:55.409506 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2651/3446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1309 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:55.415272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.415901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.422179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.422898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.423558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.424615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.425233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.425730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.546806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.560421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.562803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.566615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b8cdd65-f03f-47b3-905d-cd8814f4e830 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 200 len: 1333 microversion: 2.47 time: 0.153422 Oct 04 18:07:55.567765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2652/3447] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 1333 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:55.572968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.574070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.581033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:55.582937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.583424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.584565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.585878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.585878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.586517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.846834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.862238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57b33b27-bbb3-40f3-b2b4-cdd7d311809f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1487 microversion: 2.1 time: 0.292779 Oct 04 18:07:55.863238 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2653/3448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1487 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:55.872279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.873315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.886152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.887193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.888210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.889427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.891188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.891306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.125223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.136289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.138011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.140808 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d84ffee1-e221-4d1d-9475-b70364672ad7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.274655 Oct 04 18:07:56.141418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2654/3449] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:56.146786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be146c5-4cde-4cd8-9f31-65e1d056cb8c", "name": "network-vif-deleted", "tag": "053986dc-0979-40fc-93f8-4e01cfa4f1c6"}, {"name": "network-changed", "server_uuid": "a9bb5e54-92fa-429b-9b85-a5a4b65f9d69", "tag": "558e5af7-f3a0-491b-a5a6-2a069afa0de8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:56.158440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.159111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.159705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.177981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Creating event network-vif-deleted:053986dc-0979-40fc-93f8-4e01cfa4f1c6 for instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c on n-h2-831193-17 Oct 04 18:07:56.178499 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] Creating event network-changed:558e5af7-f3a0-491b-a5a6-2a069afa0de8 for instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 on n-h2-831193-17 Oct 04 18:07:56.185267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8b39fe06-b635-4712-b82f-ef693aad7e89 req-7975eb44-6320-4bcc-af52-e4d66fbb1d3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042429 Oct 04 18:07:56.185887 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2655/3450] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:56.191535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.192291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.199535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.200043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.200507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.201223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.201681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.202110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.362386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.375145 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb3b1849-3182-4de4-93e0-cbb67cb4606a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.184286 Oct 04 18:07:56.375145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2656/3451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:56.376522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.377338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] [instance: 4be146c5-4cde-4cd8-9f31-65e1d056cb8c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.385337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.385969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.386425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.387733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.388271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.388772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.404667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] HTTP exception thrown: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Request method failure captured: Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c HTTP/1.1 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHXwf8ZNpIP8BqyKlqWtkoCgQBiuHgeoxem3DRa-CD8HVs9nBasxssJLdkL__Mais0mpBrfuAKa4OHwaxzaMUpnDJqVEw7i9KhZ6ZXJ2RqXmxW6w92TFPIiDSWo6iUI5rU1i1pDBRpXHF7GdhU7hmk2u7Ke4F4X4snrGnYM3Xlq1-MI Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91c2761fdd7343368c59940180353f7a Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91c2761fdd7343368c59940180353f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91c2761fdd7343368c59940180353f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91c2761fdd7343368c59940180353f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91c2761fdd7343368c59940180353f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91c2761fdd7343368c59940180353f7a Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueTestJSON-135048376 Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueTestJSON-135048376-project Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 357dac18752041d2a242b03ebf31287f Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueTestJSON-135048376-project Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4be146c5-4cde-4cd8-9f31-65e1d056cb8c'} Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:56.406376 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] Returning 404 to user: Instance 4be146c5-4cde-4cd8-9f31-65e1d056cb8c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cdc55d10-48de-4f4e-ac03-3f96d62f9513 tempest-ServerRescueTestJSON-135048376 tempest-ServerRescueTestJSON-135048376-project] 10.222.0.33 "GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c" status: 404 len: 111 microversion: 2.1 time: 0.035290 Oct 04 18:07:56.411018 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2657/3452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/4be146c5-4cde-4cd8-9f31-65e1d056cb8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:56.415024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:56.415844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.422235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.422965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.423584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.424297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.424753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.425188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.456306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lazy-loading 'flavor' on Instance uuid 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:56.775068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5d06b82-3054-48b4-9c55-0844be7b6914 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0/action" status: 202 len: 0 microversion: 2.1 time: 0.364170 Oct 04 18:07:56.779020 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2658/3453] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:56 2022] POST /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:56.786126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.787406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.794734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.795315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.795781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.796544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.797010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.797496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.155732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.166248 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e1138f01-056e-4509-b342-1090a96451ac tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1309 microversion: 2.1 time: 0.388548 Oct 04 18:07:57.167297 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2659/3454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.172200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.172200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.179286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.180008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.180597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.181472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.182123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.182547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.294026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.303577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.305123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.306470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-211b37ac-313d-46b5-b8af-5c48ba0ffbd6 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 200 len: 1339 microversion: 2.47 time: 0.138175 Oct 04 18:07:57.307431 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2660/3455] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 1339 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:57.312466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.313311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.319921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.320555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.320994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.321693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.322143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.322566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.578710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.588568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5cecc33a-8ff2-4df7-b853-0284bcf883db tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1493 microversion: 2.1 time: 0.279770 Oct 04 18:07:57.589705 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2661/3456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1493 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.594910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.595640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.602709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.603498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.603955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.604785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.605315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.605814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.046864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.062250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.063763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.065002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-897c5dfc-31b8-47c6-a063-7011b584bcb6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.474327 Oct 04 18:07:58.065583 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2662/3457] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:58.084614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.085252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.103567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.104045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.104500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.105232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.105703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.106182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.593328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.606413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa572b1c-6052-4e81-bc04-683d2391795d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.539211 Oct 04 18:07:58.607684 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2663/3458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.617144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6ad37-b660-42ab-b925-85bb6a819ed3", "name": "network-vif-plugged", "status": "completed", "tag": "d14436ef-6f67-4cb7-940e-5612dc42ae07"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:58.641370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.643024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.643711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.661635 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] Creating event network-vif-plugged:d14436ef-6f67-4cb7-940e-5612dc42ae07 for instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 on n-h2-831193-17 Oct 04 18:07:58.667079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-42fb509d-e66d-43a1-af89-b71ab5bb39da req-7b277a28-4a1e-4790-8d4c-c0cbff09851a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056286 Oct 04 18:07:58.667997 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2664/3459] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:58.673386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.674252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.681628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.682129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.682569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.683594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.684048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.685068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.006799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.018586 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ebe9bdd-2bb1-449a-85ad-efd8d2a383f9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1309 microversion: 2.1 time: 0.349338 Oct 04 18:07:59.020764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2665/3460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:59.026366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.027271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.038253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.039142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.039887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.041637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.043182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.044138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.549454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.563070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.564565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.565772 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-518905a2-f919-4128-82a3-8a66e57cab7e tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 200 len: 1339 microversion: 2.47 time: 0.543762 Oct 04 18:07:59.566354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2666/3461] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 1339 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:59.584309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.585228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.598064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.598942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.599205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.599787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.607666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.608160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.198190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.202086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:00.217308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f58f0d65-9fa8-439b-8506-6caf4671f6a6 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 0.637515 Oct 04 18:08:00.231202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2667/3462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:00.231202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.231202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.245561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.246093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.246518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.247296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.247765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.248202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.643746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.674866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.678324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.689167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9efec49-68e8-42b1-a409-b698300e313b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.470145 Oct 04 18:08:00.691282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2668/3463] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:00.699315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.701525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.727438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.729116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.730997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.732124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.734365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.735523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.076005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.084022 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db9d4ceb-6312-4ca0-b8a5-f0518c9c04f6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1315 microversion: 2.1 time: 0.391271 Oct 04 18:08:01.084868 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2669/3464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.117874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.120331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.129330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.130075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.130705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.133515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.134484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.135776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.588776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.599219 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90aa7cb2-1b76-4b40-bd0a-ba59314f1347 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1309 microversion: 2.1 time: 0.490946 Oct 04 18:08:01.604863 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2670/3465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.619059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.620150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.641332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.642247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.642894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.643865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.644977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.645614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.784296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.804396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.806385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51cc393d442a40e8a27ebb181640d7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fe748234334012b45a6447135b9880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.807898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-951f2883-6ccd-4070-a9da-4fe642d202d8 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 200 len: 1360 microversion: 2.47 time: 0.201697 Oct 04 18:08:01.808477 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2671/3466] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 1360 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:01.842453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bb5e54-92fa-429b-9b85-a5a4b65f9d69", "name": "network-vif-plugged", "status": "completed", "tag": "558e5af7-f3a0-491b-a5a6-2a069afa0de8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:01.861709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.862653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.863348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.878655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] Creating event network-vif-plugged:558e5af7-f3a0-491b-a5a6-2a069afa0de8 for instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 on n-h2-831193-17 Oct 04 18:08:01.886563 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9b13040e-9cde-4121-8639-c9262b14fb48 req-04cd7d19-2274-4117-95fb-9ba8081bbdb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075054 Oct 04 18:08:01.890779 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2672/3467] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:01.909101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.911777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.919468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.920270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.920871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.935702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.943547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.945687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.333795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.348295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10f54e3a-e969-43fb-af3e-4425005816cd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 0.455249 Oct 04 18:08:02.349713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2673/3468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:02.388413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.389331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.397613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.398478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.399146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.400229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.400921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.401541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.030809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.043914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.048964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.053431 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a3fb3ec-3745-4a05-8a84-9be44935ebdf tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.702111 Oct 04 18:08:03.079510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2674/3469] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:03.092003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1995404086"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:03.096145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.122059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.128154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.129294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.130967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.132752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.134275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.258289 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:08:03.259362 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:08:03.468881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:03.506428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=24 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:03.517565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5529031-fef6-4e3b-89e5-13d25477ad51 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "POST /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2/action" status: 202 len: 52 microversion: 2.47 time: 0.431994 Oct 04 18:08:03.528653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2675/3470] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:03 2022] POST /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2/action => generated 52 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:08:03.536172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.539122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.555850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.557373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.559673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.561408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.562338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.563228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.909952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.941308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6708a78a-c020-4519-ba95-d02cd4c11f0a tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1501 microversion: 2.1 time: 0.408302 Oct 04 18:08:03.942109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2676/3471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1501 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.956010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.958967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.989366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.996367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.997233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.999280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.000672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.001124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.302465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.315696 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1dde20f9-a794-4f5c-adec-45453427e886 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1490 microversion: 2.1 time: 0.370903 Oct 04 18:08:04.316995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2677/3472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1490 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:04.324142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.325339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.333708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.336211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.337017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.338769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.339816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.340818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.557343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.566728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b15470a3-d790-498a-bfd7-319b4105a450 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 0.247555 Oct 04 18:08:04.570812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2678/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:04.575994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.576696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.592197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.601610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.602225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.603001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.604269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.607283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.647503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:04.844120 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f42016f2-fd55-40b8-8528-c1b0ae94f111 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 204 len: 0 microversion: 2.47 time: 0.265766 Oct 04 18:08:04.863681 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2679/3474] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:08:04 2022] DELETE /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:08:04.873264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8fa404-2e8b-4bc1-9a7e-755d5992adf0", "name": "network-vif-plugged", "status": "completed", "tag": "dfcf0a9b-e581-47f4-96bb-3b43632e90ca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:04.886606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.887435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.888311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.908649 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] Creating event network-vif-plugged:dfcf0a9b-e581-47f4-96bb-3b43632e90ca for instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 on n-h1-831193-17 Oct 04 18:08:04.914816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-724ed2db-1abe-47d5-b2b2-e1477beb8c68 req-6fe65044-26ec-4b3b-b966-7b7887b81f7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047076 Oct 04 18:08:04.916033 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2680/3475] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:04.922795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.923805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.934216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.935330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.936157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.937134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.937821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.938454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.259080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.271473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29187c9a-e5d0-4ba9-bae5-99d34675c290 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1501 microversion: 2.1 time: 0.352321 Oct 04 18:08:05.274491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2681/3476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:05.293133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.295885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.313495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.314189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.314769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.316163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.316859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.317518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.678584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.690320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:05.707129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.711162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.713319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ffd927f8-cd57-4beb-8b22-07fbfb254f75 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.437049 Oct 04 18:08:05.714752 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2682/3477] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:05.721792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1106273984", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:05.884109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:07.067278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:07.068707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:07.069345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:07.070147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:07.070846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:07.085875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.086848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.087479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.088583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.089209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.089810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.125371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:07.137426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:07.170319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:07.179337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:07.272037 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c64cd12-f484-4e1b-bd00-2bde172fb1b9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555980 Oct 04 18:08:07.280344 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2683/3478] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:07.872316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.875526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.889908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.890574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.892619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.904323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.906404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.908218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.972379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:08.857413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbd5083c-4327-4a66-9164-deceac3b858b tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "DELETE /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 204 len: 0 microversion: 2.42 time: 1.569307 Oct 04 18:08:08.862106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2684/3479] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:08:07 2022] DELETE /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 0 bytes in 1581 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:08:08.893454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:08.895214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] [instance: c4f33add-d730-4535-8b6d-2f939ec90eb2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:08.920179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.922202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.923388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.928987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.929646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.931518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.969925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] HTTP exception thrown: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Request method failure captured: Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 HTTP/1.1 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHZ3219iD3-5ZFiNgGaVhCFyy4KrH7gwlQBa8ABkAzDpO-tEqZCht-t-JydoOsqKVVToS860Fr6sHKn6jOvnz5VzO_OZ_Xt_-odTJrfGLMgoMStdzuF7TbwAxNiTLrw1gkYmj33_YTvWwEqkOURU0yniIqPyjIru8w6CWQNeb8_Fx9M Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b8fe748234334012b45a6447135b9880 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAaction247Test-1283534977 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8fe748234334012b45a6447135b9880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8fe748234334012b45a6447135b9880"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8fe748234334012b45a6447135b9880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8fe748234334012b45a6447135b9880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAaction247Test-1283534977 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b8fe748234334012b45a6447135b9880 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAaction247Test-1283534977 Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAaction247Test-1283534977-project Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 51cc393d442a40e8a27ebb181640d7ee Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAaction247Test-1283534977-project Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c4f33add-d730-4535-8b6d-2f939ec90eb2'} Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:08.976636 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] Returning 404 to user: Instance c4f33add-d730-4535-8b6d-2f939ec90eb2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9502c2d-c803-492d-ad13-1f862c3e4e77 tempest-ServersAaction247Test-1283534977 tempest-ServersAaction247Test-1283534977-project] 10.222.0.33 "GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2" status: 404 len: 111 microversion: 2.47 time: 0.109524 Oct 04 18:08:08.984347 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2685/3480] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:08 2022] GET /compute/v2.1/servers/c4f33add-d730-4535-8b6d-2f939ec90eb2 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:08.999674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:09.004016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.018604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.021391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.023710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.024982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.026417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.030914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.062958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lazy-loading 'flavor' on Instance uuid c9a6ad37-b660-42ab-b925-85bb6a819ed3 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:09.241856 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77ce2660-6637-4913-9cad-c596272fd8a4 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.260578 Oct 04 18:08:09.247749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2686/3481] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:08 2022] POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:09.256547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.257469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.271965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.273638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.274966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.276388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.277055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.277825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.106104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.126632 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b0f5ffc9-6e90-409e-8121-0b29bad055f5 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 0.877060 Oct 04 18:08:10.127798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2687/3482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:10.704246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b22461c7-3d48-40ec-a19f-ac051c4e5a18 tempest-ComputeTenantNetworksTest-2099612538 tempest-ComputeTenantNetworksTest-2099612538-project] Calling method '.version_select at 0x7f6340222940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.037267 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b22461c7-3d48-40ec-a19f-ac051c4e5a18 tempest-ComputeTenantNetworksTest-2099612538 tempest-ComputeTenantNetworksTest-2099612538-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.906090 Oct 04 18:08:11.037842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2688/3483] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 18:08:10 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:11.042823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.043483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:11.060163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.060710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.061164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.061912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.063312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.063713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.639124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.680625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.696188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.703500 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9acc288c-6f0a-442a-906f-1a8ff9dded59 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.660505 Oct 04 18:08:11.704513 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2689/3484] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:11.709910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.716974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:11.733620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.734406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.736533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.737559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.740391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.741059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.429910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.439369 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35e916ae-b6e7-44df-b3bf-24a140594a30 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1309 microversion: 2.1 time: 0.733528 Oct 04 18:08:12.451532 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2690/3485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1309 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:12.462486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:12.463945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:12.467791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:12.479468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.482582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.484176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.486053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.489846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.490305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.347401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.370806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.372367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.373714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1acf7edf-75fa-473c-a999-89952a6dc3d1 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2958 microversion: 2.42 time: 0.920869 Oct 04 18:08:13.385542 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2691/3486] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:12 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2958 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:13.401592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:13.402237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:13.422808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.423377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.423825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.424554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.425011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.430672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.954911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.965079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a5adf62-2c1d-4df5-88a2-122aeda8ae5d tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1492 microversion: 2.1 time: 0.578413 Oct 04 18:08:13.970328 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2692/3487] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:13 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1492 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:13.975734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-781169b3-3add-4416-83eb-49896a3cdbd9 tempest-ComputeTenantNetworksTest-2099612538 tempest-ComputeTenantNetworksTest-2099612538-project] Calling method '.version_select at 0x7f6340222b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.589112 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-781169b3-3add-4416-83eb-49896a3cdbd9 tempest-ComputeTenantNetworksTest-2099612538 tempest-ComputeTenantNetworksTest-2099612538-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/7a5194ab-bf18-4b96-8e8d-0ccd78364d9a" status: 200 len: 139 microversion: 2.1 time: 0.616488 Oct 04 18:08:14.590191 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2693/3488] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:08:13 2022] GET /compute/v2.1/os-tenant-networks/7a5194ab-bf18-4b96-8e8d-0ccd78364d9a => generated 139 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:14.603175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.603808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:14.622588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.623134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.623582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.624313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.624778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.630863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.050206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.069020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5fd82b33-7ee0-4f46-b738-cca5f99dd599 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 1.470760 Oct 04 18:08:16.083223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2694/3489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:14 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:16.090373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.095636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.112818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.113334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.113778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.117965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.124963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.125719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.105792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:17.150730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:17.789956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.799981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.814982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.816275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83de56c2-06e9-44a0-87e8-104fcb9dd6a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 1.745332 Oct 04 18:08:17.845974 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2695/3490] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:16 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:17.858192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.858852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.874998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.879604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.880286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.881192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.881623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.882068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.706943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.720630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c12197ce-81cf-4fe7-a957-8ef82eeb9ffa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1309 microversion: 2.1 time: 0.876798 Oct 04 18:08:18.721570 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2696/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1309 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.726773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:18.737176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:18.744602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.747744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.748467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.749423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.759826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.760614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.945537 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-edbc8373-c41a-454a-bc6b-9544eda64923 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.222194 Oct 04 18:08:18.953474 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2697/3492] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:18 2022] POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:18.963612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-unplugged", "status": "completed", "tag": "2baf4bf3-9054-4a77-a75e-67ca9f036b08"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:18.977230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.978111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.978733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.997071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] Creating event network-vif-unplugged:2baf4bf3-9054-4a77-a75e-67ca9f036b08 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:19.004205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-830a56ee-3710-4cf8-8517-a0b86957dda7 req-1792bec3-19c2-493e-893f-56e4da55d3df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048034 Oct 04 18:08:19.006747 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2698/3493] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:19.030825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:19.032904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.053004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.053845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.054590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.055592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.056262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.056896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.102112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:19.952857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:19.969338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:19.978970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:19.982081 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b570c908-1281-470a-9785-7024e01c0483 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2916 microversion: 2.42 time: 0.973374 Oct 04 18:08:19.983246 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2699/3494] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2916 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:20.003522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.004641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.012469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.020325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.021530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.022416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.023010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.023626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.872367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.881901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00741c81-0f0e-4b2d-8f76-fbc337080107 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1509 microversion: 2.1 time: 0.891494 Oct 04 18:08:20.892417 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2700/3495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1509 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.907652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032a2e4e-99ee-46e1-8019-789c25382152", "tag": "4a779ebf-26ca-4d9e-952b-f31dc946475c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:20.946253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.947583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.949882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.982997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] Creating event network-changed:4a779ebf-26ca-4d9e-952b-f31dc946475c for instance 032a2e4e-99ee-46e1-8019-789c25382152 on n-h1-831193-17 Oct 04 18:08:20.998502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3a505d2d-6219-4240-8a6d-a3a85e6baf76 req-00472dbb-c52d-4272-ad9f-6c912549b322 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099247 Oct 04 18:08:21.000410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2701/3496] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:21.006442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.012599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.023944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.024835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.025499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.026486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.027244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.027946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.335537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.372427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.374808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.376463 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5df6eee-c4ce-4793-989f-b2e51b89e9e8 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 2.374343 Oct 04 18:08:23.378002 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2702/3497] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.408744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.409864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.419181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.419997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.420629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.421724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.422338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.422942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.215084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.229637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7275ab05-79c0-48d1-84c5-74d2657d47db tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1498 microversion: 2.1 time: 0.850323 Oct 04 18:08:24.231673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2703/3498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1498 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.248021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.249486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.270479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.271383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.272071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.273012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.273701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.274341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.987215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.001921 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04d54f89-bea7-40ec-b7e3-d89ee294ca04 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1309 microversion: 2.1 time: 0.765645 Oct 04 18:08:25.003729 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2704/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1309 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.010711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.011819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.021511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.022420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.023124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.024227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.025128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.025798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.538812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.549301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.551422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.553258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c943f30a-42e6-4fea-9586-85593f8d5b25 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2869 microversion: 2.42 time: 0.548099 Oct 04 18:08:25.568163 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2705/3500] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2869 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:25.583854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-unplugged", "status": "completed", "tag": "0624cb6e-d0b6-46b1-8938-44b05d9f569a"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-unplugged", "status": "completed", "tag": "20938216-0411-47c1-b277-44f94db5f660"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-unplugged", "status": "completed", "tag": "7fb21bea-b1f2-4e11-88c6-51799235d44a"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-unplugged", "status": "completed", "tag": "a449186f-440d-420b-93bc-a22bf6415010"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "0f7f691a-70c9-4c81-9bdf-3ee37b61118f"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "faa992a7-5058-4ea9-a4f0-2b9848cbf70a"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "acd4770c-3b15-4922-a6b2-3bd6ed249eca"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "221dcea7-bb25-4ec6-9a42-c8b92651d758"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:25.602058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.602783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.603438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.619366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-unplugged:0624cb6e-d0b6-46b1-8938-44b05d9f569a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:25.620080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-unplugged:20938216-0411-47c1-b277-44f94db5f660 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:25.620599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-unplugged:7fb21bea-b1f2-4e11-88c6-51799235d44a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:25.621247 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-unplugged:a449186f-440d-420b-93bc-a22bf6415010 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:25.621780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-plugged:0f7f691a-70c9-4c81-9bdf-3ee37b61118f for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:25.622338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-plugged:faa992a7-5058-4ea9-a4f0-2b9848cbf70a for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:25.622922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-plugged:acd4770c-3b15-4922-a6b2-3bd6ed249eca for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:25.623445 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] Creating event network-vif-plugged:221dcea7-bb25-4ec6-9a42-c8b92651d758 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:25.635705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c0a55d99-9e73-4e1f-b26b-f23a3737385c req-1f3a7ee6-5eea-4aa2-842a-552f91242644 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.057789 Oct 04 18:08:25.636567 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2706/3501] 10.222.0.33 () {64 vars in 1318 bytes} [Tue Oct 4 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.643872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.644591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.653399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.654205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.654652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.655416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.655884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.656325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.430250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.441051 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1298982b-174a-457e-9b97-f520e95d5908 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1506 microversion: 2.1 time: 0.802372 Oct 04 18:08:26.442019 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2707/3502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1506 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.448006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-deleted", "tag": "0624cb6e-d0b6-46b1-8938-44b05d9f569a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:26.458345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.463882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.464824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.483008 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] Creating event network-vif-deleted:0624cb6e-d0b6-46b1-8938-44b05d9f569a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:26.488979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5e9c9bf3-2be5-4cbd-96f1-4e836d6becd8 req-0321ce56-29ff-47a2-a920-e15ffb221bcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044853 Oct 04 18:08:26.490675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2708/3503] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:26.496505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.497426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.508847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.510343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.510980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.513068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.513781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.514496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.014663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.025408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.026871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.028350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c8f28e7-6fc2-4568-9957-b57dfc7d9cfa tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.536397 Oct 04 18:08:27.029255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2709/3504] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:27.034425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.035066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.041843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.042341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.042785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.043519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.044008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.044435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.403662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.413581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ebab043-f93f-439d-9e65-9e5250095908 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1501 microversion: 2.1 time: 0.382978 Oct 04 18:08:27.428981 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2710/3505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1501 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.440276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.441742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.451482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.452427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.453102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.454051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.454736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.455415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.790351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.801098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab0a04ce-c086-4041-9983-1da708a80974 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1309 microversion: 2.1 time: 0.370548 Oct 04 18:08:27.805048 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2711/3506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.811448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.812069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.836636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.838642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.841686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.843442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.845734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.847793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.254644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.266435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.277161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.278751 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f32586a9-c7ae-449a-b464-0ff74c4fba0f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2708 microversion: 2.42 time: 0.471112 Oct 04 18:08:28.279916 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2712/3507] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2708 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:28.290345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:28.296182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.312125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.312627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.313091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.313795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.314253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.314683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.377259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lazy-loading 'flavor' on Instance uuid c9a6ad37-b660-42ab-b925-85bb6a819ed3 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:28.522310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87530a32-3b35-494e-8c29-72b14dacf3a6 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.240552 Oct 04 18:08:28.524774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2713/3508] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:28 2022] POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:28.539580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.540365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.547377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.547895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.548507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.549375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.549982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.550555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.440603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.499657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa1f0e8f-4792-481f-afaf-4d89c3a4a265 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1506 microversion: 2.1 time: 0.969702 Oct 04 18:08:29.500758 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2714/3509] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1506 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.525357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "dbaf9de8-4490-44cd-8050-c66a830aa234"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "ad62896c-72ad-460e-977d-df032390cb99"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-plugged", "status": "completed", "tag": "a9d193dc-3032-412e-b7ce-9b340178f836"}, {"server_uuid": "032a2e4e-99ee-46e1-8019-789c25382152", "name": "network-vif-plugged", "status": "completed", "tag": "4a779ebf-26ca-4d9e-952b-f31dc946475c"}, {"server_uuid": "7f8fa404-2e8b-4bc1-9a7e-755d5992adf0", "name": "network-vif-unplugged", "status": "completed", "tag": "dfcf0a9b-e581-47f4-96bb-3b43632e90ca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:29.580354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.581552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.583228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.624062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Creating event network-vif-plugged:dbaf9de8-4490-44cd-8050-c66a830aa234 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:29.625399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Creating event network-vif-plugged:ad62896c-72ad-460e-977d-df032390cb99 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:29.626526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Creating event network-vif-plugged:a9d193dc-3032-412e-b7ce-9b340178f836 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:29.636057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Creating event network-vif-plugged:4a779ebf-26ca-4d9e-952b-f31dc946475c for instance 032a2e4e-99ee-46e1-8019-789c25382152 on n-h1-831193-17 Oct 04 18:08:29.636880 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] Creating event network-vif-unplugged:dfcf0a9b-e581-47f4-96bb-3b43632e90ca for instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 on n-h1-831193-17 Oct 04 18:08:29.654747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8104a5fe-35b5-4e55-81e7-64362f5c86eb req-b189d9b5-1296-4d0d-ac6b-d0b864912fad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.151097 Oct 04 18:08:29.656285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2715/3510] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:29.665917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.667140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.679713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.680950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.683280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.687832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.689589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.690253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.204706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.211803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:30.215228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.228610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.229824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-436e465a-d27a-4d82-969d-211c20cce3dc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1880 microversion: 2.32 time: 0.572182 Oct 04 18:08:30.230399 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2716/3511] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1880 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.235430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.236040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.251284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.252007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.252689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.253663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.254320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.255021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.095427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.111778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aba0ce42-91bb-425a-8265-699eea765ddb tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1492 microversion: 2.1 time: 0.880234 Oct 04 18:08:31.113402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2717/3512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1492 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:31.121094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-deleted", "tag": "7fb21bea-b1f2-4e11-88c6-51799235d44a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:31.140341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.140890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.141455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.167862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] Creating event network-vif-deleted:7fb21bea-b1f2-4e11-88c6-51799235d44a for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:31.173356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a601efa1-ca20-4cd5-9bbc-c66af8f560c1 req-ea44897d-2bef-446f-9ad0-6bd602f5198f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057849 Oct 04 18:08:31.174449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2718/3513] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:31.181790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.183437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.205982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.206868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.207540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.208524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.209176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.209793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.638280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.651680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6be38d5-52ed-4a85-b67e-880e7170bc8f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1309 microversion: 2.1 time: 0.475684 Oct 04 18:08:31.652266 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2719/3514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:31.687468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.690042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.698761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.699526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.700135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.710381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.710877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.711539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.212001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.225495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.227059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.228257 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b959ca52-9fff-48dd-8948-e7c9af1080ce tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 2322 microversion: 2.42 time: 0.574853 Oct 04 18:08:32.230873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2720/3515] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 2322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:32.250420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.251076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.265429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.266800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.267434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.269978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.276498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.278347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.834480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.842982 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68269c9f-14cc-45eb-ade2-6be085b63b56 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 200 len: 1449 microversion: 2.1 time: 0.610701 Oct 04 18:08:32.843837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2721/3516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 1449 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.863741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:32.865028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.877561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.878711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.879497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.881801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.882883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.883882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.076809 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad80b1e9-6d4e-4909-a7cf-f079a57b66c7 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.231237 Oct 04 18:08:33.077821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2722/3517] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:32 2022] POST /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:33.108443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.123228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.140060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.141007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.142060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.142952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.143719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.144316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.535604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.547356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.548819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.550130 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e127d40-f376-41dc-a2ad-3354b83bc7bb tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2833 microversion: 2.32 time: 0.470826 Oct 04 18:08:33.571743 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2723/3518] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2833 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:33.572066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.587891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.601247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.603670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.604129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.607470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.607967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.608414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.074163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.082657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70b203bb-c31a-48e0-9fd2-db33654a28a6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1489 microversion: 2.1 time: 0.517913 Oct 04 18:08:34.086436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2724/3519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1489 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.103887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.104581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.112548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.117896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.118605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.119568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.120265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.120902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.498457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.513477 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d9c1844-233e-4695-aae0-9b6982beb089 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.425531 Oct 04 18:08:34.514098 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2725/3520] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.542863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.543556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.563247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.563765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.564228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.565258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.565491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.580644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.042587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.054695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef430b4a-3d4c-478e-8fcf-e097cc3b3ea8 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1498 microversion: 2.1 time: 0.536571 Oct 04 18:08:35.055622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2726/3521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:35.308942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-deleted", "tag": "2baf4bf3-9054-4a77-a75e-67ca9f036b08"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-deleted", "tag": "20938216-0411-47c1-b277-44f94db5f660"}, {"server_uuid": "87221687-48ef-4445-8ddc-5c38d85c7246", "name": "network-vif-deleted", "tag": "a449186f-440d-420b-93bc-a22bf6415010"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:35.329588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.330843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.332621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.363640 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Creating event network-vif-deleted:2baf4bf3-9054-4a77-a75e-67ca9f036b08 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:35.364787 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Creating event network-vif-deleted:20938216-0411-47c1-b277-44f94db5f660 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:35.369586 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] Creating event network-vif-deleted:a449186f-440d-420b-93bc-a22bf6415010 for instance 87221687-48ef-4445-8ddc-5c38d85c7246 on n-h2-831193-17 Oct 04 18:08:35.381454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f6e07af8-0287-46b0-bf7c-cc58a33acbc9 req-1ef3ba27-b5af-4093-836b-1eef07693f74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.321142 Oct 04 18:08:35.384842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2727/3522] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:35.399532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.400878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.414365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.415568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.416486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.417636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.418306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.418934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.509602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.521902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.523726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.525439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2a5fe76-23c9-479d-b965-ef0159a08053 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.138606 Oct 04 18:08:35.551392 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2728/3523] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:35.557593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.558445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.565245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.566048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.566709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.568230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.569098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.569768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.808679 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-509226c3-a990-4e53-949f-ee5dfd959aad tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.255056 Oct 04 18:08:35.810041 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2729/3524] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963/os-interface => generated 1832 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:35.824766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.826203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.837176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.838632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.839696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.841284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.843764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.844943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.224771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.240940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04b10aa6-6ac7-4d93-b48a-9ba36b8f5883 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1490 microversion: 2.1 time: 0.429148 Oct 04 18:08:36.250115 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2730/3525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1490 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.278005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.280112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.306359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.307131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.308176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.311215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.312030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.312935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.522611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.531708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a4b4c01-a1a0-4cbf-947f-fcd7bd3b4ded tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.265234 Oct 04 18:08:36.533470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2731/3526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.964817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-495286926", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:37.083596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] validate_networks() for [('95b8ba85-9d95-443e-b965-d9baf72e946b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:37.907342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:37.908050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:37.908692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:37.909298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:37.910080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:37.923440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.924176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.924826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.925817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.927101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.927890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.951349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:37.961347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for user 1e4ef2f4be1046a2869572360d9aa168 and project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:37.980320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:37.996866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:38.105883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef3a640e-c043-4ef7-95ac-b2326f48b175 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.571040 Oct 04 18:08:38.117155 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2732/3527] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:38.132838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.133681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.159655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.160571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.165104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.166270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.167199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.167654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.454036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.475661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fed733b3-74ed-4ed0-af0f-0b0af184ef93 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1501 microversion: 2.1 time: 0.354819 Oct 04 18:08:38.477781 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2733/3528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.500969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.502039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.518674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.521324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.522510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.524097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.524594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.527292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.842960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.855930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:38.860517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-364ea2b6-4c83-4d60-a03a-231658860cad tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1489 microversion: 2.1 time: 0.376690 Oct 04 18:08:38.861554 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2734/3529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1489 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.869242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.870206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.875965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:38.877771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.878972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.880325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.881373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.882101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.882777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.983090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.007277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.012050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.014743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5b65a5ca-c577-47fb-8e0c-8d028875dcef tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.151470 Oct 04 18:08:39.016107 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2735/3530] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:39.038371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.040393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.067802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.068134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.068798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.070018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.070790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.071489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.441067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.459620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da12a373-c417-4f80-bfdc-c0b3977ae083 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.434349 Oct 04 18:08:39.460331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2736/3531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.839217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "tag": "0f7f691a-70c9-4c81-9bdf-3ee37b61118f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:39.852778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.853516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.854095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.901012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] Creating event network-changed:0f7f691a-70c9-4c81-9bdf-3ee37b61118f for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:08:39.915338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e9ad1e1b-5087-48d3-9a7c-581b84ccce4b req-18edf5be-fa58-497c-8cc7-5fb41d2c17ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436715 Oct 04 18:08:39.917860 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2737/3532] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:39.943749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.944474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.967460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.967969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.968593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.971826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.972487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.973064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.167638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.180320 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59a8d6b4-220d-4ca6-aa0d-05de72de212e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1217 microversion: 2.1 time: 0.259820 Oct 04 18:08:40.184222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2738/3533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.195875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.196386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.231569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.232100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.232559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.241045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.242204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.246827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.372436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:40.639132 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35e2ef9c-07be-43cb-a44f-e708003a45fd tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 204 len: 0 microversion: 2.1 time: 0.441710 Oct 04 18:08:40.639878 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2739/3534] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:40 2022] DELETE /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:40.669176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.671628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.701315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.701827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.717473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.718286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.718779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.719370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.852575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:41.060107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0528c2d0-d712-4360-a032-264007b4c188 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 204 len: 0 microversion: 2.1 time: 0.416881 Oct 04 18:08:41.067437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2740/3535] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:40 2022] DELETE /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:41.077635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.079161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.101591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.102636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.103831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.105512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.106415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.107135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.538574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.549232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d031449a-f0bf-4e9f-8f67-5c564f38590f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.480045 Oct 04 18:08:41.549825 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2741/3536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.584715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.585833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.593424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.598957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.599818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.600999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.601611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.602380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.705380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.752743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.758088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.759810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c9977891-7c9f-4d0d-89c7-7698adc9a36c tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.194445 Oct 04 18:08:41.763893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2742/3537] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:41.774021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1356871928", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:41.871387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] validate_networks() for [('95b8ba85-9d95-443e-b965-d9baf72e946b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:42.686767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:42.687442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:42.687701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:42.688136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:42.688543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:42.709483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.709991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.710950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.711242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.711920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.712517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.752892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:42.760333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for user 1e4ef2f4be1046a2869572360d9aa168 and project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:42.779324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:42.781886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:42.865433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f924c706-4241-4217-b569-5fd07ba39f9c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.099597 Oct 04 18:08:42.866365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2743/3538] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:42.873446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.874100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.884240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.884921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.885531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.886547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.887301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.888371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.613220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.639342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca83d47b-59e5-496a-9cbf-e43e3226f491 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1507 microversion: 2.1 time: 0.767812 Oct 04 18:08:43.640005 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2744/3539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1507 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.663361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.665254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.693143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.694030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.694259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.695006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.695677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.696294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.198582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.208879 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76b64b35-e458-4538-bb17-f29a5a95f92b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 200 len: 1294 microversion: 2.1 time: 0.566556 Oct 04 18:08:44.229194 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2745/3540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 1294 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.236576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:44.245709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.246652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.247329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.281689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:08:44.352383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6125c19-89ce-4f87-8c12-d21e40384056 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.118083 Oct 04 18:08:44.353418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2746/3541] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:44 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:44.371791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.372793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.419292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.419292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.432281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.433126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.433602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.434047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.766581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.786479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.787708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.788979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11d831bd-e2d1-400e-a692-2162956faa32 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.426600 Oct 04 18:08:44.795720 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2747/3542] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:44.808554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.813698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.836966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.837488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.838026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.850236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.850907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.851393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.893245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:45.020942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.044032 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ede13a77-2a94-4b9a-91b4-7b81b3642a42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1274 microversion: 2.1 time: 0.242464 Oct 04 18:08:45.045957 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2748/3543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.062996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032a2e4e-99ee-46e1-8019-789c25382152", "name": "network-vif-deleted", "tag": "4a779ebf-26ca-4d9e-952b-f31dc946475c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:45.088940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.093764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.094832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.141532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] Creating event network-vif-deleted:4a779ebf-26ca-4d9e-952b-f31dc946475c for instance 032a2e4e-99ee-46e1-8019-789c25382152 on n-h1-831193-17 Oct 04 18:08:45.152712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9a8c43f5-c88c-4a63-9cd8-55f3f9361372 req-09cfe9ef-7f30-4850-b45b-72c6ea5a161a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104146 Oct 04 18:08:45.153983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2749/3544] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:45.166002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.170366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.178901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.179749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.180420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.181405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.187805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.188830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.292815 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:08:45.293617 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:08:45.842876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.857413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d252b32a-0324-4b7d-9bb9-211dfb37c272 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.696730 Oct 04 18:08:45.858622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2750/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.882689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.882890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.898661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.899533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.900152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.901044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.901800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.902383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.946866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.947630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.948086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.948556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lazy-loading 'fault' on Instance uuid c9a6ad37-b660-42ab-b925-85bb6a819ed3 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:46.058538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c54ba1766f446cca985dd529b3f5c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a52c4aa12b342eea9763b6e8b11ba06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.069700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d2c9ce2-7c8b-40f3-a63f-5237ba8ae75b tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 200 len: 1305 microversion: 2.1 time: 0.209736 Oct 04 18:08:46.075859 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2751/3546] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 1305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.088155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6ad37-b660-42ab-b925-85bb6a819ed3", "name": "network-vif-deleted", "tag": "d14436ef-6f67-4cb7-940e-5612dc42ae07"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:46.114881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.115719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.118738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.255575 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] Creating event network-vif-deleted:d14436ef-6f67-4cb7-940e-5612dc42ae07 for instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 on n-h2-831193-17 Oct 04 18:08:46.281607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-596100cd-df5d-4926-9964-5e28a60fca83 req-08904864-3a12-4711-8c6d-6455129d7b5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204388 Oct 04 18:08:46.282444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2752/3547] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:46.302893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.305561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.314283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.315143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.315835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.317181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.317974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.318553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.350913 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 HTTP/1.1 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '032a2e4e-99ee-46e1-8019-789c25382152'} Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.354001 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:08:46.358627 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.361782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.362957 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b93fef7e-27b3-40db-9305-29e88bdc5f99 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 404 len: 111 microversion: 2.1 time: 0.078684 Oct 04 18:08:46.363829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2753/3548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:46.372107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.373228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.384407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.385131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.385711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.386795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.387421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.388264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.560207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.572967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.574705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.576134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35b2d401-cb7b-4a7e-a86d-32f33fa91544 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.210640 Oct 04 18:08:46.588876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2754/3549] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:46.604840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.605599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.613954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.614656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.615370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.616279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.616852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.617423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.697798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.706098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91974549-d0a5-416b-8ca5-fdef32fe1852 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1280 microversion: 2.1 time: 0.115781 Oct 04 18:08:46.707119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2755/3550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1280 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.712198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.712699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.719474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.720006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.720445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.721158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.721618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.722152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.764026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:46.920788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4173004d-3bff-470f-80ea-e82dd9c6355b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 204 len: 0 microversion: 2.1 time: 0.211680 Oct 04 18:08:46.922578 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2756/3551] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:46 2022] DELETE /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:46.937640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.938939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.949419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.950632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.951461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.954995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.955949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.956735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.180868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.196368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8dc7b681-f528-4f94-abe6-bfc3c9587b3b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.271015 Oct 04 18:08:47.212298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2757/3552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.222019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.222964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.231622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.232117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.232555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.234495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.235103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.235553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.894641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.903626 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0dc28fb4-48f9-47a2-b27e-1b2b8bbb257c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1496 microversion: 2.1 time: 0.689051 Oct 04 18:08:47.941687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2758/3553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1496 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.949346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.949979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] [instance: c9a6ad37-b660-42ab-b925-85bb6a819ed3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.966600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.967433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.968057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.969125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.969754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.970345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.991994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] HTTP exception thrown: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Request method failure captured: Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 HTTP/1.1 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHZpnfKwPhpuKIzlRQjq6UxIutHh3JdBrTUt8o2c39Wl7YZx_63KpxERSMBtj2c5ifkRopgHxmji7MTLWfscZU-krN3YdHNbVTvby84FI8e10oCNTUt7TLzs6rV-ZZFoYi7e-viIOvqyrlqy_L00tl_uXchVMwXWDn7qcno03i1RGLI Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0a52c4aa12b342eea9763b6e8b11ba06 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestServerAdvancedOps-49405352 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a52c4aa12b342eea9763b6e8b11ba06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a52c4aa12b342eea9763b6e8b11ba06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a52c4aa12b342eea9763b6e8b11ba06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a52c4aa12b342eea9763b6e8b11ba06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestServerAdvancedOps-49405352 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0a52c4aa12b342eea9763b6e8b11ba06 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestServerAdvancedOps-49405352 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestServerAdvancedOps-49405352-project Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8c54ba1766f446cca985dd529b3f5c66 Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestServerAdvancedOps-49405352-project Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c9a6ad37-b660-42ab-b925-85bb6a819ed3'} Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:47.995104 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. Oct 04 18:08:47.999504 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.001542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] Returning 404 to user: Instance c9a6ad37-b660-42ab-b925-85bb6a819ed3 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:48.002676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a967d548-2ece-4459-abb9-b4275f56c6d1 tempest-TestServerAdvancedOps-49405352 tempest-TestServerAdvancedOps-49405352-project] 10.222.0.33 "GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3" status: 404 len: 111 microversion: 2.1 time: 0.059179 Oct 04 18:08:48.003881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2759/3554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/c9a6ad37-b660-42ab-b925-85bb6a819ed3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:48.017909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.019882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.042624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.043233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.051756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.052700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.053203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.053713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.279515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.294266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.296165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.298401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75e49364-e5a6-449c-acd5-eff068e8b6a0 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.293271 Oct 04 18:08:48.299637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2760/3555] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:48.305141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.306220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.313776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.314665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.315315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.316368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.318271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.319162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.023641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.043987 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44187756-38c5-43d2-a5e8-2552bcb6b846 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 0.742525 Oct 04 18:08:49.060144 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2761/3556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.083661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.084786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.099129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.100556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.101577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.103161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.104279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.105294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.069526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.095419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49d0b59d-e8d9-4511-ac89-a3e58b4d1298 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 1.035726 Oct 04 18:08:50.096434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2762/3557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:50.119997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec12e6b2-7e7d-47f3-99d2-06c84492a474", "tag": "ff49ff1b-fa97-4b57-961e-efc10a4879c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:50.151513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.154152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.155736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.187807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] Creating event network-changed:ff49ff1b-fa97-4b57-961e-efc10a4879c6 for instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 on n-h2-831193-17 Oct 04 18:08:50.200102 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-10ff796f-0a20-4a85-b0d1-454ff1542dac req-86264eef-0918-4f47-baf5-7a42da9aef1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098035 Oct 04 18:08:50.202039 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2763/3558] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:50.212190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.215337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.231193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.235574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.236685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.237964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.241186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.245481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.919987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.933391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08e5d3f2-4404-4a3d-b163-564ef00e9f5d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1496 microversion: 2.1 time: 0.728922 Oct 04 18:08:50.934246 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2764/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1496 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:50.957494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.958119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.970637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.971171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.976850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.977918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.981331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.983644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.186433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.211959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.213704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.214987 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75a39b91-ab8f-44c8-a487-fa9791c3652a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.278384 Oct 04 18:08:51.219768 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2765/3560] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:51.233308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6d772-4435-4ee5-995a-b0ba25de7df2", "tag": "e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:51.276804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.278776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.279313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.310196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] Creating event network-changed:e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71 for instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 on n-h1-831193-17 Oct 04 18:08:51.326312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-75598f43-9f86-40f4-ae16-910cc2d5da65 req-02e8a856-774e-4b68-b380-50d4bf0aca5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102584 Oct 04 18:08:51.329640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2766/3561] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:51.344963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.347576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.372257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.373114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.373764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.375024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.376177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.382122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.455606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:51.764317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.776010 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46916f7e-ae32-48b5-a715-92c719132bbb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 0.444570 Oct 04 18:08:51.777475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2767/3562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.792782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.794317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.803859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:51.806325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.807101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.808026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.808987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.809742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.810516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.499348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.509846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49ed0148-f77d-411d-acdf-77b5cd97487d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.730971 Oct 04 18:08:52.515726 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2768/3563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.539652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.540440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.561091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.565447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.567604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.569321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.571698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.573966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.654398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.654893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.658880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.659540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lazy-loading 'fault' on Instance uuid a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:52.726353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:52.769546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:52.815195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.826769 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1483ef22-1bbf-4844-b868-b90fefe26ab6 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 200 len: 1299 microversion: 2.1 time: 0.308749 Oct 04 18:08:52.828355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2769/3564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.839302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.841920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.856822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.857350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.857798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.860769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.864548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.865033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.958250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.968931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.970397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.971695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9c18420e-18af-453c-9188-10eae1776e03 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.142363 Oct 04 18:08:52.973748 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2770/3565] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:53.003409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bb5e54-92fa-429b-9b85-a5a4b65f9d69", "name": "network-vif-deleted", "tag": "558e5af7-f3a0-491b-a5a6-2a069afa0de8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:53.017261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.017756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.018189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.034038 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] Creating event network-vif-deleted:558e5af7-f3a0-491b-a5a6-2a069afa0de8 for instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 on n-h2-831193-17 Oct 04 18:08:53.040754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-38f9cdc4-1a70-4b8e-8cdf-6437c068d9da req-add85fff-3e5b-42a9-a5ea-06f5cd34b9e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049287 Oct 04 18:08:53.042228 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2771/3566] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:53.053952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.054671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.080607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.081112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.081556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.082290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.082780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.083245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.554206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.568086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b57980f-50aa-4688-be20-990d019e4a88 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 0.521417 Oct 04 18:08:53.580365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2772/3567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:53.591463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.592089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.599063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.599638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.600625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.601364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.601831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.602243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.985573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.010350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-98df61b0-4d88-449f-9c73-0758672889a7 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1677 microversion: 2.1 time: 0.418914 Oct 04 18:08:54.026044 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2773/3568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1677 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:54.042249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.043115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.061532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.062192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.062788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.067762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.068367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.068816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.108209 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 HTTP/1.1 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a9bb5e54-92fa-429b-9b85-a5a4b65f9d69'} Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:54.110226 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:08:54.114608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:54.145269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-93dce693-d662-4ce7-bedb-5c5b52b5b259 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 404 len: 111 microversion: 2.1 time: 0.115253 Oct 04 18:08:54.155486 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2774/3569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:54.165703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.166434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.188609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.189108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.189546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.190260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.199366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.201251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.460617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.492286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.496376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.500655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-395d53be-34e5-459b-89e7-8d68e9a6e61a tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.342653 Oct 04 18:08:54.518184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2775/3570] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:54.534089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-110242678", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:54.635244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:55.751628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:55.752215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:55.752530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:55.752949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:55.753464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:55.773181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.773934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.774388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.775842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.776521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.777206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.830941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:55.845089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:55.872727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:55.878612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:55.950102 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cb59163-1d54-4ab3-b105-87d0edbed407 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426109 Oct 04 18:08:55.951355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2776/3571] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:55.956278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.957443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.967138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.967752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.968290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.969476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.969980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.970516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.999637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.011086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad0c08d3-1f02-49ee-87f5-d96a7a1b14a4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 1.058433 Oct 04 18:08:57.015423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2777/3572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.024910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.027721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.044039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.048877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.049555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.050416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.050995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.055139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.305035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.318515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca0af863-a33a-49a8-9804-f0a51d9baccf tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1654 microversion: 2.1 time: 0.301711 Oct 04 18:08:57.331529 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2778/3573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1654 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.331529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.331529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.345915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.346437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.348883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.352373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.353578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.354878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.489672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.504615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.507351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.508816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5dcb26ba-97e0-4d7f-bfed-34a9c787bd7f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1603 microversion: 2.42 time: 0.188187 Oct 04 18:08:57.509893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2779/3574] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:57.517272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.521835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.533917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.537451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.538126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.539114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.539797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.540418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.643976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.653725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb362976-748d-4234-a730-ae590c7fb471 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1204 microversion: 2.1 time: 0.142127 Oct 04 18:08:57.664014 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2780/3575] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.664014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec12e6b2-7e7d-47f3-99d2-06c84492a474", "name": "network-vif-plugged", "status": "completed", "tag": "ff49ff1b-fa97-4b57-961e-efc10a4879c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.674431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.675257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.675889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.689497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] Creating event network-vif-plugged:ff49ff1b-fa97-4b57-961e-efc10a4879c6 for instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 on n-h2-831193-17 Oct 04 18:08:57.699611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-60e2c4b5-d45f-4e16-a9ff-6bba8b3d1e66 req-544f6327-9763-47b7-96b5-8d5b1545a5f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043437 Oct 04 18:08:57.705686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2781/3576] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:57.724828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.745885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.746487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.747092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.806054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Going to try to start instance {{(pid=128770) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:08:57.906421 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-550a5d3c-8a72-4781-b888-401d3b5bd911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.198216 Oct 04 18:08:57.907164 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2782/3577] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:57.924492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.925712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.944765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.945441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.945947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.946707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.950341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.950341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.326043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.335273 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2fd5d599-9fa1-462d-a0db-bda34e2e4d4f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1663 microversion: 2.1 time: 0.423337 Oct 04 18:08:58.344508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2783/3578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1663 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:58.357188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.358522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:58.367525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.368179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.368476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.369393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.370073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.370683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.959160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.977702 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a309e03a-ff1f-4041-9098-98f137624937 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 0.629757 Oct 04 18:08:58.992594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2784/3579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.006109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.008587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.034677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.035247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.035914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.036826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.037396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.038561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.041740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:59.093565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.094069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.094518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.095462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lazy-loading 'fault' on Instance uuid 87221687-48ef-4445-8ddc-5c38d85c7246 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:59.169077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.194925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.196803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc66c317434995a863e37c450d2aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dde8cd7f6b49e983f986d09fd2a4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.198220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9aec786-9d6d-447e-b508-2f38fee12cff tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 200 len: 1608 microversion: 2.42 time: 0.204137 Oct 04 18:08:59.199495 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2785/3580] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 1608 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:59.210667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.211331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.217668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.218199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.218839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.219688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.220011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.220383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.406435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.418965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a0a521e-225e-4b53-9c4a-0d935a6864bc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1260 microversion: 2.1 time: 0.212108 Oct 04 18:08:59.431572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2786/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.444042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.444966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.460983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.462653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.463791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.465276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.466034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.466802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.096114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.109620 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8e66b50-76af-49ac-986b-b2e062f45b55 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1663 microversion: 2.1 time: 0.676194 Oct 04 18:09:00.111182 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2787/3582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1663 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.117842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6d772-4435-4ee5-995a-b0ba25de7df2", "name": "network-vif-plugged", "status": "completed", "tag": "e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:00.133114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.133617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.134234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.153571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] Creating event network-vif-plugged:e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71 for instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 on n-h1-831193-17 Oct 04 18:09:00.167915 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9b1e9385-438b-4278-8e60-d765b4d67374 req-84679253-2101-4ef0-8449-1163291be3ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053615 Oct 04 18:09:00.169854 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2788/3583] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:00.181499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.182783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.215799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.217590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.217590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.218658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.219224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.219664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.757765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.767185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-940e19db-502f-4d1e-a840-3f257272f79f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1322 microversion: 2.1 time: 0.595107 Oct 04 18:09:00.768003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2789/3584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.773445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.774394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.781815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.782630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.783307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.784731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.785504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.786108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.808331 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] HTTP exception thrown: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Request method failure captured: Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 HTTP/1.1 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVIHUoF3pZfAsEveSiGAmQCI6YYYdEJyzde8HYt03OLVpX5d2tz2V0PjOQpaFXnLVoz5O664ZQzYQRfcfjDlxqmODy14flIjO_50XKCcH99wdbwFrERDbjwAD6gbsYDleD2WeYCAQeH1oXQFrG4eNJ-pv5_dXpoxuyik6JoPIqJZaw Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: cafc66c317434995a863e37c450d2aca Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '87221687-48ef-4445-8ddc-5c38d85c7246'} Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.810784 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:00.814364 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.816555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Returning 404 to user: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:00.818270 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-884ab3a0-37e7-4823-9912-80f470dbd575 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 404 len: 111 microversion: 2.42 time: 0.049186 Oct 04 18:09:00.819069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2790/3585] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:00.826858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.827755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.834936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.835600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.836346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.837208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.842583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.843344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.934648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.947270 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3555a222-a73e-4003-abe4-ac5ee29f5315 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1266 microversion: 2.1 time: 0.126837 Oct 04 18:09:00.948525 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2791/3586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.956642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6fd8a54e-fb81-4a1a-9920-fe14aa93ea06 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '.version_select at 0x7f6340dee430>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.980912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6fd8a54e-fb81-4a1a-9920-fe14aa93ea06 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46955100" status: 204 len: 0 microversion: 2.42 time: 0.030698 Oct 04 18:09:00.982839 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2792/3587] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46955100 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:09:01.138044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.140459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.153818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.157649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.158525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.160051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.164697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.169175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.488244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.504256 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-332bfacc-41bd-4f16-9da5-912b6edb229b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.372151 Oct 04 18:09:01.515771 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2793/3588] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:01.563618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.569648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.591886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.592955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.593725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.594684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.596527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.597464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.003515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.017125 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-649981d0-9c21-40a3-9eb0-6c8f021a971c tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.481792 Oct 04 18:09:02.019099 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2794/3589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.027396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.029383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.072875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.073412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.073915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.075078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.075694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.076871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.447534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.459451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-536ff025-04eb-48d2-9e3a-5c250bba27d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1516 microversion: 2.1 time: 0.433407 Oct 04 18:09:02.460244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2795/3590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.466471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.467202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.483216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.485228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.487647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.489815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.493599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.494133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.925065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.936401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fdd348f4-3711-4a79-9314-2606477c83d0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.474071 Oct 04 18:09:02.947204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2796/3591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.947204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.947204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.954222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.954222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.954222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.954222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.954222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.954584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.472386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.482927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b500517-3e23-43f7-822b-80c372034176 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.544305 Oct 04 18:09:03.488989 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2797/3592] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:03.495654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:03.499305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.507418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.508204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.509216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.510228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.510996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.512044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.545513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'flavor' on Instance uuid 0fc6d772-4435-4ee5-995a-b0ba25de7df2 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:03.652121 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8976bb8e-093b-46ae-af22-e56ca508f78a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action" status: 200 len: 32 microversion: 2.1 time: 0.160539 Oct 04 18:09:03.657949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2798/3593] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:03 2022] POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:09:03.664823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.665632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.675277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.675944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.676957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.678128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.678823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.679386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.609088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.619142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0405a2b4-f8a1-4007-970f-4c74c83e625b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.959713 Oct 04 18:09:04.620314 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2799/3594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:04.626262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.627391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.635947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.636792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.637508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.638919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.639743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.640719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.213402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.225502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b13052c1-992a-4149-af12-2f30eab685fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.603746 Oct 04 18:09:05.232613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2800/3595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:05.245393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1", "tag": "6588c957-97ce-43e1-a478-ab64eced10e1"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:05.263981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.264710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.265300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.282339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] Creating event network-changed:6588c957-97ce-43e1-a478-ab64eced10e1 for instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 on n-h2-831193-17 Oct 04 18:09:05.288704 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f4d337a4-14a9-447a-9cbf-c225c27300f3 req-07c99b61-ad3b-4a3a-ad68-1408e6306e44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053613 Oct 04 18:09:05.289930 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2801/3596] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:05.298604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.299663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:05.311608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.312846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.313874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.314759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.315402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.316050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.344008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:05.731143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.743875 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67009507-b299-41c3-8711-e32b0e4e199a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.451777 Oct 04 18:09:05.744614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2802/3597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:05.758431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.759715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:05.773868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.774371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.779404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.780202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.780684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.781121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.800418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:05.865609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:06.190913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.204727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c735014-075f-40d1-909a-d051a8947276 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.458819 Oct 04 18:09:06.208861 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2803/3598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.230981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:06.231841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.238783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.239515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.240138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.241009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.241624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.242211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.268569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lazy-loading 'flavor' on Instance uuid 9185a0f9-750a-4f7c-8f32-231bb72d2b01 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:06.359442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79ce58ad-5c39-4bc1-9083-ffc03fc1cb24 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.132077 Oct 04 18:09:06.361463 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2804/3599] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:06 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:06.378147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.379863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.392104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.393538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.394224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.395883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.396752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.397508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.631696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.643773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa343650-1bb0-4fc3-9e06-91699ef5cd79 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.276457 Oct 04 18:09:06.644373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2805/3600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.671998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.672589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.683251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.684041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.684487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.685203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.685668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.686110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.969930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.993745 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10b80c0c-4fa9-4d86-ad0a-99f6778fa961 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1675 microversion: 2.1 time: 0.331497 Oct 04 18:09:06.994501 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2806/3601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1675 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:07.008435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.009317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.021368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.022359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.023016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.023991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.025005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.025720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.043541 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] HTTP exception thrown: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Request method failure captured: Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 HTTP/1.1 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVIHUoF3pZfAsEveSiGAmQCI6YYYdEJyzde8HYt03OLVpX5d2tz2V0PjOQpaFXnLVoz5O664ZQzYQRfcfjDlxqmODy14flIjO_50XKCcH99wdbwFrERDbjwAD6gbsYDleD2WeYCAQeH1oXQFrG4eNJ-pv5_dXpoxuyik6JoPIqJZaw Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: cafc66c317434995a863e37c450d2aca Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '87221687-48ef-4445-8ddc-5c38d85c7246'} Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:07.046157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.049617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.052487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Returning 404 to user: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:07.053786 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9d62ac2-130f-40d7-b265-b82818227c81 tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "DELETE /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 404 len: 111 microversion: 2.42 time: 0.058022 Oct 04 18:09:07.054591 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2807/3602] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:09:06 2022] DELETE /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:07.063342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.064231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.068892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:07.073427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.074198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.076546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.077524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.080004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.080822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.410475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.420086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2fb68d6c-2c88-4439-a2b5-cc3cdb62f9c0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.360850 Oct 04 18:09:07.421378 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2808/3603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:07.426912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.427782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] [instance: 87221687-48ef-4445-8ddc-5c38d85c7246] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.434413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.435452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.436321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.437655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.438147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.438611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.454677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] HTTP exception thrown: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Request method failure captured: Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 HTTP/1.1 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHVIHUoF3pZfAsEveSiGAmQCI6YYYdEJyzde8HYt03OLVpX5d2tz2V0PjOQpaFXnLVoz5O664ZQzYQRfcfjDlxqmODy14flIjO_50XKCcH99wdbwFrERDbjwAD6gbsYDleD2WeYCAQeH1oXQFrG4eNJ-pv5_dXpoxuyik6JoPIqJZaw Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/23dde8cd7f6b49e983f986d09fd2a4b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 23dde8cd7f6b49e983f986d09fd2a4b9 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627057276 Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: cafc66c317434995a863e37c450d2aca Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627057276-project Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '87221687-48ef-4445-8ddc-5c38d85c7246'} Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.456323 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] Returning 404 to user: Instance 87221687-48ef-4445-8ddc-5c38d85c7246 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de26527b-5b45-420d-83f0-f8a9378ad37f tempest-TaggedBootDevicesTest_v242-1627057276 tempest-TaggedBootDevicesTest_v242-1627057276-project] 10.222.0.33 "GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246" status: 404 len: 111 microversion: 2.42 time: 0.035287 Oct 04 18:09:07.461787 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2809/3604] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/87221687-48ef-4445-8ddc-5c38d85c7246 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:07.677478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.678632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.691024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.692945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.694060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.695666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.697071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.698677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.900890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.909671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-76d19f4c-7ce7-4933-97e8-0cd4ac2c886c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.242609 Oct 04 18:09:07.910699 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2810/3605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:08.020064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:08.020704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.026652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.027180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.027629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.028334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.028869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.029357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.193980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:08.210828 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-639734b9-b260-4d4d-bb48-d7ae6308d001 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1658 microversion: 2.1 time: 0.194508 Oct 04 18:09:08.219908 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2811/3606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:08 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1658 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:08.249034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:08.249581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.258514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.259047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.259489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.260208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.263904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.264709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.406530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-20c5fce0-3a34-4d11-82c9-6e93949d2765 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action" status: 202 len: 0 microversion: 2.1 time: 0.161321 Oct 04 18:09:08.407624 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2812/3607] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:08 2022] POST /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:08.434484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:08.435472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.456821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.458093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.458935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.460510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.462155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.462859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.998437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:09.009451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18882558-2b19-4f99-9e1e-f3e9e458f244 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1664 microversion: 2.1 time: 0.584250 Oct 04 18:09:09.014586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2813/3608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:08 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1664 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:09.019961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.026127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.040738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.043828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.044456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.045453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.049613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.050258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.391608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:09.406275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6c5ff37-ee13-49bd-943e-78a3fa30700c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.389791 Oct 04 18:09:09.420006 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2814/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:09.430420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.431586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.440048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.441017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.442254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.443559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.444307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.444971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.872233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:09.883553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6b8c0832-b894-4138-bd90-109f8e4af95e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.458294 Oct 04 18:09:09.884838 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2815/3610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.047139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.049807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:10.065684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.069943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.071225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.072851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.074656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.075130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.345073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.360482 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bd78a6d-6167-4ed2-b749-9fae20f8f62f tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1664 microversion: 2.1 time: 0.323704 Oct 04 18:09:10.364956 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2816/3611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1664 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.434963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.436046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:10.445955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.449518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.450271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.452300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.454078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.456743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.959922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.967837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:10.982609 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6b2c2530-c942-48a2-8f1d-e552f65bd3c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.553148 Oct 04 18:09:10.997298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2817/3612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.011341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "6588c957-97ce-43e1-a478-ab64eced10e1"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:11.027776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.028587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.029369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.061133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] Creating event network-vif-plugged:6588c957-97ce-43e1-a478-ab64eced10e1 for instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 on n-h2-831193-17 Oct 04 18:09:11.075494 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-931dbe79-8a28-4413-bec9-d3bed7f229d6 req-9aeee8be-b381-464d-90f8-bea487ae2297 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076802 Oct 04 18:09:11.078378 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2818/3613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:11.086902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.087654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.101711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.102427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.103093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.104027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.104679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.106555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.473701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.487806 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cdd5749-d345-4d56-a8c4-9e2d3fc61e21 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.405691 Oct 04 18:09:11.489197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2819/3614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.499856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.502609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.511086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.512029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.512870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.514166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.514848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.515501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.809210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.823412 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28d61622-806a-4dd5-a629-3a02dbe0e911 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.332494 Oct 04 18:09:11.824278 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2820/3615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.857572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.858193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.878312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.879787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.881401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.883537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.884447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.885473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.406573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.428686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2505b9b2-365c-42d8-9501-37943f694adb tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1667 microversion: 2.1 time: 0.579011 Oct 04 18:09:12.429878 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2821/3616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1667 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:12.449225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.449225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:12.486427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.489814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.492262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.496845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.497602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.499277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.960524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.975867 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8eb8703-115a-49fc-8b9c-e05acb83e947 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1308 microversion: 2.1 time: 0.542246 Oct 04 18:09:12.977215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2822/3617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.990626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.993879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:13.007549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.008600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.010065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.011133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.011954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.012708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.075801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:13.091664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Working on deleting snapshot 4d313cee-1776-40ec-8547-4e68a19d5cc1 from shelved instance... Oct 04 18:09:14.444790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Doing local delete in cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) {{(pid=128770) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:09:14.446413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:14.447762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:14.458580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:14.459190 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:09:14.464672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] deallocate_for_instance() {{(pid=128770) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:09:15.927278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Updating instance_info_cache with network_info: [] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:09:16.207765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b81e60ad-16a1-45ae-a822-46b6689717b2 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 204 len: 0 microversion: 2.1 time: 3.226764 Oct 04 18:09:16.212749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2823/3618] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:12 2022] DELETE /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 0 bytes in 3229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:16.213915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.214758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.223176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.223850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.225206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.225977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.226449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.226928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.425511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.438226 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55962bb7-2e2b-4a86-9b5f-5d496805f48b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.226902 Oct 04 18:09:16.441235 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2824/3619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:16.458825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.460696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.470356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.472751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.473971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.475214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.477218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.478569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.764212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.773204 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2fdab1a4-4021-40d1-9132-f9fc1b1d3159 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1488 microversion: 2.1 time: 0.329766 Oct 04 18:09:16.774150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2825/3620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1488 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:16.778982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8fa404-2e8b-4bc1-9a7e-755d5992adf0", "name": "network-vif-deleted", "tag": "dfcf0a9b-e581-47f4-96bb-3b43632e90ca"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:16.797253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.797847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.798286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.823454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_external_events [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] Unable to find a host for instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0. Dropping event network-vif-deleted {{(pid=128770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:09:16.824251 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c9349827-ec80-447a-b016-d9b9da87194f req-2d8fe73c-a740-4d2c-9f9a-5c6e0b79b709 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049142 Oct 04 18:09:16.828920 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2826/3621] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:09:16.837851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.838772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.845140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.845653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.846106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.846833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.847335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.848791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.896614 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 HTTP/1.1 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7f8fa404-2e8b-4bc1-9a7e-755d5992adf0'} Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:16.916259 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 404 to user: Instance 7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99a0a722-675e-4096-9cb7-0edada2b013d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0" status: 404 len: 111 microversion: 2.1 time: 0.088437 Oct 04 18:09:16.920239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2827/3622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/7f8fa404-2e8b-4bc1-9a7e-755d5992adf0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:16.930620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:16.933245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.953432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.954083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.954426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.955207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.955677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.956393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.074605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-688493a5-2217-4092-87f1-60bd499b42e9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "PUT /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1083 microversion: 2.1 time: 0.152081 Oct 04 18:09:17.087966 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2828/3623] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:09:16 2022] PUT /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1083 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.094959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.096270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.112859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.116508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.118274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.119188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.121262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.123534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.160595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:17.187724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:17.334391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9101cfad-ece9-4793-aa80-73f836f47bbd tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 204 len: 0 microversion: 2.1 time: 0.244499 Oct 04 18:09:17.335707 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2829/3624] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:17 2022] DELETE /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:17.343313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.344460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.353447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.354189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.354848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.356037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.356905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.357601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.644115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:17.666547 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15c2deb0-a8dd-4047-b70d-cf032d86fcb5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1509 microversion: 2.1 time: 0.328747 Oct 04 18:09:17.692423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2830/3625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.712747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.713651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.746189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.747785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.750589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.751685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.753279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.754839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.950592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:17.966498 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87a21929-0ac5-4640-946f-0c5e291cb562 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1466 microversion: 2.1 time: 0.270716 Oct 04 18:09:17.969470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2831/3626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1466 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.974527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.976757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.983618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.999770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.000855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.001825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.002331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.002762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.248651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.260404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cfbbe7ca-ecd4-4bef-8859-a39f963c5332 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.289669 Oct 04 18:09:18.265846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2832/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.283240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.283929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.305283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.307651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.309239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.310731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.313471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.314287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.820111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.830985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3dc74471-7adb-4a3e-97fc-9a685721e4c1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1509 microversion: 2.1 time: 0.561929 Oct 04 18:09:18.834519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2833/3628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.859856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.860752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.868152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.869586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.870372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.871318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.872151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.872820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.937642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:19.089469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f5b9b2c-6e3c-4d11-94cf-0679581474ec tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 204 len: 0 microversion: 2.1 time: 0.233281 Oct 04 18:09:19.094983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2834/3629] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:18 2022] DELETE /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:19.107012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.109709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.126315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.129385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.136329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.137694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.139688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.142965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.318196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.331769 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa7361f0-cdc1-42a9-aa2b-f2f999451f31 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1466 microversion: 2.1 time: 0.237649 Oct 04 18:09:19.358259 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2835/3630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1466 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.364193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.366722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.382903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.384926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.386663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.388688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.389392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.390300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.623068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.637714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9de67c0e-7aaa-4086-8efa-4c2a49c86ad0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1515 microversion: 2.1 time: 0.277923 Oct 04 18:09:19.652512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2836/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.659364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.660671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.670225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.672445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.673272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.675095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.676996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.677652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.928074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.941018 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-95782a2d-af35-4628-ad3f-4d5a2c8d00cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.285169 Oct 04 18:09:19.942366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2837/3632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:20.236260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c50aba5-e3bc-4cee-a446-910e3fe4e07e", "name": "network-vif-deleted", "tag": "050ef49a-33b3-47d1-b077-6af28b7148ee"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:20.281327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.281887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.282348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.329781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] Creating event network-vif-deleted:050ef49a-33b3-47d1-b077-6af28b7148ee for instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e on n-h1-831193-17 Oct 04 18:09:20.344329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9bb665bc-11df-431f-9abc-a57c69c90b1e req-ac342ebe-7618-44f4-95ba-2dafe246872c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111600 Oct 04 18:09:20.344970 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2838/3633] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:20.359448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.360170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:20.377446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.378884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.379749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.380686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.391394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.393497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.475074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.479491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.480170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.480771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lazy-loading 'fault' on Instance uuid 4c50aba5-e3bc-4cee-a446-910e3fe4e07e {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:20.548233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.565374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ffbad91-e584-4f6c-8753-a63024991a0d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 200 len: 1305 microversion: 2.1 time: 0.210726 Oct 04 18:09:20.566988 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2839/3634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:20.668245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.669196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:20.680316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.681157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.681752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.682800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.683550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.684196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.187499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:21.216132 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84a3235c-139d-4347-af42-b946d2a3cbfa tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1515 microversion: 2.1 time: 0.557664 Oct 04 18:09:21.229326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2840/3635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:21.241758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.250276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.305773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.307810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.308363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.310644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.312669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.315886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.590546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:21.606605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0057b994-ce2b-47e7-af5b-7beb530d6fc6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.375628 Oct 04 18:09:21.607976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2841/3636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:21.620648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.624315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 4c50aba5-e3bc-4cee-a446-910e3fe4e07e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.640772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.646161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.647065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.648132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.654290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.654922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.682671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e HTTP/1.1 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4c50aba5-e3bc-4cee-a446-910e3fe4e07e'} Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:21.690712 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. Oct 04 18:09:21.696307 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.698912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 404 to user: Instance 4c50aba5-e3bc-4cee-a446-910e3fe4e07e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:21.700143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29fd1175-9418-4aec-b76e-74b1c93722f3 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e" status: 404 len: 111 microversion: 2.1 time: 0.086383 Oct 04 18:09:21.701730 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2842/3637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/4c50aba5-e3bc-4cee-a446-910e3fe4e07e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:21.715706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.718226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.736506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.737160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.738979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.743216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.743888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.744338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.781325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:21.790184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:21.968675 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1a347cd-8084-4825-81c3-0383dff1bf25 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 204 len: 0 microversion: 2.1 time: 0.261580 Oct 04 18:09:21.969845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2843/3638] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:21 2022] DELETE /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:21.991592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.992575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.002900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:22.006337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.008108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.008811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.009987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.029372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.035561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.310888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.352469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78beaa12-e82c-4318-a010-ab9b56855b51 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1507 microversion: 2.1 time: 0.368973 Oct 04 18:09:22.354793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2844/3639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:22.360492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1", "name": "network-vif-deleted", "tag": "6588c957-97ce-43e1-a478-ab64eced10e1"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:22.380947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.381623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.383915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.407077 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] Creating event network-vif-deleted:6588c957-97ce-43e1-a478-ab64eced10e1 for instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 on n-h2-831193-17 Oct 04 18:09:22.425332 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-715fbe83-5241-4b6e-9ee7-647cb2a468fd req-41cd48ad-4e22-409c-b308-fe70e4203be3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067320 Oct 04 18:09:22.428490 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2845/3640] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:22.469811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.470751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.484541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.485530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.486523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.487882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.488587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.489392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.556929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.557968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.558727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.559781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lazy-loading 'fault' on Instance uuid 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:22.638660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.650857 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0735ee7-2d92-4899-9a48-a7dd95beb2d7 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 200 len: 1319 microversion: 2.1 time: 0.193860 Oct 04 18:09:22.654631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2846/3641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:22.661571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.662256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.672339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.673630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.673630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.677074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.677962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.678487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.913639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.930094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f1ed4468-5a51-4139-9cd2-f88e46168625 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.273721 Oct 04 18:09:22.930651 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2847/3642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:23.403188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.405299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.420219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.427250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.428540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.431492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.432979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.433765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.944110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:23.952975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2977c98d-d519-4b4c-9edd-078ba3da7bc1 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1507 microversion: 2.1 time: 0.560488 Oct 04 18:09:23.955128 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2848/3643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:23 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:23.963408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.964485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.972599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.973441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.974331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.975429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.976449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.977320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.995204 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 HTTP/1.1 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1'} Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.997036 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37d62366-0cb7-4c14-838c-57b81d28068c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 404 len: 111 microversion: 2.1 time: 0.042388 Oct 04 18:09:24.001515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2849/3644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:23 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:24.006981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.007930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.015544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.016205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.016757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.018320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.019149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.020152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.209585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.218841 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-784e2839-fadf-464a-80f7-a5598afec014 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.217239 Oct 04 18:09:24.219482 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2850/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:24.235347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1608596351", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c86c13d9-4055-45a9-a8ce-1db057fdd3a9"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:24.333423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] validate_networks() for [('c86c13d9-4055-45a9-a8ce-1db057fdd3a9', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:24.866267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:24.866829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:24.867966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:24.868402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:24.868826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:24.881422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.882146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.882926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.885117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.886059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.887184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.926605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:24.934700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Getting quotas for user 0a8e43811740448e83e0e8e5dd97de8c and project 91810ef24e0c4ac0ba38bfb80c62a4e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:24.970156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:24.973669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:25.050634 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ad091be-8cc3-4bc6-b2cf-ad1a577afad9 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820452 Oct 04 18:09:25.060846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2851/3646] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:25.627164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.628248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.655836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.658904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.661903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.667612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.671561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.673033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.792473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.796393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.799016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.799783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lazy-loading 'fault' on Instance uuid 307ad4c6-bf45-4578-a62c-21033d53afa8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:25.908921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.925263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01376389-77d9-468f-aa15-c1dc24311f6b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 200 len: 1304 microversion: 2.1 time: 0.862017 Oct 04 18:09:25.931508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2852/3647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 1304 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:25.948164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7984ea1b-c4a2-480f-8422-92ea863f514c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.951261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7984ea1b-c4a2-480f-8422-92ea863f514c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.184441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7984ea1b-c4a2-480f-8422-92ea863f514c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.196285 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7984ea1b-c4a2-480f-8422-92ea863f514c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1209 microversion: 2.1 time: 0.259174 Oct 04 18:09:26.211973 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2853/3648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1209 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:26.224635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ad4c6-bf45-4578-a62c-21033d53afa8", "name": "network-vif-deleted", "tag": "2486f8ae-516e-4c10-882f-28ced930e64f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:26.253260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.254051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.254783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.268743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] Creating event network-vif-deleted:2486f8ae-516e-4c10-882f-28ced930e64f for instance 307ad4c6-bf45-4578-a62c-21033d53afa8 on n-h1-831193-17 Oct 04 18:09:26.275940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8f55bd1f-f50d-4cd7-b05f-5be0c65bfdf1 req-a8eb38d4-354a-48da-af47-0eecbc7b9ebf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061906 Oct 04 18:09:26.276810 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2854/3649] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:26.287782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.288830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.296521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.297272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.297919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.298852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.299493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.300424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.646234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.657342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8fc5b659-54b7-454f-8fc1-57ba6c42d820 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.379084 Oct 04 18:09:26.662446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2855/3650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:26.958464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.961111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 307ad4c6-bf45-4578-a62c-21033d53afa8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.981998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.982865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.983671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.985323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.985991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.986659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.008931 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 HTTP/1.1 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '307ad4c6-bf45-4578-a62c-21033d53afa8'} Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:27.011258 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 404 to user: Instance 307ad4c6-bf45-4578-a62c-21033d53afa8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-485abfc1-8f88-4570-98eb-683b70a54b29 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8" status: 404 len: 111 microversion: 2.1 time: 0.060654 Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2856/3651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/307ad4c6-bf45-4578-a62c-21033d53afa8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.024984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.032053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.032566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.033073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.036343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.037370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.038023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.132125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:27.262013 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1634305-2f9d-4707-921d-5ed099f1b94d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 204 len: 0 microversion: 2.1 time: 0.242969 Oct 04 18:09:27.263196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2857/3652] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:27 2022] DELETE /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:27.273114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.274400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.282875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.284524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.286232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.287498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.288255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.289061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.395367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.430114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.431864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.433391 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3df3710-6d39-481e-916e-4cc33683141e tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2952 microversion: 2.32 time: 1.168083 Oct 04 18:09:28.434453 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2858/3653] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:27 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2952 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:28.461385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.463185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.478999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.481988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.483929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.486303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.487080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.487909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.653805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.664971 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-60b32049-9dac-4050-a7c3-a4d31c643a9d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1267 microversion: 2.1 time: 0.228912 Oct 04 18:09:28.666452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2859/3654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:28.672565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.674117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.683144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.683767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.684222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.684955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.685423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.685862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.330585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:29.344953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:29.348185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26cbb934-1d6e-440c-a632-eede71f9d41b tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1494 microversion: 2.1 time: 0.680166 Oct 04 18:09:29.349427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2860/3655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1494 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:29.361697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:29.366351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:29.379461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.380633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.381349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.382434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.383303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.383991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.068081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.078895 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f6eeee6-6c72-4826-a709-a1d2ce332c4e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.728025 Oct 04 18:09:30.089585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2861/3656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:29 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:30.095169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.096032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.142590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.143498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.157443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.158223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.158710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.159170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.483616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8b6dad9-b483-49c6-88a3-089b6e83951f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.392483 Oct 04 18:09:30.494293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2862/3657] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963/os-interface => generated 1832 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:30.504874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.506244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.518543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.520134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.520803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.521779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.522682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.524468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.670911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.685653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c6562fa-691e-44c9-a9a6-2bd82bf6da16 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1267 microversion: 2.1 time: 0.189289 Oct 04 18:09:30.686519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2863/3658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:30.699843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.702122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.717134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.721621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.722346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.723929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.728127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.729054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.815468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.816348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.816806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.817493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lazy-loading 'fault' on Instance uuid 95f5f017-8641-4a5c-a172-a8756c9fbb5d {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:30.978479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.997907 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd91f874-e1f4-4ced-936f-188cc0a87a7d tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 200 len: 1304 microversion: 2.1 time: 0.309291 Oct 04 18:09:31.014350 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2864/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:31.024649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f5f017-8641-4a5c-a172-a8756c9fbb5d", "name": "network-vif-deleted", "tag": "9fa7e558-819c-404b-a928-b7ec0fed69d4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:31.039596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.040468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.041632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.060617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] Creating event network-vif-deleted:9fa7e558-819c-404b-a928-b7ec0fed69d4 for instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d on n-h2-831193-17 Oct 04 18:09:31.068419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5238dba8-f1bd-4a9b-b478-9eacd8a3ae15 req-16c8040a-9d18-40b9-b2e8-2d38f62ceff7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052432 Oct 04 18:09:31.070950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2865/3660] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:31.123653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.125638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.153028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.154278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.155732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.158443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.159185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.160694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.810042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:31.828342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a514e31-7310-493c-818e-743225ee42ad tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.713592 Oct 04 18:09:31.852522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2866/3661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:31.866173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.867571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.878104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.879589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.883847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.886002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.887115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.887900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.882992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:32.906240 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e4c3d33-ddc9-4621-88ca-8ae7ff53ac1e tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 1.052396 Oct 04 18:09:32.920748 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2867/3662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:32.936496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:32.940592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 95f5f017-8641-4a5c-a172-a8756c9fbb5d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:32.960977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.962640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.963539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.964895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.965756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.966499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.989698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d HTTP/1.1 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '95f5f017-8641-4a5c-a172-a8756c9fbb5d'} Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:32.991703 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. Oct 04 18:09:32.995274 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:32.998014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 404 to user: Instance 95f5f017-8641-4a5c-a172-a8756c9fbb5d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:33.000040 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb96cddc-fa25-4dda-a4e6-9837d0538b98 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d" status: 404 len: 111 microversion: 2.1 time: 0.075548 Oct 04 18:09:33.001149 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2868/3663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:32 2022] GET /compute/v2.1/servers/95f5f017-8641-4a5c-a172-a8756c9fbb5d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:33.006321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.007331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.015752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.016833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.017564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.018446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.019645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.020184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.409279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.429989 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-729c520c-598f-4a37-aec5-3ee3a2a421f5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1522 microversion: 2.1 time: 0.427473 Oct 04 18:09:33.436073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2869/3664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:33.436073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.436443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.450617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.451432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.452980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.454080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.454799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.455481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.505629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:33.643584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8c950f7-6520-4416-b570-f58db81e11ca tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 204 len: 0 microversion: 2.1 time: 0.210870 Oct 04 18:09:33.651390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2870/3665] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:33 2022] DELETE /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:33.661927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.663294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.674906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.675865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.677245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.678728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.679496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.681849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.019700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.029368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ecf9388-ae11-42e1-b9a9-ab74b8031c93 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1673 microversion: 2.1 time: 0.376192 Oct 04 18:09:34.040735 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2871/3666] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1673 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.056252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.057198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.065091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.065795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.066942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.067874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.068571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.069154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.444745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.465456 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4d95875-0308-4ed9-9b0b-d7445c8f7317 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.421118 Oct 04 18:09:34.468534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2872/3667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.475670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c185e377-e1cd-42f2-bf63-e85fa6d733ff", "tag": "0f0673c9-2eae-442e-b42b-4e2b1631b587"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:34.530860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.536709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.540962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.569106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] Creating event network-changed:0f0673c9-2eae-442e-b42b-4e2b1631b587 for instance c185e377-e1cd-42f2-bf63-e85fa6d733ff on n-h2-831193-17 Oct 04 18:09:34.584188 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-28259956-f376-4d21-84af-080741c8c89a req-fc353a39-39e7-4c53-a392-f660294ea33b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113866 Oct 04 18:09:34.585117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2873/3668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:34.605852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.608940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.622738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.626770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.629631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.632249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.632942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.634140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.851574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.861213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-114ad21d-4ea6-4e69-a479-a920f9e24420 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1502 microversion: 2.1 time: 0.274572 Oct 04 18:09:34.862525 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2874/3669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.974448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.975099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.997725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:35.000539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.001237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.002115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.003133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.003852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.004519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.587948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:35.604979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35ef489c-d028-4454-9b7f-72dc5227a688 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1515 microversion: 2.1 time: 0.632874 Oct 04 18:09:35.619066 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2875/3670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1515 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:35.620309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:35.621980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:35.635663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.636310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.636814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.637818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.638944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.639655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.192814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:36.621360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.634902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4199f24a-510d-4614-89e5-157f4a19d725 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1673 microversion: 2.1 time: 1.026213 Oct 04 18:09:36.637210 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2876/3671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:35 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1673 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:36.685880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:36.686580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:36.717369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:36.734105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.739350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.742267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.743693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.744190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.744633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.425120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.438887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:37.449982 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e384604e-2424-4a09-ab76-d44f8e19389a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.811396 Oct 04 18:09:37.468165 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2877/3672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:36 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.486906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:37.514452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: fadb3f8b-243c-427a-9ee7-9b0cfd5485b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.525264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/fadb3f8b-243c-427a-9ee7-9b0cfd5485b9/action HTTP/1.1 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 14 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: {"rescue": {}} Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'fadb3f8b-243c-427a-9ee7-9b0cfd5485b9', 'body': {'rescue': {}}} Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:37.530727 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. Oct 04 18:09:37.535799 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:37.538960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 404 to user: Instance fadb3f8b-243c-427a-9ee7-9b0cfd5485b9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:37.542012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e48e4e81-159a-47ad-882d-4e8b9e943a98 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/fadb3f8b-243c-427a-9ee7-9b0cfd5485b9/action" status: 404 len: 111 microversion: 2.1 time: 0.070820 Oct 04 18:09:37.552197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2878/3673] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:37 2022] POST /compute/v2.1/servers/fadb3f8b-243c-427a-9ee7-9b0cfd5485b9/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:37.570079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:37.572957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.597602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.598183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.598630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.601517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.602054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.602511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.732563 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4c4d43e-ae67-4781-8c33-2f1cbaa5e010 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action" status: 202 len: 0 microversion: 2.1 time: 0.174479 Oct 04 18:09:37.736448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2879/3674] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:37 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:37.745938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.754291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.772198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.773270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.774136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.775325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.778612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.779547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.976048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b85216915b4f62a9792a82adffc05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba6215ca0f94666914353478323a7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.989283 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f21f0740-f77d-45c6-a57e-b8570d548067 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 200 len: 1605 microversion: 2.1 time: 0.246802 Oct 04 18:09:37.990153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2880/3675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:38.002687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.003637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.019790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.020480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.022537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.023483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.025381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.026094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.424378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.454101 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35d877d6-0b42-436b-b27c-83348353f83b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1520 microversion: 2.1 time: 0.458692 Oct 04 18:09:38.455371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2881/3676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:38.497863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.501282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.539252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.552484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.554235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.558282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.559214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.559915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.419625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.439864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05334fd3-2149-4d84-96e9-a394406e6fd2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.953492 Oct 04 18:09:39.440789 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2882/3677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:38 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:39.477981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9185a0f9-750a-4f7c-8f32-231bb72d2b01", "name": "network-vif-deleted", "tag": "eba0cbce-91b1-4e36-9dd3-5c94ee998748"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:39.514324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.514998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.515685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.591528 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] Creating event network-vif-deleted:eba0cbce-91b1-4e36-9dd3-5c94ee998748 for instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 on n-h2-831193-17 Oct 04 18:09:39.603020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0d654f80-e894-4e2e-93f6-d7a915173dba req-8f40a19b-8557-459b-a2da-460020f36d16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160135 Oct 04 18:09:39.608064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2883/3678] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:39.622941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.636663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] [instance: 9185a0f9-750a-4f7c-8f32-231bb72d2b01] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.657112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.657551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.658007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.658775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.659303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.659815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.733527 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] HTTP exception thrown: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Request method failure captured: Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 HTTP/1.1 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHR8WUOtemZb1mjMHcTg5JXPrEP_kP7VUjQAF8oIG_RqHcNHZfEZEZ6irNWpxNA3t9cO97-lEbz6nhCAh72Qd4FnJY1EUKG_4BdHl84aZn8OULFtGk7886s7FL8OlnPRukbT2D2sNn_ebcceuhYSbAss4VkQGwvknvO_yXI9Qzl2kNs Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba6215ca0f94666914353478323a7ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba6215ca0f94666914353478323a7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 2ba6215ca0f94666914353478323a7ee Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-1014308531 Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 76b85216915b4f62a9792a82adffc05c Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-1014308531-project Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9185a0f9-750a-4f7c-8f32-231bb72d2b01'} Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:39.735387 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Returning 404 to user: Instance 9185a0f9-750a-4f7c-8f32-231bb72d2b01 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:39.740143 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f15e39b-02b2-4eb8-93c4-4fcc836ce136 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01" status: 404 len: 111 microversion: 2.1 time: 0.126450 Oct 04 18:09:39.746626 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2884/3679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/9185a0f9-750a-4f7c-8f32-231bb72d2b01 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:39.773113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.773766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.797723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.798258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.798727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.799538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.800020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.801140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.322574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.332894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5982e5f4-38c9-4048-9575-7c77c8753069 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1500 microversion: 2.1 time: 0.580783 Oct 04 18:09:40.333513 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2885/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1500 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:40.345004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d125ac71-e928-4e18-aa8d-07500dd5f188 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] Calling method '.version_select at 0x7f6341a11c10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.439468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d125ac71-e928-4e18-aa8d-07500dd5f188 tempest-ServerActionsTestJSON-1014308531 tempest-ServerActionsTestJSON-1014308531-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891977886" status: 202 len: 0 microversion: 2.1 time: 0.103009 Oct 04 18:09:40.451511 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2886/3681] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:09:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891977886 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:40.478394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:40.481105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.500526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.503074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.507862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.511544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.512052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.512555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.624522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'flavor' on Instance uuid ec12e6b2-7e7d-47f3-99d2-06c84492a474 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:40.660433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Cannot 'rescue' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state paused Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action HTTP/1.1 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 14 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: {"rescue": {}} Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'rescue' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state paused Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ec12e6b2-7e7d-47f3-99d2-06c84492a474', 'body': {'rescue': {}}} Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state paused Oct 04 18:09:40.662437 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state paused Oct 04 18:09:40.666082 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:09:40.672023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 409 to user: Cannot 'rescue' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state paused {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:40.673351 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-257a2ec7-dd09-4d94-a1c5-6673cd905210 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action" status: 409 len: 144 microversion: 2.1 time: 0.216751 Oct 04 18:09:40.674557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2887/3682] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:40 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action => generated 144 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:09:40.684456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.688657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.707648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.708166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.708617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.709352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.709830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.710272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.051551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.075625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bba4d05b-d19c-491c-bd99-cbe51e77ac90 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.399129 Oct 04 18:09:41.089780 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2888/3683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:41.094881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:41.105888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.127081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.128200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.129909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.131445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.140777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.141907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.324189 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f190c0a9-789b-4e11-aabc-fa89ccfcdc85 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action" status: 202 len: 0 microversion: 2.1 time: 0.232518 Oct 04 18:09:41.327522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2889/3684] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:41 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:41.347701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.353591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.387832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.389560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.390628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.392372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.395271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.396803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.042891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:42.065209 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0347e3e9-13d2-4fd3-a89b-16c9f28b01b6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1507 microversion: 2.1 time: 0.733068 Oct 04 18:09:42.075467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2890/3685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1507 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:42.104133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:42.104757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:42.113629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.114144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.114577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.115349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.115816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.116247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.668336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:42.685099 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9a4aeae-9304-41cd-8715-8b4aea991635 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.584353 Oct 04 18:09:42.701328 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2891/3686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:42 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:43.096835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.098295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.129527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.130374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.131398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.132504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.133648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.134433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.199882 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:09:43.200429 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:09:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:09:43.651439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.659927 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee5cef14-7b3a-4569-9aba-dec4400865eb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1515 microversion: 2.1 time: 0.569601 Oct 04 18:09:43.661581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2892/3687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1515 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:43.712408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.719859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.726560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.727072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.740225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.741510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.742314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.743061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.037046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.054658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb87886d-2776-44af-a5a7-f65cc1a909e5 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.346001 Oct 04 18:09:44.058038 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2893/3688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:45.757941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c185e377-e1cd-42f2-bf63-e85fa6d733ff", "name": "network-vif-plugged", "status": "completed", "tag": "0f0673c9-2eae-442e-b42b-4e2b1631b587"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:45.793909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.797730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.798612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.870805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] Creating event network-vif-plugged:0f0673c9-2eae-442e-b42b-4e2b1631b587 for instance c185e377-e1cd-42f2-bf63-e85fa6d733ff on n-h2-831193-17 Oct 04 18:09:45.882355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1f4ad862-a482-45fc-ada7-c50b0f8e9eeb req-bc16c8b3-3b9e-444c-b640-690fdaa76ae4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.855574 Oct 04 18:09:45.884232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2894/3689] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:45.899354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:45.902331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:45.929775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.932365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.935516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.938421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.939019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.939499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.655089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.711460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e14e2c86-fce0-4d93-808a-92f320713071 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1309 microversion: 2.1 time: 0.825454 Oct 04 18:09:46.733113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2895/3690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:45 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1309 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:46.809984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:46.814130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.840834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.843151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.843864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.845080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.845795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.846962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.885374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:46.902163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'flavor' on Instance uuid ec12e6b2-7e7d-47f3-99d2-06c84492a474 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:47.070943 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8402063-3eed-4706-bda5-b4bc3eb23777 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action" status: 200 len: 32 microversion: 2.1 time: 0.268050 Oct 04 18:09:47.079432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2896/3691] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:46 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:09:47.087696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.088715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.100944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.102316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.103471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.104466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.105534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.106472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.842165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:47.864633 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-057d1484-6f9e-499b-82a7-7f7beecffebb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.777888 Oct 04 18:09:47.865352 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2897/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:47.875688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.876643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.897091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.897678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.898140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.902107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.902594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.905133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.631000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.643851 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-116654be-c5f6-4407-9e7f-54337a4fa8e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1490 microversion: 2.1 time: 0.776765 Oct 04 18:09:48.644959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2898/3693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1490 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:48.673158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1666758094"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:48.676574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.692644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.693160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.693720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.694357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.694811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.699157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.848993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2806cc59-f0dd-4b74-a2b5-363ca6d7cb57 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "PUT /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1075 microversion: 2.1 time: 0.180210 Oct 04 18:09:48.863743 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2899/3694] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:09:48 2022] PUT /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1075 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:48.881376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.895468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.977075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.981527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.981770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.985889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.986706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.987287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.441930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.466605 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f424f272-bb32-4d65-a7b3-7ecfb4013442 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1501 microversion: 2.1 time: 0.594827 Oct 04 18:09:49.487011 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2900/3695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1501 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.493108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.494217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.503360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.504199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.504862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.506412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.507358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.508304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.838991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.850169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a3237fa-cb78-465e-914b-cf97da937325 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.361600 Oct 04 18:09:49.863494 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2901/3696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.877346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.878737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.889772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.894753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.895359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.896135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.896624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.897215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.431862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:50.442405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77efbdb2-6a6e-4d86-b0ba-90a6a9aa60f1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1501 microversion: 2.1 time: 0.577522 Oct 04 18:09:50.448169 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2902/3697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1501 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.475361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:50.494876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.497204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.498763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.547148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:09:50.646991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9670aee8-a3c5-4a0d-acb7-ba095884cd35 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "POST /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff/action" status: 202 len: 0 microversion: 2.1 time: 0.178787 Oct 04 18:09:50.647661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2903/3698] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:50 2022] POST /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:50.680882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.682643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.691924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.692675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.698651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.699726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.700410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.701197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.315680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.330308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5394c9a7-76a7-4e3f-9613-8e01a610846c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.667969 Oct 04 18:09:51.331293 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2904/3699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:51.338522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.345769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.360522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.361256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.361878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.363545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.364125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.364576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.884440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.894956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d523db97-eab3-48c6-bdfe-7b66e2e690ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.562331 Oct 04 18:09:51.903990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2905/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:52.368396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.370722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.431988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.435771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.436920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.438045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.438754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.443305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.077240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.090518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45448b7a-b769-4daa-ba5d-ba19c0a9f7ea tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.737847 Oct 04 18:09:53.098302 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2906/3701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.104795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.105459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.125991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.126632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.127123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.127904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.128417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.128948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.678341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.706168 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16fee320-3ad7-4082-819e-e34bd5b5fb25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.606710 Oct 04 18:09:53.714653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2907/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.148081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.148810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.162134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.167299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.167908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.169523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.172819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.174789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.764454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.773371 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-150f57e7-1f28-4356-a34e-e47de8de3f31 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.632042 Oct 04 18:09:54.773976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2908/3703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.793723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.795182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.813066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.827966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.834799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.835764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.842746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.843157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.920214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:55.293007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.303519 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33b0df07-aa19-4680-845a-32b96998b4da tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.528409 Oct 04 18:09:55.316257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2909/3704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:55.804448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.807352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.837137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.838170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.838639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.839407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.842968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.843471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.305171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.317480 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da5efe74-e07b-4716-a9bc-7f66e8806957 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.523148 Oct 04 18:09:56.318091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2910/3705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:56.329249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.340106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.351896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.353925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.354730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.356110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.356825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.357500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.037039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.054621 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4618a7fe-7a77-4b3f-829d-b4676f06a0ee tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.729681 Oct 04 18:09:57.061119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2911/3706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:57.348082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.349741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.362052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.363909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.364841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.368730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.370621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.371384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.266830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.302280 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ace09c83-4df7-4f68-966a-d15ea00a8503 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.951275 Oct 04 18:09:58.304213 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2912/3707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.328367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.329787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.349416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.354633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.356656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.361433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.363290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.364397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.762252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.771238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0eac58cf-314b-4bde-802e-e6deaf070593 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.465240 Oct 04 18:09:58.783537 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2913/3708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.345425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.346130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.363391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.363926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.374762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.378856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.392259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.393129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.867671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.902185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86446dce-62f5-4feb-8a02-459c8d184191 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.558344 Oct 04 18:09:59.908382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2914/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.943327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.943965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.972399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.973197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.973809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.974772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.975433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.976022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.251874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.265220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b7c6d64-f5e8-4a75-89a8-0b511a508e5a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.354487 Oct 04 18:10:00.267846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2915/3710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.613944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1171344545", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "540d0bf1-099e-4eae-a422-759f341c43a0"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:00.700128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] validate_networks() for [('540d0bf1-099e-4eae-a422-759f341c43a0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:02.309484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:02.310083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:02.310646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:02.311131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:02.311857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:02.335828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.336347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.340669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.341593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.346422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.352501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.457093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Getting quotas for project debdbb6a8048440b84d8af1a0b7ea8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:02.478424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Getting quotas for user 3488825130c74fffaa70d6c658dee49c and project debdbb6a8048440b84d8af1a0b7ea8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:02.528938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Going to run 3 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:02.539436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:02.616781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=5d4ea8f2-0f70-45c6-be5b-4408c0129dc8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:02.662605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=ba0c2eec-168a-4588-b81c-d051ba9b2603,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:02.722475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:02.819108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e542a54d-c555-4248-9d42-9327b41bc79c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549033 Oct 04 18:10:02.820006 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2916/3711] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:02.832741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.833381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.853682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.854844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.855512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.857019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.857683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.858849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.691206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.703701 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abad8ccf-0f18-4742-8ef5-b45baddd75f0 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.875986 Oct 04 18:10:03.708131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2917/3712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:03.719881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.721301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.736650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.740307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.740993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.742199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.744117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.744788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.110967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.134452 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a1567f4-db6c-4b0b-91f1-72b45d90ab54 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1501 microversion: 2.1 time: 1.422942 Oct 04 18:10:05.137091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2918/3713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1501 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.155371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.171383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.172619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:05.189937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.195058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.196126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.197115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.198161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.201053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.307479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:05.433350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7d76e85a-6cbb-4832-8299-2fc57d2a75f4 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.291235 Oct 04 18:10:05.449372 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2919/3714] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers => generated 1018 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.454829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.461963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.481937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.482709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.483723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.495455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.496202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.496808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.043245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.059365 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-232c0abf-3c77-4dad-b6bf-1efc8d329f02 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.608385 Oct 04 18:10:06.060551 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2920/3715] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.080815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7e00aca-1ce1-43e2-b923-a1fd44efc0da"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:06.084012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.101042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.101615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.102110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.102862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.103361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.114060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.184861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Cannot 'attach_volume' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state rescued Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/os-volume_attachments HTTP/1.1 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 74 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: {"volumeAttachment": {"volumeId": "b7e00aca-1ce1-43e2-b923-a1fd44efc0da"}} Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'attach_volume' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state rescued Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': 'ec12e6b2-7e7d-47f3-99d2-06c84492a474', 'body': {'volumeAttachment': {'volumeId': 'b7e00aca-1ce1-43e2-b923-a1fd44efc0da'}}} Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:10:06.188966 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state rescued Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state rescued Oct 04 18:10:06.198174 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:06.204023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 409 to user: Cannot 'attach_volume' instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 while it is in vm_state rescued {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:06.204023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4448bef-7fc6-459a-b9ce-1a29d9863d4c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.139922 Oct 04 18:10:06.205071 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2921/3716] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:10:06 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/os-volume_attachments => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:10:06.220081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.221680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.235363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.239515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.240050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.243905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.244886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.248480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.589765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.610840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37773ada-ac01-4429-8030-b2df16af3b32 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1275 microversion: 2.1 time: 0.400056 Oct 04 18:10:06.615325 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2922/3717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1275 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.624688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:06.628416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.678020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.680603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.684044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.685265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.686045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.686765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.956548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2622a89-2374-4312-b6b6-b9cd437ba38f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action" status: 202 len: 0 microversion: 2.1 time: 0.338231 Oct 04 18:10:06.966222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2923/3718] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:06 2022] POST /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:07.293180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: .version_select at 0x7f6345c95dc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-85711135", "policies": ["affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:07.367869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:07.395524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:07.574303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:07.593518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:07.651572 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f97de0d9-a83d-4fde-8965-0a8cd4b46520 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.675692 Oct 04 18:10:07.660433 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2924/3719] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 18:10:06 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:07.666871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.671853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.691664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.692812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.693428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.694338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.694942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.696057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.689649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.704676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf881b09-3c69-4c71-ba0d-8e38d0fc5e57 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1509 microversion: 2.1 time: 1.048661 Oct 04 18:10:08.714181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2925/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1509 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.720349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.721270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.736300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.737341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.737997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.739845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.740834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.741533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.322982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.327423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:09.347160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84fe8fdd-7dd1-4d84-b32c-24aaefd289de tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.631076 Oct 04 18:10:09.355955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2926/3721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.361295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.361897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.383171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.384109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.384901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.385909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.386526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.387139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.969338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.983759 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7d2f27d-47b8-4ffb-8a84-abc63c410eee tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1281 microversion: 2.1 time: 0.625887 Oct 04 18:10:09.984705 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2927/3722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1281 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.998803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: .version_select at 0x7f6341a11700>, body: {"server_group": {"name": "tempest-server-group-1235895168", "policies": ["affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:10.069196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:10.091173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:10.222346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:10.245031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:10.290812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1b9e2e81-e6e4-4ca4-a0ce-62494d962f2d tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.304737 Oct 04 18:10:10.291685 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2928/3723] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 18:10:09 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:10.303971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.307958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.325963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.327008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.327675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.328636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.339918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.340638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.222389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.235314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6cc3c7a-0d11-405a-87b3-bfb78bd546f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1509 microversion: 2.1 time: 1.935768 Oct 04 18:10:12.236802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2929/3724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1509 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.245484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: .version_select at 0x7f6341c36670>, body: {"server_group": {"name": "tempest-server-group-1235895168", "policies": ["affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:12.278403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:12.291771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:12.384695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:12.388539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:12.394749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:12.453747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0d4b380-a9e0-4b73-9963-52fb6b6041e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.214478 Oct 04 18:10:12.460107 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2930/3725] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 18:10:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:12.463156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.463984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.477352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.478958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.479601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.480607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.481456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.483418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.045148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.063831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64ae77be-dd84-45ae-bcf7-66c35c8fc892 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 0.606717 Oct 04 18:10:13.064714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2931/3726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.080213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.088055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.102442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.108908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.113298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.116905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.117570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.118044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.816240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.890046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5baad7ca-4255-49ec-82db-27da9fdd81bd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.823621 Oct 04 18:10:13.891764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2932/3727] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.905932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba0c2eec-168a-4588-b81c-d051ba9b2603", "tag": "9e0a644a-b6df-4bac-8299-2688acb29708"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:13.927846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.928677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.929968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.986524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] Creating event network-changed:9e0a644a-b6df-4bac-8299-2688acb29708 for instance ba0c2eec-168a-4588-b81c-d051ba9b2603 on n-h1-831193-17 Oct 04 18:10:14.011380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e74d305a-facd-4c44-b159-cad71aa71c29 req-0e602d07-764d-422a-b081-58b5ab19fae9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115822 Oct 04 18:10:14.025157 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2933/3728] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:14.039450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b231c82-cb55-41b5-a804-3256dc432a7f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.106023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b231c82-cb55-41b5-a804-3256dc432a7f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/098abb82-78df-4e40-b899-3bbb3e5b2187" status: 204 len: 0 microversion: 2.1 time: 0.079555 Oct 04 18:10:14.106718 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2934/3729] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:14 2022] DELETE /compute/v2.1/os-server-groups/098abb82-78df-4e40-b899-3bbb3e5b2187 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:14.111685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.112924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.130127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.130627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.138767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.140033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.140532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.140978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.645169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:14.665726 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c7f47cd3-0a8d-4f6b-8276-a7730d6d64b8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1515 microversion: 2.1 time: 0.555898 Oct 04 18:10:14.668806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2935/3730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:14.685117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.686472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.707559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.709815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.709815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.727956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.733163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.735315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.232389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:15.695129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.707639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51774bce-86da-4c81-8720-12c49cecc589 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1511 microversion: 2.1 time: 1.035883 Oct 04 18:10:15.710066 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2936/3731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1511 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.721315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26444e92-d573-49ca-be4d-e0c843aa1241 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.748149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26444e92-d573-49ca-be4d-e0c843aa1241 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.036412 Oct 04 18:10:15.751075 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2937/3732] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:15.767400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.769039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.788903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.789539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.790124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.791680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.792978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.793992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.065696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.099749 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44dc2226-cbbc-405e-9822-7eb53d5dc4e0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 1.345514 Oct 04 18:10:17.101700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2938/3733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.145491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3a83c32-627a-48bb-8db4-d0d73e889cca tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.209465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3a83c32-627a-48bb-8db4-d0d73e889cca tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c61eed91-f508-46e4-af36-c96eb37e9d4d" status: 204 len: 0 microversion: 2.1 time: 0.084893 Oct 04 18:10:17.214391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2939/3734] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:17 2022] DELETE /compute/v2.1/os-server-groups/c61eed91-f508-46e4-af36-c96eb37e9d4d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:17.225442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.226396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.243613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.246311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.247106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.248392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.249221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.250559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.840542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.850767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0b658e6-7d0d-462b-8a10-9ec8a2d06df2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1488 microversion: 2.1 time: 0.634938 Oct 04 18:10:17.851620 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2940/3735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1488 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.867506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ebc68c4f-7479-4414-a8ea-4b0b73b61202 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.880816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ebc68c4f-7479-4414-a8ea-4b0b73b61202 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.027953 Oct 04 18:10:17.881829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2941/3736] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:17.903628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b31f059-0a26-4d70-8f8f-1a7fc56606a8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: .version_select at 0x7f6340e724c0>, body: {"keypair": {"name": "tempest-keypair-1523140279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBII37DgL9viJfjYOxiKkUQWqCzSIIxoSNK8hkwCa4KJUkpwj7NytMl04TDll0u8SAmi2cE298iK/HidnNDSPGg3pmIfLd6eC7xujFKZbWohRuQqaOKw6ggHjfrFSUpK6PA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:17.969881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3b31f059-0a26-4d70-8f8f-1a7fc56606a8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for project 1b3067da6039458f917440765eda4a7f. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:17.989534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3b31f059-0a26-4d70-8f8f-1a7fc56606a8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for user 1e4ef2f4be1046a2869572360d9aa168 and project 1b3067da6039458f917440765eda4a7f. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:18.032487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b31f059-0a26-4d70-8f8f-1a7fc56606a8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149297 Oct 04 18:10:18.033078 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2942/3737] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:10:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:18.047008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4ea8f2-0f70-45c6-be5b-4408c0129dc8", "tag": "f8447528-4f32-4aae-b15d-b0f999ab1f53"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:18.067963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.071546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.073741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.097107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] Creating event network-changed:f8447528-4f32-4aae-b15d-b0f999ab1f53 for instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 on n-h2-831193-17 Oct 04 18:10:18.103325 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f27466e2-cd2c-434d-b217-ebd2da8886e6 req-d003ec20-21c4-425d-a889-26c18eb0223c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060353 Oct 04 18:10:18.104343 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2943/3738] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:18.110511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-884296059"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:18.114000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.129408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.129973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.130456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.131762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.131879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.132228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.245935 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce7ab673-6876-4359-b36c-f3299486ea63 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "PUT /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1060 microversion: 2.1 time: 0.140028 Oct 04 18:10:18.247806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2944/3739] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:10:18 2022] PUT /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1060 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.267862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: .version_select at 0x7f6340e3b310>, body: {"server_group": {"name": "tempest-server-group-1969716443", "policies": ["affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:18.291177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:18.298919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:18.370834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:18.385218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:18.418803 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3c9f309e-d0fb-4122-b6b2-8029bfbfc663 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.167972 Oct 04 18:10:18.420984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2945/3740] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 18:10:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:18.442980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.443908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.459925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.460427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.460871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.461809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.462512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.462995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.975670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.984066 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5115dffb-2796-447d-a0fc-f245e5559b83 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.561099 Oct 04 18:10:18.988233 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2946/3741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.999724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.999918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.009832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.010124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.010444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.011386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.012426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.012426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.482199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.502711 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d258e636-ac9b-4da2-9060-e2e53def6016 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1487 microversion: 2.1 time: 0.512795 Oct 04 18:10:19.512247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2947/3742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1487 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.531618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26a81ba0-2b00-4056-aca5-a9e0aa15b7d8 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.570644 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26a81ba0-2b00-4056-aca5-a9e0aa15b7d8 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/6d5f0110-07b7-4478-832b-fb6ef32723ce" status: 204 len: 0 microversion: 2.1 time: 0.056610 Oct 04 18:10:19.572260 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2948/3743] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:19 2022] DELETE /compute/v2.1/os-server-groups/6d5f0110-07b7-4478-832b-fb6ef32723ce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:19.579094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.581595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.602211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.605200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.606245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.607901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.608969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.610231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.717927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.729674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cefff4b0-979d-44bf-9d15-932187dd80ce tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1487 microversion: 2.1 time: 1.156073 Oct 04 18:10:20.733150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2949/3744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1487 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.746083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-799926f8-7447-40fa-ab8c-b39719e783c1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.788467 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-799926f8-7447-40fa-ab8c-b39719e783c1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.053773 Oct 04 18:10:20.789090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2950/3745] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:20.803559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.804558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.816466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:20.829852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.830697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.834302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.836425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.837420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.838038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.138978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.151999 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eeab7662-3f35-406d-b777-568f9dc7e002 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.360791 Oct 04 18:10:21.152634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2951/3746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:21.161603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1b1e92-270b-4f67-9bd6-e99bf6e6cf99", "tag": "95fb9a2b-3834-4204-b098-9640afe6eb69"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:21.183246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.183752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.184199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.210390 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] Creating event network-changed:95fb9a2b-3834-4204-b098-9640afe6eb69 for instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 on n-h2-831193-17 Oct 04 18:10:21.225417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a5cda475-4063-4049-b82d-499c76beacd3 req-d3dd7d22-2ff5-45d6-b1e0-494b76b317de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071520 Oct 04 18:10:21.226056 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2952/3747] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:21.242522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0c2eec-168a-4588-b81c-d051ba9b2603", "name": "network-vif-plugged", "status": "completed", "tag": "9e0a644a-b6df-4bac-8299-2688acb29708"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:21.261045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.261553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.267165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.289599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] Creating event network-vif-plugged:9e0a644a-b6df-4bac-8299-2688acb29708 for instance ba0c2eec-168a-4588-b81c-d051ba9b2603 on n-h1-831193-17 Oct 04 18:10:21.305874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-784974ce-399e-46cd-bc2b-19d1e0df4c6d req-46979132-5d3c-446f-865b-fee265f6a6a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078395 Oct 04 18:10:21.308413 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2953/3748] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:21.319295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.323007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.336639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.340153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.341020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.341997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.344303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.345052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.397955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:21.458763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:21.549262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46043b32-a75d-4997-93b8-c807863069e2 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 204 len: 0 microversion: 2.1 time: 0.239136 Oct 04 18:10:21.553494 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2954/3749] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:21 2022] DELETE /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:21.556029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: .version_select at 0x7f6340e720d0>, body: {"server_group": {"name": "tempest-server-group-341780149", "policies": ["anti-affinity"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:21.579728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:21.586289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:21.691761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:21.708229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_groups'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:21.763746 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-808c10ca-e44e-4df8-90a1-ff93d8d49d18 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.211029 Oct 04 18:10:21.771005 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2955/3750] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 18:10:21 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:21.800165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.801853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.836924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.837445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.837901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.838648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.839209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.839656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.121090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.135368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd5a6e1d-296a-4f02-afc0-06b200b4dfcc tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 200 len: 1493 microversion: 2.1 time: 0.366069 Oct 04 18:10:22.137946 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2956/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 1493 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.163588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-775c59e5-ae1b-4065-b467-671453adbd07 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.199268 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-775c59e5-ae1b-4065-b467-671453adbd07 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/cce72800-0631-4295-992a-e4731155b130" status: 204 len: 0 microversion: 2.1 time: 0.046627 Oct 04 18:10:22.201448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2957/3752] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:22 2022] DELETE /compute/v2.1/os-server-groups/cce72800-0631-4295-992a-e4731155b130 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:22.211022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.212229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.221444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.222388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.223082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.224346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.225017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.225652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.487739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.502469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d5d4395-bbb9-4b9f-a88f-81ca9586d304 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.299303 Oct 04 18:10:22.509658 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2958/3753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.536445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52459893-caaf-4dc6-a40e-96665e559468 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.560993 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52459893-caaf-4dc6-a40e-96665e559468 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.050054 Oct 04 18:10:22.563867 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2959/3754] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:22.696968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1119200936", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95b8ba85-9d95-443e-b965-d9baf72e946b"}], "security_groups": [{"name": "tempest-securitygroup--2032136580"}], "key_name": "tempest-keypair-1523140279", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:23.333363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] validate_networks() for [('95b8ba85-9d95-443e-b965-d9baf72e946b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:24.995864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:24.996455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:24.996875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:24.997377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:24.998045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:25.021513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.022588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.024690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.026258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.028192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.030249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.087983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:25.106757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Getting quotas for user 1e4ef2f4be1046a2869572360d9aa168 and project 1b3067da6039458f917440765eda4a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:25.153388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:25.160019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:25.309439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8faf5a92-1553-4e93-b137-88717f6c8822 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.614851 Oct 04 18:10:25.313566 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2960/3755] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:10:25.325338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-880080855", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "5f3bfa6e-c023-4c22-9ad1-b3d2764181b0"}]}, "os:scheduler_hints": {"group": "d15cf128-19e1-4141-92a8-0351d68c9827"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:25.441754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] validate_networks() for [('5f3bfa6e-c023-4c22-9ad1-b3d2764181b0', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:26.416319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:26.417455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:26.424475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:26.426644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:26.427611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:26.461602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=57 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:26.464507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.471346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.472863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.474223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.475208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.484583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.526437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:26.538518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:26.564876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:26.568309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:26.635544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:26.645443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:26.656475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:26.745173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:26.758809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Getting quotas for user 5e3e7dc6c1dd4e7a8ee47c4ac279797a and project 3b66d173edab423f8751dd80bf70d168. Resources: {'server_group_members'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:26.852783 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a69db739-3ae4-46b9-ac10-15a2754e51e5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535738 Oct 04 18:10:26.856982 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2961/3756] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:26.868283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.868992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.882710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.886047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.886711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.887574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.892263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.892901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.929106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff HTTP/1.1 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c185e377-e1cd-42f2-bf63-e85fa6d733ff'} Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.930827 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c66994d7-a284-4fa4-aa0a-f6e9ec14c214 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 404 len: 111 microversion: 2.1 time: 0.074830 Oct 04 18:10:26.936328 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2962/3757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:26.948176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.948810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.959204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.963509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.963987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.966756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.967913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.968585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.307255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.336357 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9896e192-614d-43e1-af89-8317e16923d9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.396328 Oct 04 18:10:27.341700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2963/3758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.352746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.356449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.384528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.386747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.387373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.390289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.394030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.406156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.511065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.520693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-132ba75c-a973-4df7-9c55-c00b4794a77b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1298 microversion: 2.1 time: 0.177501 Oct 04 18:10:27.524309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2964/3759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.536972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c185e377-e1cd-42f2-bf63-e85fa6d733ff", "name": "network-vif-deleted", "tag": "0f0673c9-2eae-442e-b42b-4e2b1631b587"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:27.564432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.566244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.566942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.599586 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] Creating event network-vif-deleted:0f0673c9-2eae-442e-b42b-4e2b1631b587 for instance c185e377-e1cd-42f2-bf63-e85fa6d733ff on n-h2-831193-17 Oct 04 18:10:27.606735 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eca0e2a7-3abb-43f5-9f28-d2f4827c95b3 req-546b4596-64cf-43be-8220-b9da3a19cac0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078244 Oct 04 18:10:27.608038 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2965/3760] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.615908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4ea8f2-0f70-45c6-be5b-4408c0129dc8", "name": "network-vif-plugged", "status": "completed", "tag": "f8447528-4f32-4aae-b15d-b0f999ab1f53"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:27.630505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.631216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.631814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.647300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] Creating event network-vif-plugged:f8447528-4f32-4aae-b15d-b0f999ab1f53 for instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 on n-h2-831193-17 Oct 04 18:10:27.655853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-38cd161d-e6fd-411b-83c2-785c6b091da8 req-e3ad8a3b-8672-4703-a5b5-835f025f0955 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044460 Oct 04 18:10:27.656963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2966/3761] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.668904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74a143af-a34b-4567-a9c6-9e19aeb8bd7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.670347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74a143af-a34b-4567-a9c6-9e19aeb8bd7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.096533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74a143af-a34b-4567-a9c6-9e19aeb8bd7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.107845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74a143af-a34b-4567-a9c6-9e19aeb8bd7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1212 microversion: 2.1 time: 0.449311 Oct 04 18:10:28.108455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2967/3762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1212 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:28.122747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.123256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.137125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.137980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.138758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.139960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.140469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.140903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.175239 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff HTTP/1.1 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c185e377-e1cd-42f2-bf63-e85fa6d733ff'} Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:28.183582 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:28.189436 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e78d4535-7dad-410f-bb2e-1d65218c8086 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 404 len: 111 microversion: 2.1 time: 0.074839 Oct 04 18:10:28.191903 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2968/3763] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:28 2022] DELETE /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:28.199427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.200185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c185e377-e1cd-42f2-bf63-e85fa6d733ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.212847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.213423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.213937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.215074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.215637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.216073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.257288 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff HTTP/1.1 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c185e377-e1cd-42f2-bf63-e85fa6d733ff'} Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.265200 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c185e377-e1cd-42f2-bf63-e85fa6d733ff could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74ec19ad-288d-4132-955e-7a6918f55867 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff" status: 404 len: 111 microversion: 2.1 time: 0.074718 Oct 04 18:10:28.270117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2969/3764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/c185e377-e1cd-42f2-bf63-e85fa6d733ff => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:28.288842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.295871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.321265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.321700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.322154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.322903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.331698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.332199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.381085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 HTTP/1.1 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1'} Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:28.399728 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.404386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:28.406281 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b6d45a2-cdce-4b2e-978b-415045e58946 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 404 len: 111 microversion: 2.1 time: 0.127682 Oct 04 18:10:28.410213 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2970/3765] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:28 2022] DELETE /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:10:28.416305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.417014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.423700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.425308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.426109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.427011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.427583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.428118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.736021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.748396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b37829e2-1589-4503-a5ad-3f39ef6c157b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1323 microversion: 2.1 time: 0.336904 Oct 04 18:10:28.749238 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2971/3766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:28.773630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.774759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.782173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.782986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.783708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.785860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.786581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.787264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.804142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 HTTP/1.1 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1'} Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.807073 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. Oct 04 18:10:28.811423 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.813318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:28.814448 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e813153f-8e3f-4eac-8095-fb24c399366c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1" status: 404 len: 111 microversion: 2.1 time: 0.047324 Oct 04 18:10:28.819958 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2972/3767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/6a7d91f2-cb8c-4968-8958-57e4b0b6f8a1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:28.826756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.827684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.838669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.839520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.840169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.841130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.841806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.842431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.477279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.495194 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9f262c1-e145-49cf-bc30-c6a6afcd7d41 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.673588 Oct 04 18:10:29.498094 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2973/3768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.512192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.512852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.525245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.531474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.531938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.532706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.533177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.533664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.575146 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 HTTP/1.1 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '032a2e4e-99ee-46e1-8019-789c25382152'} Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:29.577549 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.584480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.587916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:29.589168 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ac38ec2-fe8c-4765-9c31-2c8f8dcc98a1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 404 len: 111 microversion: 2.1 time: 0.087849 Oct 04 18:10:29.590295 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2974/3769] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:29 2022] DELETE /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:29.595889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.596975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.604583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.605391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.606099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.607143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.607863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.608528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.861854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.870166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db4b625c-3496-4795-9a51-35e1d451942e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1270 microversion: 2.1 time: 0.278136 Oct 04 18:10:29.880122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2975/3770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.885222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.886064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 032a2e4e-99ee-46e1-8019-789c25382152] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.905169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.905852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.906462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.907477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.908099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.908731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.944067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 HTTP/1.1 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '032a2e4e-99ee-46e1-8019-789c25382152'} Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.945568 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. Oct 04 18:10:29.949326 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.951251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 032a2e4e-99ee-46e1-8019-789c25382152 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:29.952212 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-36841601-5817-4722-8ea7-52ea255ede52 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152" status: 404 len: 111 microversion: 2.1 time: 0.070826 Oct 04 18:10:29.952799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2976/3771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/032a2e4e-99ee-46e1-8019-789c25382152 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:29.965773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1b1e92-270b-4f67-9bd6-e99bf6e6cf99", "name": "network-vif-plugged", "status": "completed", "tag": "95fb9a2b-3834-4204-b098-9640afe6eb69"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:29.984134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.984430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.984885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.012211 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] Creating event network-vif-plugged:95fb9a2b-3834-4204-b098-9640afe6eb69 for instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 on n-h2-831193-17 Oct 04 18:10:30.036567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-b7d04311-ca84-4262-b1c2-fd856c07b7aa req-52949528-1568-4388-8d5b-6f4bf54c06d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080247 Oct 04 18:10:30.039412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2977/3772] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:30.047763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.048510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.063402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.066308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.066872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.067669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.068141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.068578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.890807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.900096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10f0e0e2-dfa0-4892-b9b9-ee49f559e759 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1515 microversion: 2.1 time: 0.857126 Oct 04 18:10:30.906753 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2978/3773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1515 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:30.936086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.936826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.945857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.949146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.949610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.950359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.950828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.952261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.985375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 HTTP/1.1 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a9bb5e54-92fa-429b-9b85-a5a4b65f9d69'} Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:30.987538 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:30.993562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:30.996086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:30.997872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a2862e1-2413-4291-a21f-3984e689b6a8 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 404 len: 111 microversion: 2.1 time: 0.088458 Oct 04 18:10:30.998496 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2979/3774] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:30 2022] DELETE /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:31.012018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:31.044485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.046478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.046930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.077341 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] Creating event network-changed:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:10:31.089012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fd5612df-5526-4e62-805f-c505addd7aff req-d85ebaf0-3acd-422c-9da9-e19171497c88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089239 Oct 04 18:10:31.089637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2980/3775] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:31.105859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.106592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.115730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.116645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.118422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.119335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.120553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.121064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.541324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.551154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6f4797d-742c-4926-8c7d-ff307c5162d1 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.459979 Oct 04 18:10:31.551747 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2981/3776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.556624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.557512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.565830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.567389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.568070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.569856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.570483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.570862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.170714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.182444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9143b72-5ac2-4cd0-83a0-024ac4aa8b56 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.629350 Oct 04 18:10:32.185784 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2982/3777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.197164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.197800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.217375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.217892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.218344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.219085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.219558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.219998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.565737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG neutronclient.v2_0.client [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=128771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:10:32.566706 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.549124 Oct 04 18:10:32.586382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.591981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:32.604399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb25062d-7a2c-4742-8fbe-1595c230b01d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603" status: 200 len: 1516 microversion: 2.1 time: 0.416837 Oct 04 18:10:32.605403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2983/3778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.628245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-c020844d-d04c-43df-9b16-5c7d8eee6a46'] Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return req.get_response(self.application) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack self.force_reraise() Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack raise self.value Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return request.get_response(self.application) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 18:10:32.628375 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self._create_instance( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2548, in _ports_needed_per_instance Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack nets = self._get_available_networks( Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 454, in _get_available_networks Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack nets = neutron.list_networks(**search_opts).get('networks', []) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.631761 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] http://10.222.0.33/compute/v2.1/servers returned with HTTP 401 Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:10:32 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.33) Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: CRITICAL nova [None req-e0993665-b298-46fc-8a26-345f31f97d74 tempest-LiveMigrationTest-1686988312 tempest-LiveMigrationTest-1686988312-project] Unhandled error: OSError: write error Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova OSError: write error Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova Oct 04 18:10:32.635517 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 796/3779] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:32 2022] POST /compute/v2.1/servers => generated 0 bytes in 900615 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 04 18:10:32.641818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.642250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: a9bb5e54-92fa-429b-9b85-a5a4b65f9d69] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.645971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.656371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.657004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.657556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.659731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.661369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.662027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.662306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.662835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.663912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.664663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.665129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.668483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.703286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 HTTP/1.1 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a9bb5e54-92fa-429b-9b85-a5a4b65f9d69'} Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:32.706501 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8a36e11-b263-4306-9f66-2544f949da9b tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69" status: 404 len: 111 microversion: 2.1 time: 0.090893 Oct 04 18:10:32.711673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2984/3780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/a9bb5e54-92fa-429b-9b85-a5a4b65f9d69 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:32.715901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.717271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.727725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.728581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.729494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.730747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.731249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.731692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.961492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.979067 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e7dfa19c-f585-485b-a7b8-f1e6ef0a9516 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.345767 Oct 04 18:10:32.980618 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 797/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.988106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.988996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.996163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.997163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.997886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.999093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.999805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.000455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.017485 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 HTTP/1.1 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6c068d3b-1bd6-435a-96f9-11685a80e750'} Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.020314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.024664 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.026964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.028255 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-931af044-499b-4d34-8bce-c382c31e0952 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 404 len: 111 microversion: 2.1 time: 0.046433 Oct 04 18:10:33.029518 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 798/3782] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:32 2022] DELETE /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:33.039192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.040153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: 6c068d3b-1bd6-435a-96f9-11685a80e750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.047516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.048279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.048910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.050340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.050973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.051601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.068612 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 HTTP/1.1 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6c068d3b-1bd6-435a-96f9-11685a80e750'} Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.071009 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance 6c068d3b-1bd6-435a-96f9-11685a80e750 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.075114 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fa336db2-6aae-4775-8b0e-4e1092ff880c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750" status: 404 len: 111 microversion: 2.1 time: 0.039525 Oct 04 18:10:33.078303 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 799/3783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/6c068d3b-1bd6-435a-96f9-11685a80e750 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:10:33.083934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.084518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.091335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.091839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.092391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.093129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.093594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.094032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.110724 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 HTTP/1.1 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7'} Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.112859 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.117151 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30e0f4c4-af3c-47dd-b2b3-c98ddf800627 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 404 len: 111 microversion: 2.1 time: 0.034681 Oct 04 18:10:33.118742 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 800/3784] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:33 2022] DELETE /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:33.124480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.125104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.132667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.133321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.133765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.134471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.134921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.135395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.151526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 HTTP/1.1 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7'} Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.153089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cfc7ed90-e0f9-4b3c-8daa-92e73138a8b1 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7" status: 404 len: 111 microversion: 2.1 time: 0.034203 Oct 04 18:10:33.160427 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 801/3785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/c42dfbb2-e18e-420c-8a1b-c9f9c5d5abc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:33.165724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.166240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.173694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.174431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.174890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.175661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.176138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.176592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.193295 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 HTTP/1.1 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e4e82252-df33-4334-a638-164e0f8cb151'} Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.194944 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.199424 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-810802bc-4658-432b-b29a-e260f62f0409 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151" status: 404 len: 111 microversion: 2.1 time: 0.036059 Oct 04 18:10:33.201205 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 802/3786] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:33 2022] DELETE /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:33.205381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.206517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: e4e82252-df33-4334-a638-164e0f8cb151] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.213060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.213487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.213933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.214654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.215154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.215589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.233064 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 HTTP/1.1 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e4e82252-df33-4334-a638-164e0f8cb151'} Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:33.234803 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance e4e82252-df33-4334-a638-164e0f8cb151 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff74a0fc-eb3a-45f0-b391-2f9e1e53709d tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151" status: 404 len: 111 microversion: 2.1 time: 0.034729 Oct 04 18:10:33.239977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 803/3787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/e4e82252-df33-4334-a638-164e0f8cb151 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:33.244631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.245255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.251454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.251953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.252431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.253141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.253605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.254042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.501917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.515280 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef27159c-8fc2-40a9-94b3-7286ec5381f0 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 200 len: 1515 microversion: 2.1 time: 0.805244 Oct 04 18:10:33.516255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2985/3788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 1515 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.521853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.522847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.529234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.530282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.531368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.532499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.533190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.533895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.580601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:33.641525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.656210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-519a410d-b82a-4008-b5b6-451b68ad1fec tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.415269 Oct 04 18:10:33.657787 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 804/3789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.663700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.664447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.692855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-295feaa8-45c2-4025-a04e-a182dc9e1791 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 204 len: 0 microversion: 2.1 time: 0.174994 Oct 04 18:10:33.693838 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2986/3790] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:33 2022] DELETE /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:33.699315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.701136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.701865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.702866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.703515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.703971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.704308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.704860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.712415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.713203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.713851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.715587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.716297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.716964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.753623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:33.907239 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9218b1d7-a5a5-44a8-bf3f-b8aa1c13791a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 204 len: 0 microversion: 2.1 time: 0.247747 Oct 04 18:10:33.919277 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 805/3791] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:33 2022] DELETE /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:33.925318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.926475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.933427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.934129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.934930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.935682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.936141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.936574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.092368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.105738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0917e9ea-b798-4cf2-9d4f-14b17b5c041a tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1480 microversion: 2.1 time: 0.406832 Oct 04 18:10:34.107164 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2987/3792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1480 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:34.113668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.114641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.121737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.122778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.123422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.124741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.125369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.125984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.283932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.294068 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d49bf696-f63d-4857-9dfe-24cecd56ad23 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1521 microversion: 2.1 time: 0.372584 Oct 04 18:10:34.295263 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 806/3793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.414755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.425581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42fab344-e814-4dfb-8417-eac4c2b136ea tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.317146 Oct 04 18:10:34.429412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2988/3794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.452262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57a4eb2-8b2d-4627-b735-c435abfcc212", "tag": "2c1f4747-a343-48b8-8c61-9a612c5be970"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:34.472219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.472715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.473156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.492254 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] Creating event network-changed:2c1f4747-a343-48b8-8c61-9a612c5be970 for instance e57a4eb2-8b2d-4627-b735-c435abfcc212 on n-h1-831193-17 Oct 04 18:10:34.500571 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b66bc764-01d4-4818-88d2-3a81ec75680c req-04e3c308-6a13-4a33-9348-81edd0f92d65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051006 Oct 04 18:10:34.501435 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 807/3795] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:34.680721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.681877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.688423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.689135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.689726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.691195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.691806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.692384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.937976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.949111 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5baa5fb1-e91e-4844-8b0b-84e5aca81c37 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.272067 Oct 04 18:10:34.951535 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2989/3796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.136108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.137594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.145065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.145800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.146399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.147303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.148132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.148720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.328557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.329928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.342452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.348191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.348191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.349150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.349774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.359815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.726879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.741062 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6508a223-69d4-4a73-a96c-7a1db1acb14c tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1480 microversion: 2.1 time: 0.606604 Oct 04 18:10:35.742936 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 808/3797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1480 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.748209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.748824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.757712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.758444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.759070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.760150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.760988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.761884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.118794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.129314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65f15db0-8486-4ce3-88f7-c93b20bd478d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1521 microversion: 2.1 time: 0.814382 Oct 04 18:10:36.133864 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2990/3798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1521 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:36.148944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.152747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.167655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.169792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.170390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.178704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.180032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.180755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.513449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:36.589567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.606591 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9d5c987-a0b5-4187-aac4-89e73351220e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.469548 Oct 04 18:10:36.620180 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2991/3799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:36.620504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.621067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d382fedf-935d-4cd7-9428-1c74b26f4dfb", "name": "network-vif-deleted", "tag": "7b06551f-2737-436e-bf47-72c3b2049c5f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:36.632342 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2e6cf237-31a9-4dfe-9b6a-0e4f6630d1ef tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.887941 Oct 04 18:10:36.633515 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 809/3800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:36.652621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.655626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.656398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.683926 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] Creating event network-vif-deleted:7b06551f-2737-436e-bf47-72c3b2049c5f for instance d382fedf-935d-4cd7-9428-1c74b26f4dfb on n-h1-831193-17 Oct 04 18:10:36.702008 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f4ca316d-cab3-464d-a5eb-3e5d02880c0d req-bcfd338a-e5bc-462e-a450-b51de5077af0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090924 Oct 04 18:10:36.702899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2992/3801] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:36.771924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.772739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.786874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.787711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.788263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.789026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.789486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.790271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.902069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.902575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.903105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.904192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lazy-loading 'fault' on Instance uuid d382fedf-935d-4cd7-9428-1c74b26f4dfb {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:37.131106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a8e43811740448e83e0e8e5dd97de8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91810ef24e0c4ac0ba38bfb80c62a4e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.160431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.163928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.164461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d7c371c5-050b-40d3-8c5a-d7847e3ce76f tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 200 len: 1283 microversion: 2.1 time: 0.396341 Oct 04 18:10:37.170634 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 810/3802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 1283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.186982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.187997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.189532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.194668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.195537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.198888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.563339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.593288 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbae0d20-8f57-40a0-99f5-3c2dd3dac85c tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1521 microversion: 2.1 time: 0.440908 Oct 04 18:10:37.596669 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2993/3803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.632726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.633935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.645565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.646050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.646675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.647618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.648235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.649027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.659650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.660707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.678947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.679819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.683686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.686755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.690549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.697941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.034480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.047691 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de215436-468d-4c63-b747-14a94dbd3817 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.418740 Oct 04 18:10:38.048689 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 811/3804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:38.063500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4ea8f2-0f70-45c6-be5b-4408c0129dc8", "name": "network-vif-deleted", "tag": "f8447528-4f32-4aae-b15d-b0f999ab1f53"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:38.085448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.086392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.087143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.103963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:38.114536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.142653 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] Creating event network-vif-deleted:f8447528-4f32-4aae-b15d-b0f999ab1f53 for instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 on n-h2-831193-17 Oct 04 18:10:38.143722 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d748eda3-73ab-40f4-b535-87d3a30734cc tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.473974 Oct 04 18:10:38.163437 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2994/3805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:38.174844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2c1ed93c-feba-408d-bc40-cdd90770606f req-1015cbd5-0ca0-4f0c-a421-a8152264ca1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121195 Oct 04 18:10:38.179268 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 812/3806] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:38.188865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.189863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] [instance: d382fedf-935d-4cd7-9428-1c74b26f4dfb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.197667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.198543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.200123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.201402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.202122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.202797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.246362 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] HTTP exception thrown: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Request method failure captured: Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb HTTP/1.1 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHYdZ9_EYor49JVn9NS6vkh6GBbPBSn3vdrHB7BEQchp17eHsQSB2vk0fUTPt7kpQSozYHLy3_oalAqs3eOg8-H6lRR2pfNMRNH1Y_OReOgQKQHqmPeI3q5U9zx5pYnml_e0EjYY_At83jaZkRqdo1UYMXB9t9ri4I-FR4sHA8GndJA Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91810ef24e0c4ac0ba38bfb80c62a4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersTestJSON-1589492180 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91810ef24e0c4ac0ba38bfb80c62a4e6 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersTestJSON-1589492180 Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a8e43811740448e83e0e8e5dd97de8c Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersTestJSON-1589492180-project Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'd382fedf-935d-4cd7-9428-1c74b26f4dfb'} Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:38.248664 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. Oct 04 18:10:38.252508 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:38.255220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] Returning 404 to user: Instance d382fedf-935d-4cd7-9428-1c74b26f4dfb could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:38.256426 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd15cec0-78e9-4daf-98f4-984ad864a831 tempest-ServersTestJSON-1589492180 tempest-ServersTestJSON-1589492180-project] 10.222.0.33 "GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb" status: 404 len: 111 microversion: 2.1 time: 0.072199 Oct 04 18:10:38.258820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2995/3807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/d382fedf-935d-4cd7-9428-1c74b26f4dfb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:38.556619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "name": "network-vif-plugged", "status": "completed", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:38.615724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.618381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.619017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.625180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.626612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.661495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.662410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.667746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.672042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.672854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.673954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.679185 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] Creating event network-vif-plugged:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:10:38.708269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4498b0c4-91e3-4de6-89e8-14e1ed95ecc8 req-d28c1d19-b218-454b-8e33-ae9fbc304f6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156071 Oct 04 18:10:38.709571 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 813/3808] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:38.816728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.817246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.817704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.818362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lazy-loading 'fault' on Instance uuid 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:38.889756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.901829 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4deb334-c50f-4daf-8036-ace058aaff5b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 200 len: 1313 microversion: 2.1 time: 0.285242 Oct 04 18:10:38.903286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2996/3809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:39.079486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.080225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.095903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.099335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.099987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.100950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.102736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.105144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.176156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.176702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.188974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.189533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.190085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.191606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.192100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.192521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.767744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.795498 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-64631812-ad70-4a73-ac9a-7f987e4fedcf tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.721454 Oct 04 18:10:39.812908 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 814/3810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:39.844015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.860135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f54fbf63-3651-48b2-b6a6-848ba15e43fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1372 microversion: 2.1 time: 0.689037 Oct 04 18:10:39.869512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2997/3811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1372 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:39.929836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.930990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.942571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.947093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.947787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.948979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.949607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.952701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.998705 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] HTTP exception thrown: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 HTTP/1.1 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5d4ea8f2-0f70-45c6-be5b-4408c0129dc8'} Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.000689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:40.005709 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.011995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 404 to user: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:40.013063 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5d9e7573-5556-45b2-853c-33b7d6250daa tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 404 len: 111 microversion: 2.1 time: 0.087585 Oct 04 18:10:40.014027 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 815/3812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:40.023140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.031345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.032330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.046834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.050513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.050975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.051789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.052260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.052689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.217089 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9f70879-6161-465d-abfe-02c16731539b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.196830 Oct 04 18:10:40.227971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2998/3813] 10.222.0.33 () {58 vars in 1230 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:40.238799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e13e99bd-0388-4595-a373-836355f02269 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e13e99bd-0388-4595-a373-836355f02269 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:40.248842 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e13e99bd-0388-4595-a373-836355f02269 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e13e99bd-0388-4595-a373-836355f02269 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.022130 Oct 04 18:10:40.253326 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 816/3814] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:40.261984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.269040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.269753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.279584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.280335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.281000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.281977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.282606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.283230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.321455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:40.355332 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-238a5d68-9ea4-4333-83a3-a51be33415fd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.097266 Oct 04 18:10:40.363198 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 2999/3815] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers => generated 683 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:40.370531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.377297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.378100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.compute.servers [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Removing options 'limit' from query {{(pid=128771) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:10:40.379109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.387380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.388665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.390237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.391086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.391583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.392026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.420523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:40.459922 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5f6f6a13-3e8a-4de8-ab06-542530bd01a9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.094100 Oct 04 18:10:40.469974 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 817/3816] 10.222.0.33 () {58 vars in 1144 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:40.482530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb5e8318-ffc5-482c-9cb7-17369010376b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb5e8318-ffc5-482c-9cb7-17369010376b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: action_args: {} Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '-1' Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:40.487791 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:40.494024 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.496839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb5e8318-ffc5-482c-9cb7-17369010376b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:40.498649 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb5e8318-ffc5-482c-9cb7-17369010376b tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024248 Oct 04 18:10:40.511557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7779228-5c23-4cd1-8d40-68f9181702cd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7779228-5c23-4cd1-8d40-68f9181702cd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: action_args: {} Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:40.517055 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:40.522349 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:40.524806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3000/3817] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:40.525908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7779228-5c23-4cd1-8d40-68f9181702cd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:40.526989 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c7779228-5c23-4cd1-8d40-68f9181702cd tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020249 Oct 04 18:10:40.537439 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 818/3818] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:40.546061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-631c22ab-7e6d-4224-bd97-ae246bafe37f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.559099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-631c22ab-7e6d-4224-bd97-ae246bafe37f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.559832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-631c22ab-7e6d-4224-bd97-ae246bafe37f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.567987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.servers [None req-631c22ab-7e6d-4224-bd97-ae246bafe37f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Flavor 'non_existing_flavor' could not be found {{(pid=128770) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 18:10:40.569014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-631c22ab-7e6d-4224-bd97-ae246bafe37f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.035583 Oct 04 18:10:40.578242 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3001/3819] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:10:40.584034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.591514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.593323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.602988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.604088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.604816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.606840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.608125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.609037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.741926 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d2e0fca-c1f3-4afe-acc3-0bd55e7f899d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.162980 Oct 04 18:10:40.748290 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 819/3820] 10.222.0.33 () {58 vars in 1174 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:40.760411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:40.770100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.782034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.782731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:40.801129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.801640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.802553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.803703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.810254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.813612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.831644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.835694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:40.857235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.857767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.860997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.863338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.865319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.865782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.953137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:41.056179 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba80371a-126e-407c-b538-de120a57ba2d tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.294794 Oct 04 18:10:41.057233 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3002/3821] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:41.068005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.069034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.076461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.077309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.077976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.079740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.082822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.083520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.123381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:41.531955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.541278 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b779c5d1-4fb8-430d-8da9-d2154980aa8a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1566 microversion: 2.1 time: 0.479708 Oct 04 18:10:41.559921 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3003/3822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1566 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.572096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.575267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.579975 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1ea07603-809f-4747-9284-cdc3a0d327a4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.756037 Oct 04 18:10:41.580595 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 820/3823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.589092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.590009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.611635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.614000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.615251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.615926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.616449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:41.618937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.619784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.620573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.623305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.624139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.624819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.625800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.626487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.627698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.674837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:41.771636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.788423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.790814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.791356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.890146 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f9916626-af28-4b6f-ab54-a094cbd41b1d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300556 Oct 04 18:10:41.891154 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 821/3824] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:42.149847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce59c447-0033-434a-9f13-73da86f1e047 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.588392 Oct 04 18:10:42.168306 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3004/3825] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:42.178229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fc254cb2-c13d-4e38-8d71-cfe0f0933adb tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.194202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fc254cb2-c13d-4e38-8d71-cfe0f0933adb tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.195384 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fc254cb2-c13d-4e38-8d71-cfe0f0933adb tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021913 Oct 04 18:10:42.195941 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 822/3826] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:42.209123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.213976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.214655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Searching by: {'deleted': False, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:42.225499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.226003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.226448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.227683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.227683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.228086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.296038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.multi_cell_list [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128770) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:42.332824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8117af67-698a-4b90-9e27-4a03b3f8ba9f tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.128341 Oct 04 18:10:42.333444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3005/3827] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers => generated 683 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:42.346812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.347747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.354348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.355185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.355857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.356850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.357523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.358169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.388997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:42.569627 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd489732-c0f8-4da9-a5a3-bb9c2470bcf9 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 204 len: 0 microversion: 2.1 time: 0.226299 Oct 04 18:10:42.579309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.581725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.587112 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 823/3828] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:42 2022] DELETE /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:42.589258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.589975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.590639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.591940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.592595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.593214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.606951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.608468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.620029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.620846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.623151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.624142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.627822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.628568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.666736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:42.851951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aaa9f574-1faf-48e9-8f96-51a6d9c26f2a tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603" status: 204 len: 0 microversion: 2.1 time: 0.235085 Oct 04 18:10:42.854982 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3006/3829] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:42 2022] DELETE /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:42.868209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.869729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.889228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.891273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.891982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.893727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.894917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.895829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.914618 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] HTTP exception thrown: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 HTTP/1.1 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '5d4ea8f2-0f70-45c6-be5b-4408c0129dc8'} Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:42.917078 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:42.920731 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:42.924614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 404 to user: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:42.925874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac5de2c7-4484-4bad-828f-24f5c54f3af5 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 404 len: 111 microversion: 2.1 time: 0.063479 Oct 04 18:10:42.926832 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3007/3830] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:42 2022] DELETE /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:42.935253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.936419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.943282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.947516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.952179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.956228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.959469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7aee20c3-51f2-4f0a-829c-62d19a9262f4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.357114 Oct 04 18:10:42.960728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.962269 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 824/3831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:42.962840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.963564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.201913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:43.219568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99b43306-9e60-4957-a9ab-fc24f1e78ca6 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 200 len: 1521 microversion: 2.1 time: 0.288368 Oct 04 18:10:43.220236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3008/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:43.316757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57a4eb2-8b2d-4627-b735-c435abfcc212", "name": "network-vif-plugged", "status": "completed", "tag": "2c1f4747-a343-48b8-8c61-9a612c5be970"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:43.327870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.328623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.329252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.343984 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] Creating event network-vif-plugged:2c1f4747-a343-48b8-8c61-9a612c5be970 for instance e57a4eb2-8b2d-4627-b735-c435abfcc212 on n-h1-831193-17 Oct 04 18:10:43.349640 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ba137dde-16e3-49e5-bffb-5800707e47e9 req-82aafa58-60f0-4c49-821d-fe87d5018eb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037116 Oct 04 18:10:43.350168 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 825/3833] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:44.000579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:44.001815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:44.009356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.010115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.010716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.011614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.012229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.012814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.245071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:44.246024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:44.255742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.260536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.261113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.261958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.263561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.264098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.466469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:44.475822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-199e0bb4-1241-41e7-8ecc-87514f6fa46e tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1312 microversion: 2.1 time: 0.478982 Oct 04 18:10:44.484688 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3009/3834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:43 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1312 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:44.728091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:44.741905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f3cdba65-184a-48dd-a87f-3a375bcd95d1 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 200 len: 1521 microversion: 2.1 time: 0.501045 Oct 04 18:10:44.774641 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 826/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:44 2022] GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:45.144319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1b1e92-270b-4f67-9bd6-e99bf6e6cf99", "name": "network-vif-deleted", "tag": "95fb9a2b-3834-4204-b098-9640afe6eb69"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:45.180521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.181101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.182732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.232276 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] Creating event network-vif-deleted:95fb9a2b-3834-4204-b098-9640afe6eb69 for instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 on n-h2-831193-17 Oct 04 18:10:45.245203 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-90634b5f-c9bf-4e00-861e-f65a6b43f58e req-a263c405-1a43-411d-8476-1aa5faf4df2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107820 Oct 04 18:10:45.249211 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3010/3836] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:45.516481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:45.517642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:45.554778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.558592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.573344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.574759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.575637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.586284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.787716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:45.790815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:45.849543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.864913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.866036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.866863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.870635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.871897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.951471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.955677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.956841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.959317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lazy-loading 'fault' on Instance uuid df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:46.091478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.102714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01e01a0e-64e6-4d5e-885b-8e665af607c3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 200 len: 1313 microversion: 2.1 time: 0.326294 Oct 04 18:10:46.104406 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3011/3837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:45 2022] GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:46.280105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.291442 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e29e4329-0519-432a-b01f-ba0d065bc7b0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1497 microversion: 2.1 time: 0.782357 Oct 04 18:10:46.295664 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 827/3838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:45 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1497 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:46.323886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.359131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_groups [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Querying cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) for 1 instances {{(pid=128770) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:10:46.361577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.365510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.366248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.410385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55f772c9-add8-4c58-addb-d90ae6b6599f tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827" status: 200 len: 220 microversion: 2.1 time: 0.091300 Oct 04 18:10:46.412547 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3012/3839] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827 => generated 220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:46.423569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.424667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.438795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.439318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.439993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.440882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.441490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.442073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.499064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:46.672769 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fa79a6ff-f3b7-428d-99a8-0b32482767e1 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 204 len: 0 microversion: 2.1 time: 0.252686 Oct 04 18:10:46.676813 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 828/3840] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:46 2022] DELETE /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:46.695489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.696409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.720330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.725699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.727932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.728981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.729660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.733058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.943431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:46.986377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.988877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.002905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.035513 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] Creating event network-changed:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:10:47.044103 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f025ca9c-6f1a-4266-9e08-6123d3bdcf2d req-2bf0de69-df85-4acc-b228-766ec3d67c34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129361 Oct 04 18:10:47.049688 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 829/3841] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:47.134006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.134972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: df1b1e92-270b-4f67-9bd6-e99bf6e6cf99] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.153504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.154199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.154806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.157509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.168512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.169502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.239902 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] HTTP exception thrown: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 HTTP/1.1 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'df1b1e92-270b-4f67-9bd6-e99bf6e6cf99'} Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:47.243276 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. Oct 04 18:10:47.247467 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:47.249542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 404 to user: Instance df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:47.251473 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9979f545-dc2c-430b-a4a4-07edae5a03b3 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99" status: 404 len: 111 microversion: 2.1 time: 0.127357 Oct 04 18:10:47.258041 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 830/3842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/df1b1e92-270b-4f67-9bd6-e99bf6e6cf99 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:47.264212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.265268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.275734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.276258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.276682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.277595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.278219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.279801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.448420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.473168 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-73c82619-5266-4810-86fc-ef5456639a41 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603" status: 200 len: 1480 microversion: 2.1 time: 0.213109 Oct 04 18:10:47.489826 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 831/3843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 => generated 1480 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:47.492206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.515756 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d71eac2-9cb5-4ea5-8d90-29bbb50e89b4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1503 microversion: 2.1 time: 0.833592 Oct 04 18:10:47.519722 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3013/3844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1503 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:48.497265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:48.500988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:48.528275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.530293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.533284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.534573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.536124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.539664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.565899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:48.573974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:48.630665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.638835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.639789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.640458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lazy-loading 'fault' on Instance uuid ba0c2eec-168a-4588-b81c-d051ba9b2603 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:48.644690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.645259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.645715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.646558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.647015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.658298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.190209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3488825130c74fffaa70d6c658dee49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdbb6a8048440b84d8af1a0b7ea8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.204383 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-337d86d5-7a17-4541-a508-cfbfa1d3e326 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603" status: 200 len: 1313 microversion: 2.1 time: 0.710750 Oct 04 18:10:49.205272 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 832/3845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:48 2022] GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:49.212228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0c2eec-168a-4588-b81c-d051ba9b2603", "name": "network-vif-deleted", "tag": "9e0a644a-b6df-4bac-8299-2688acb29708"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:49.248762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.254736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.256405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.293153 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] Creating event network-vif-deleted:9e0a644a-b6df-4bac-8299-2688acb29708 for instance ba0c2eec-168a-4588-b81c-d051ba9b2603 on n-h1-831193-17 Oct 04 18:10:49.304423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4bc32a8f-fe43-4ba4-97fc-b187c471530c req-602a452a-6f94-47a2-9a08-b099acfbaec9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096381 Oct 04 18:10:49.305587 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 833/3846] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:49.349416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.363160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-577df4ff-3dab-4af9-85ad-917a681b0dff tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1503 microversion: 2.1 time: 0.821995 Oct 04 18:10:49.370273 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3014/3847] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:48 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1503 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:49.717836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57a4eb2-8b2d-4627-b735-c435abfcc212", "name": "network-vif-deleted", "tag": "2c1f4747-a343-48b8-8c61-9a612c5be970"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:49.750446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.753070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.754779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.834566 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] Creating event network-vif-deleted:2c1f4747-a343-48b8-8c61-9a612c5be970 for instance e57a4eb2-8b2d-4627-b735-c435abfcc212 on n-h1-831193-17 Oct 04 18:10:49.864507 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9aa127f7-f8d2-457b-bd3f-9f77374ed7d8 req-6c6c686c-1029-4bdb-bc6d-15ebbd0140f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151606 Oct 04 18:10:49.866565 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 834/3848] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:50.229891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.230515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: ba0c2eec-168a-4588-b81c-d051ba9b2603] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.241578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.246010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.249224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.250387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.252772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.254206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.291834 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] HTTP exception thrown: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 HTTP/1.1 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'ba0c2eec-168a-4588-b81c-d051ba9b2603'} Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.312337 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 404 to user: Instance ba0c2eec-168a-4588-b81c-d051ba9b2603 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2df33ae3-c554-4e90-b9ea-cb237b1a3234 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603" status: 404 len: 111 microversion: 2.1 time: 0.088062 Oct 04 18:10:50.317169 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3015/3849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/ba0c2eec-168a-4588-b81c-d051ba9b2603 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:50.323833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.324556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] [instance: 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.336874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.339798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.340607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.342015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.344977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.345699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.372064 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] HTTP exception thrown: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Request method failure captured: Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 HTTP/1.1 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb3q0osW3Stmk7bR6h3z0Fvvy5ZuIYRwoHhi9Okxp96QEvMVHfNlSh4plzLHwva5CXZG1dwcuHm2og5WabPWUbDwK8I37j4ZRjFonfUHXeHVtgZPrgt8pLHiGLMxefU7HikOBLTYwwJfgOAxXCX9F-1QAyXSjrtVkQs4x8-QKwdjTY Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/debdbb6a8048440b84d8af1a0b7ea8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: debdbb6a8048440b84d8af1a0b7ea8cd Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1500343654 Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3488825130c74fffaa70d6c658dee49c Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ListServersNegativeTestJSON-1500343654-project Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5d4ea8f2-0f70-45c6-be5b-4408c0129dc8'} Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.374346 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. Oct 04 18:10:50.378992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.386474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] Returning 404 to user: Instance 5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:50.387665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-793dfdd0-7f2c-4688-bf96-8b6657238c48 tempest-ListServersNegativeTestJSON-1500343654 tempest-ListServersNegativeTestJSON-1500343654-project] 10.222.0.33 "GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8" status: 404 len: 111 microversion: 2.1 time: 0.068270 Oct 04 18:10:50.391697 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 835/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/5d4ea8f2-0f70-45c6-be5b-4408c0129dc8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:50.403944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.404905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.421922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.422917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.423463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.426171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.427490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.428748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.526103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.528143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.529787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.530478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lazy-loading 'fault' on Instance uuid e57a4eb2-8b2d-4627-b735-c435abfcc212 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:50.665716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3e7dc6c1dd4e7a8ee47c4ac279797a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b66d173edab423f8751dd80bf70d168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.678754 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d59c4f7-73fa-4643-a906-739fab632d51 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 200 len: 1302 microversion: 2.1 time: 0.289337 Oct 04 18:10:50.679765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3016/3851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 1302 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:51.711408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.718318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:51.725949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:51.738883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.740075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.741283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.742233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.744530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.745219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.783131 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 HTTP/1.1 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e57a4eb2-8b2d-4627-b735-c435abfcc212'} Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:51.785342 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:51.789441 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.791447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:51.792578 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0df11893-6114-4a52-8cf6-a4099ad20dc5 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 404 len: 111 microversion: 2.1 time: 0.090573 Oct 04 18:10:51.802777 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 836/3852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:51.831489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.853491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:51.874342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_groups [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Querying cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) for 1 instances {{(pid=128770) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:10:51.879018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.879557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.880007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.910541 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92a9e880-b373-40b1-a500-2ae92f7719c0 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.082946 Oct 04 18:10:51.912122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3017/3853] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:51.932926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.963865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:51.967574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.compute.server_groups [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Querying cell 1e3715f3-b416-44ed-969d-2dded84eaf0f(cell1) for 1 instances {{(pid=128771) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:10:51.971839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.973801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.974463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.028492 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-884ca0b2-7277-47a6-bc80-5d8eb8841f11 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827" status: 200 len: 182 microversion: 2.1 time: 0.100234 Oct 04 18:10:52.029724 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 837/3854] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827 => generated 182 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:52.041868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.042377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:52.061407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.062240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.066251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.067503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.068188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.070723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.096005 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 HTTP/1.1 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e57a4eb2-8b2d-4627-b735-c435abfcc212'} Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:52.098503 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.103021 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.106249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.107729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cfa9eb13-d030-4faf-a0b1-3e5d951189d4 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 404 len: 111 microversion: 2.1 time: 0.070320 Oct 04 18:10:52.108804 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3018/3855] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.116710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.117334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] [instance: e57a4eb2-8b2d-4627-b735-c435abfcc212] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:52.130846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.136460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.137011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.137779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.141373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.141827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.173055 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 HTTP/1.1 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e57a4eb2-8b2d-4627-b735-c435abfcc212'} Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.188069 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. Oct 04 18:10:52.192300 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.194197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance e57a4eb2-8b2d-4627-b735-c435abfcc212 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.201269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b321030-d41e-4c21-a9e4-f865fbd40e7b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212" status: 404 len: 111 microversion: 2.1 time: 0.082597 Oct 04 18:10:52.214555 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 838/3856] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:52 2022] GET /compute/v2.1/servers/e57a4eb2-8b2d-4627-b735-c435abfcc212 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.225816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e351430-f5e4-45d4-84e4-e2f629e19bef tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.243525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9e351430-f5e4-45d4-84e4-e2f629e19bef tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e351430-f5e4-45d4-84e4-e2f629e19bef tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-server-groups/cce72800-0631-4295-992a-e4731155b130 HTTP/1.1 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'cce72800-0631-4295-992a-e4731155b130'} Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.247722 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. Oct 04 18:10:52.253279 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.255191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e351430-f5e4-45d4-84e4-e2f629e19bef tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance group cce72800-0631-4295-992a-e4731155b130 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.256668 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e351430-f5e4-45d4-84e4-e2f629e19bef tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/cce72800-0631-4295-992a-e4731155b130" status: 404 len: 117 microversion: 2.1 time: 0.037953 Oct 04 18:10:52.258242 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3019/3857] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/os-server-groups/cce72800-0631-4295-992a-e4731155b130 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.267692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9fd97e7-a8b5-420e-b087-b50be7322236 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.276671 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e9fd97e7-a8b5-420e-b087-b50be7322236 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9fd97e7-a8b5-420e-b087-b50be7322236 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-server-groups/6d5f0110-07b7-4478-832b-fb6ef32723ce HTTP/1.1 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6d5f0110-07b7-4478-832b-fb6ef32723ce'} Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.279468 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. Oct 04 18:10:52.283918 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.284393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9fd97e7-a8b5-420e-b087-b50be7322236 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance group 6d5f0110-07b7-4478-832b-fb6ef32723ce could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.285131 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e9fd97e7-a8b5-420e-b087-b50be7322236 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/6d5f0110-07b7-4478-832b-fb6ef32723ce" status: 404 len: 117 microversion: 2.1 time: 0.022723 Oct 04 18:10:52.286433 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 839/3858] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/os-server-groups/6d5f0110-07b7-4478-832b-fb6ef32723ce => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.294996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-832ddc5d-7a01-4ef1-b7e5-689aadf95556 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.305292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:52.307529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-832ddc5d-7a01-4ef1-b7e5-689aadf95556 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-832ddc5d-7a01-4ef1-b7e5-689aadf95556 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-server-groups/c61eed91-f508-46e4-af36-c96eb37e9d4d HTTP/1.1 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c61eed91-f508-46e4-af36-c96eb37e9d4d'} Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.310346 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. Oct 04 18:10:52.314207 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.316785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-832ddc5d-7a01-4ef1-b7e5-689aadf95556 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance group c61eed91-f508-46e4-af36-c96eb37e9d4d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.318492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-832ddc5d-7a01-4ef1-b7e5-689aadf95556 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c61eed91-f508-46e4-af36-c96eb37e9d4d" status: 404 len: 117 microversion: 2.1 time: 0.027483 Oct 04 18:10:52.320212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3020/3859] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/os-server-groups/c61eed91-f508-46e4-af36-c96eb37e9d4d => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.330456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6008b5d2-c134-48d2-803f-3320b757f337 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.338234 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6008b5d2-c134-48d2-803f-3320b757f337 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] HTTP exception thrown: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6008b5d2-c134-48d2-803f-3320b757f337 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Request method failure captured: Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-server-groups/098abb82-78df-4e40-b899-3bbb3e5b2187 HTTP/1.1 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHb-sk-xJKrSPei7wGQXQsd6IPSJdLA03YkoU7auQOCCn3RqD0LwDAHdfyGQjmI8F5n1p4kAsYqVVLySs-O6gnspHP1DxN3eu7NCO8-ZE1YjtyaBPwTwIhKK9VccxRoTFBVH5KE28ypsfN42KlQCh0ApGETn6VFlTntQeNt1DtPHsq8 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b66d173edab423f8751dd80bf70d168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b66d173edab423f8751dd80bf70d168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 3b66d173edab423f8751dd80bf70d168 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerGroupTestJSON-1615778834 Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 5e3e7dc6c1dd4e7a8ee47c4ac279797a Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerGroupTestJSON-1615778834-project Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '098abb82-78df-4e40-b899-3bbb3e5b2187'} Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.341281 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. Oct 04 18:10:52.345177 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.348103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6008b5d2-c134-48d2-803f-3320b757f337 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Returning 404 to user: Instance group 098abb82-78df-4e40-b899-3bbb3e5b2187 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.349633 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6008b5d2-c134-48d2-803f-3320b757f337 tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/098abb82-78df-4e40-b899-3bbb3e5b2187" status: 404 len: 117 microversion: 2.1 time: 0.024130 Oct 04 18:10:52.354093 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 840/3860] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/os-server-groups/098abb82-78df-4e40-b899-3bbb3e5b2187 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:52.359150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e6b5c59-427d-47fc-846e-653b3c88ad3b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.418006 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e6b5c59-427d-47fc-846e-653b3c88ad3b tempest-ServerGroupTestJSON-1615778834 tempest-ServerGroupTestJSON-1615778834-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827" status: 204 len: 0 microversion: 2.1 time: 0.062409 Oct 04 18:10:52.418993 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3021/3861] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 18:10:52 2022] DELETE /compute/v2.1/os-server-groups/d15cf128-19e1-4141-92a8-0351d68c9827 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:10:53.683517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dedc64d7-1a2c-410e-9c47-49999de3974d tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6341c5f550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.827588 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dedc64d7-1a2c-410e-9c47-49999de3974d tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1b32ed4b-1bb8-426a-9268-ce515a45b9f6" status: 200 len: 351 microversion: 2.1 time: 0.148973 Oct 04 18:10:53.828438 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 841/3862] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/os-volumes/1b32ed4b-1bb8-426a-9268-ce515a45b9f6 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:56.628863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1d89536-c030-460d-bb62-6dbf83e98bf3 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f634022b550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:56.722935 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1d89536-c030-460d-bb62-6dbf83e98bf3 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fda7a168-3bd2-408c-ae55-68d3a6801de3" status: 200 len: 351 microversion: 2.1 time: 0.099478 Oct 04 18:10:56.724132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3022/3863] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/os-volumes/fda7a168-3bd2-408c-ae55-68d3a6801de3 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:00.519812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-59758896-76a1-41a0-a273-66ab4d6c7417 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f634216e5e0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.675226 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-59758896-76a1-41a0-a273-66ab4d6c7417 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ac2258dd-2ad1-4572-ab66-6ad76bfcedd7" status: 200 len: 351 microversion: 2.1 time: 0.159772 Oct 04 18:11:00.687512 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 842/3864] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/os-volumes/ac2258dd-2ad1-4572-ab66-6ad76bfcedd7 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:00.698138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21c1af92-421d-4329-b76d-4a8fb94e39e4 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f634022ba60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.846495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21c1af92-421d-4329-b76d-4a8fb94e39e4 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.157665 Oct 04 18:11:00.847330 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3023/3865] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:00.863002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-148cd6ce-9eef-40f3-a6c3-f2fa5f2d8173 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f634213f430>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.988274 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-148cd6ce-9eef-40f3-a6c3-f2fa5f2d8173 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.130533 Oct 04 18:11:01.004042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d1cb3dd-a5ca-4815-bc8d-9f3813fb7eea tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f63402e4790>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.007096 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 843/3866] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:01.114587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d1cb3dd-a5ca-4815-bc8d-9f3813fb7eea tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.114892 Oct 04 18:11:01.128884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3024/3867] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:01.131024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc329e6d-b7ec-40f8-b930-23c430e40a73 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6341f4d940>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.265265 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc329e6d-b7ec-40f8-b930-23c430e40a73 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.139078 Oct 04 18:11:01.268096 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 844/3868] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:01.286673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-191d172f-956f-4762-b49e-f11c5cd20621 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6340e72d30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.415899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-191d172f-956f-4762-b49e-f11c5cd20621 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.139560 Oct 04 18:11:01.416874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3025/3869] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:01.432299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce611dda-0d04-4cc1-a039-6e39f93a36b8 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6342277310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.590594 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce611dda-0d04-4cc1-a039-6e39f93a36b8 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.161833 Oct 04 18:11:01.605520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f430782a-f3b6-4682-bc67-31295db18fe5 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6340e72700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.606000 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 845/3870] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:01.830831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f430782a-f3b6-4682-bc67-31295db18fe5 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.228338 Oct 04 18:11:01.834762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3026/3871] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:01.854997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2e574df3-38cf-4edb-9e5a-7a053b1da8e7 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] Calling method '.version_select at 0x7f6341dbddc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.046019 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2e574df3-38cf-4edb-9e5a-7a053b1da8e7 tempest-VolumesTestJSON-1484435675 tempest-VolumesTestJSON-1484435675-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.193875 Oct 04 18:11:02.046820 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 846/3872] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:04.916585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:04.922057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:05.359429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78addfca-f4be-4984-825c-a90d26899618 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] Calling method '.version_select at 0x7f6340311a60>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.472849 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78addfca-f4be-4984-825c-a90d26899618 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634/defaults" status: 200 len: 371 microversion: 2.1 time: 0.570909 Oct 04 18:11:05.476696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3027/3873] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:11:04 2022] GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634/defaults => generated 371 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:05.488256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-18b981fb-b028-4d44-85e2-29ebb89899d5 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] Calling method '.version_select at 0x7f6341e66160>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.500592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:05.502069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:05.661313 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-18b981fb-b028-4d44-85e2-29ebb89899d5 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634" status: 200 len: 371 microversion: 2.1 time: 0.175504 Oct 04 18:11:05.673931 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 847/3874] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634 => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:05.681611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e8fb7ee-739a-4216-aabf-f1492ecc1a03 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] Calling method '.version_select at 0x7f63402e4ca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.878007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e8fb7ee-739a-4216-aabf-f1492ecc1a03 tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634/defaults" status: 200 len: 371 microversion: 2.1 time: 0.202305 Oct 04 18:11:05.889512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3028/3875] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634/defaults => generated 371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:05.897433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50cf6a74-ea46-4468-8667-de6fb9907fce tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] Calling method '.version_select at 0x7f6342277a60>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.005843 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50cf6a74-ea46-4468-8667-de6fb9907fce tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634" status: 200 len: 371 microversion: 2.1 time: 0.113096 Oct 04 18:11:06.016297 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 848/3876] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634 => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:06.021942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2aef6cc4-5c10-408a-b1c1-0b87eaa8707b tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] Calling method '.version_select at 0x7f63402e4280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.231314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2aef6cc4-5c10-408a-b1c1-0b87eaa8707b tempest-QuotasTestJSON-1584260433 tempest-QuotasTestJSON-1584260433-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634?user_id=68e932372ef846a2ad53974ad7aac42f" status: 200 len: 371 microversion: 2.1 time: 0.210824 Oct 04 18:11:06.235678 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3029/3877] 10.222.0.33 () {58 vars in 1323 bytes} [Tue Oct 4 18:11:06 2022] GET /compute/v2.1/os-quota-sets/cdfd3394e036484a9bc99739d8300634?user_id=68e932372ef846a2ad53974ad7aac42f => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:12.357358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1843230919", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5eeaded7-990f-48da-b97a-403c6be2c564"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:12.476313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] validate_networks() for [('5eeaded7-990f-48da-b97a-403c6be2c564', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:14.396109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:14.397182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:14.397833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:14.398412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:14.399074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:14.410496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.411290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.411894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.412823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.413443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.414085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.440417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Getting quotas for project 93a56014897c4ceabc35e431c73493b4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:14.446691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Getting quotas for user cec6b5be8c454b37b347e297344bee37 and project 93a56014897c4ceabc35e431c73493b4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:14.462433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Going to run 2 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:14.465125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 72738a25-a21d-4010-91f6-bd1dc2bc5afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:14.517444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=72738a25-a21d-4010-91f6-bd1dc2bc5afe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:14.587850 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [b6fa956a-222c-4fe7-83ec-d2ad5f50e420] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:11:15.607684 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [b6fa956a-222c-4fe7-83ec-d2ad5f50e420] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 50014. Oct 04 18:11:15.616409 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4efb6447-1e1b-459e-ad82-cfce86886d88 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.564204 Oct 04 18:11:15.624292 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 849/3878] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:15.640934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:15.672097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:15.675155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Searching by: {'deleted': False, 'project_id': '93a56014897c4ceabc35e431c73493b4'} {{(pid=128770) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:15.714942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.715606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.716069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.716923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.717385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.730131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.780677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-467916ac-ae33-49d8-8a4f-4f599d363654 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.147752 Oct 04 18:11:15.781286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3030/3879] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/servers => generated 677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:15.797308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02c4d865-9122-4302-a9ec-30252a00eb81 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:15.808768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-02c4d865-9122-4302-a9ec-30252a00eb81 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:16.020949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-02c4d865-9122-4302-a9ec-30252a00eb81 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:16.053824 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-02c4d865-9122-4302-a9ec-30252a00eb81 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1220 microversion: 2.1 time: 0.256104 Oct 04 18:11:16.054963 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 850/3880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1220 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:17.094396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-143aa7f0-9b6d-4b9f-8fda-af02c5860e6a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.095808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-143aa7f0-9b6d-4b9f-8fda-af02c5860e6a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.108040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:17.639427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-143aa7f0-9b6d-4b9f-8fda-af02c5860e6a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.652156 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-143aa7f0-9b6d-4b9f-8fda-af02c5860e6a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1220 microversion: 2.1 time: 0.561528 Oct 04 18:11:17.654195 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3031/3881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:17 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1220 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:18.701141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:18.702910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.716264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.716579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aaab1e7-04bf-4e71-9769-c57415e33c38"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:18.717544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.720696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.722124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.723347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.724030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.726055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.743111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.755397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.756291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.757833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.758783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.759587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.899756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:18.918679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cacb634c-ab0c-4b5f-bbc7-a0a6ae90bb42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1272 microversion: 2.1 time: 0.223036 Oct 04 18:11:18.924211 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 851/3882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:18 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:19.662719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a5aaeaf-2cbb-4a32-9016-a29a2c49c1ce tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947762 Oct 04 18:11:19.683664 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3032/3883] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:11:18 2022] POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:19.946666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:19.947321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:19.978174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.997589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.999679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.002086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.004925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.015246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.496898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.506649 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4425f79e-6ba1-4f49-baa0-e0490b05fb8f tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1290 microversion: 2.1 time: 0.563769 Oct 04 18:11:20.512151 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 852/3884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:19 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1290 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:21.544586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.546434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.593864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.597386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.600210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.602989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.607448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.621650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.836117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.853929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd4ba1f5-c804-4545-98b2-d643f9e13c40 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 2.318201 Oct 04 18:11:23.882553 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3033/3885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:24.886692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.888408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.905300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:24.914795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.921544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.922613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.925454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.927731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.928479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.044706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:26.139207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.178079 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a99d5a3b-3e94-4a6f-9676-415598e8febe tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 1.298459 Oct 04 18:11:26.211928 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 853/3886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:27.219901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.221495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.232573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:27.253905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.256082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.257984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.260934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.261093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.261665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.648548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:28.011611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.029965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17c03144-195f-4283-9ea3-0b3617d7fee6 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.815538 Oct 04 18:11:28.034119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3034/3887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:29.065921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.066686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.120028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.128334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.128798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.129714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.130179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.130614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.335444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2508b566-e851-4d5f-be63-4cdbc8385de7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: .version_select at 0x7f6341c5fd30>, body: {"keypair": {"name": "tempest-keypair-2077403980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnxGuLEjNWlK1P+PaHLC3350Hh57maz89azBYzlyVEa1cf6dPqO8Mv6PhB5zd+FYg4uyS+z9ovEwxLrc/wwcip0uKRyqgoI22o1UKektNmf89LzLgzd+ZvNq4rUswvVA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:29.378593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2508b566-e851-4d5f-be63-4cdbc8385de7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:29.390936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-2508b566-e851-4d5f-be63-4cdbc8385de7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:29.492958 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2508b566-e851-4d5f-be63-4cdbc8385de7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.204397 Oct 04 18:11:29.500005 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 854/3888] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:11:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:29.505524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d686ff3f-2f58-4cc6-a5c6-86751d7397df", "tag": "418d972b-5f8c-48d7-b85a-543d851c770b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:29.547514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.549133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.549594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.603702 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] Creating event network-changed:418d972b-5f8c-48d7-b85a-543d851c770b for instance d686ff3f-2f58-4cc6-a5c6-86751d7397df on n-h1-831193-17 Oct 04 18:11:29.618957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-7097e1ef-92ed-4fb3-8b8e-7513cbf0fd2f req-6c2cf864-2c55-44d3-bdf1-9fca3a5713ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123183 Oct 04 18:11:29.621752 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 855/3889] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:29.950271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.963780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5a8b452f-5dff-47ff-ae08-55e0ef72bd62 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.904731 Oct 04 18:11:29.964799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3035/3890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:30.997476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:30.998658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.021318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.029930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.030707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.032047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.039514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.040645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.574435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:31.585473 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd9b5e01-edad-401c-976a-66984553f6a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.596374 Oct 04 18:11:31.590399 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 856/3891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:30 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.701544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72738a25-a21d-4010-91f6-bd1dc2bc5afe", "tag": "373256c4-91cf-4ff7-aba8-76b6adde85b3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:31.767859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.768358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.768805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.801962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] Creating event network-changed:373256c4-91cf-4ff7-aba8-76b6adde85b3 for instance 72738a25-a21d-4010-91f6-bd1dc2bc5afe on n-h2-831193-17 Oct 04 18:11:31.808998 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a4a4b837-406c-43ec-81c0-e3fa3576a3b4 req-d576ade2-0de4-4b0c-8577-27ab7f903fcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114859 Oct 04 18:11:31.811376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3036/3892] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:32.615884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:32.617075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:32.631842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.634377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.635858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.637209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.639392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.641490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.380089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.390659 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a191f87d-1117-4f01-9bfb-8491864ef0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.778541 Oct 04 18:11:33.403661 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 857/3893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:32 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:34.419537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:34.420346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:34.432036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.433039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.437850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.442945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.445580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.447528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.743899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:34.744531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:34.758725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.759372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.759883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.760661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.761131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.765427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.849719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:35.134120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=29 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:35.181683 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9737813a-b64a-459a-8165-31ae0e933615 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 204 len: 0 microversion: 2.32 time: 0.973952 Oct 04 18:11:35.185659 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3037/3894] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:11:34 2022] DELETE /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:11:35.200771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:35.202046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:35.213073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.214046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.214835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.215718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.216310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.216821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.956205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.959554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=39 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:35.969280 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-743b11ce-87b0-45bb-80e6-e3896e3c0f02 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 1.555169 Oct 04 18:11:35.979358 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 858/3895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:34 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:36.122245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.136680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.138078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.149613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfa5a4ad-62e4-4f86-8977-f879448729a6 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2958 microversion: 2.32 time: 0.951659 Oct 04 18:11:36.160656 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3038/3896] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:35 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2958 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:36.811185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2015437116", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "026cefdc-3a81-4fee-9860-a3ebae88796b"}], "security_groups": [{"name": "tempest-securitygroup--2012869556"}], "key_name": "tempest-keypair-2077403980", "user_data": "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:36.879922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:36.998309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.999111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.012182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.013633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.014327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.015577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.016262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.017802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.106848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] validate_networks() for [('026cefdc-3a81-4fee-9860-a3ebae88796b', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:37.559961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:37.574906 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47eed1e0-6fda-40c1-8fc8-9a491209c95a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.580855 Oct 04 18:11:37.584106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3039/3897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:37.603359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.604280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.628506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.633942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.634399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.642638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.645810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.646569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.144647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.158390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.177899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.184187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da6c2468-fc96-4a9b-b2da-3628ce294f87 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2958 microversion: 2.32 time: 0.597194 Oct 04 18:11:38.186620 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3040/3898] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2958 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:38.388030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:38.388492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:38.388925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:38.389342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:38.389763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:38.405008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.410338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.410807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.411760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.412150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.412595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.449008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:38.456678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:38.474204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:38.476900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:38.586541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a1e673ae-fc92-495c-89f9-1307136b1d1a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.780346 Oct 04 18:11:38.589604 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 859/3899] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:38.605931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32c35dc5-fa7d-4a08-beac-6bbf5a781a21 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.606557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32c35dc5-fa7d-4a08-beac-6bbf5a781a21 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.610116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.610955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.625365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.629250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.629977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.634147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.634810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.635492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.832030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32c35dc5-fa7d-4a08-beac-6bbf5a781a21 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.844434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32c35dc5-fa7d-4a08-beac-6bbf5a781a21 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1242 microversion: 2.1 time: 0.239383 Oct 04 18:11:38.850452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3041/3900] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1242 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:39.111394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.124953 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-671d4285-bbd2-4d70-be21-2328c40c270a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.520043 Oct 04 18:11:39.127058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 860/3901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:39.217936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.219075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.242497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.246078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.246797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.247995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.250584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.251320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.398286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d686ff3f-2f58-4cc6-a5c6-86751d7397df", "name": "network-vif-plugged", "status": "completed", "tag": "418d972b-5f8c-48d7-b85a-543d851c770b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:39.419605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.420102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.420539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.490234 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] Creating event network-vif-plugged:418d972b-5f8c-48d7-b85a-543d851c770b for instance d686ff3f-2f58-4cc6-a5c6-86751d7397df on n-h1-831193-17 Oct 04 18:11:39.506189 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9f7ed041-c1ae-413c-9f41-64eeeb59ab54 req-10ae94fb-90ba-40b3-8d45-72fccc010e06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111725 Oct 04 18:11:39.515479 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 861/3902] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:39.874396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b82e87b9-280a-4e77-a45e-bf1c20caa2b9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.884587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b82e87b9-280a-4e77-a45e-bf1c20caa2b9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.252090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b82e87b9-280a-4e77-a45e-bf1c20caa2b9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.268795 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b82e87b9-280a-4e77-a45e-bf1c20caa2b9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1242 microversion: 2.1 time: 0.400163 Oct 04 18:11:40.273630 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 862/3903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1242 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:40.289209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:40.297570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.324064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.337500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.339456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.341168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.342171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.343056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.343826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.346692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.348175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.357116 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1dafcd13-0af3-4e02-8854-f67329bfb0f9 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2958 microversion: 2.32 time: 1.143315 Oct 04 18:11:40.358255 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3042/3904] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2958 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:40.370304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.375838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.389188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'flavor' on Instance uuid c06de75c-4497-40f4-8b8f-be8f62545404 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:40.400656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.405116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.405894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.406991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.408186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.410566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.779935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-382e2f9d-8a4a-4e44-9571-71260fd6540a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/action" status: 200 len: 32 microversion: 2.1 time: 0.501074 Oct 04 18:11:40.795071 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 863/3905] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:40 2022] POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:40.828766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.831552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.878374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.882498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.883149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.887706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.888337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.890585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.950600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.968607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ea736fc-34c2-41af-b135-fd6e568bc63a tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1320 microversion: 2.1 time: 0.609002 Oct 04 18:11:40.969220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3043/3906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1320 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:41.292435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.293157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.312892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.315193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.315885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.319423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.320463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.322518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.161402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.175063 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9e384a5-e864-4561-92b1-35dfc91a278e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1302 microversion: 2.1 time: 0.886475 Oct 04 18:11:42.183003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3044/3907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1302 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:42.194734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.195764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.212212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.216246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.217704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.223107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.225223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.228195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.455819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.468225 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5d6771ad-7751-4673-b864-a5005b9eb19d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.662097 Oct 04 18:11:42.471912 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 864/3908] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:42.492807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72738a25-a21d-4010-91f6-bd1dc2bc5afe", "name": "network-vif-plugged", "status": "completed", "tag": "373256c4-91cf-4ff7-aba8-76b6adde85b3"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-unplugged", "status": "completed", "tag": "0f7f691a-70c9-4c81-9bdf-3ee37b61118f"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-unplugged", "status": "completed", "tag": "faa992a7-5058-4ea9-a4f0-2b9848cbf70a"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:42.511319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.512257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.512946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.528800 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Creating event network-vif-plugged:373256c4-91cf-4ff7-aba8-76b6adde85b3 for instance 72738a25-a21d-4010-91f6-bd1dc2bc5afe on n-h2-831193-17 Oct 04 18:11:42.530232 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Creating event network-vif-unplugged:0f7f691a-70c9-4c81-9bdf-3ee37b61118f for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:42.531077 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] Creating event network-vif-unplugged:faa992a7-5058-4ea9-a4f0-2b9848cbf70a for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:42.542635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e11f5648-a3dc-4aa7-8219-1bd5e78fcdeb req-ff5a19ad-b131-423d-b58b-41f8d9ad1316 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.069101 Oct 04 18:11:42.543644 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 865/3909] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:42.552051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.553166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.562074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.563272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.564091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.565041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.565765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.566413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.193171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.208623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8afde834-b4e0-4638-a77b-033e615e8922 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 200 len: 1508 microversion: 2.1 time: 0.663432 Oct 04 18:11:43.223750 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 866/3910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 1508 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:43.223750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.226573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.233779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.234284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.234728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.239688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.240190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.240642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.382739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.401460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.407915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.409392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c128b3cd-e370-4970-b6e7-e25fdbe99b13 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2958 microversion: 2.32 time: 1.224368 Oct 04 18:11:43.410631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3045/3911] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2958 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:43.428881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.432376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 72738a25-a21d-4010-91f6-bd1dc2bc5afe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.466465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.470865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.479449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.482253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.488390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.490081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.493938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.505678 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8cf7222d-da72-4100-8048-a456d81cbb0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1300 microversion: 2.1 time: 0.293576 Oct 04 18:11:43.507255 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 867/3912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1300 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:43.513964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.514573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.547015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.551909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.552462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.554433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.556104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.556571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.266956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.273350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:44.277565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ecb2e270-8e07-4217-98a7-659e3e1811dc tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe" status: 200 len: 1320 microversion: 2.1 time: 0.863147 Oct 04 18:11:44.287424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3046/3913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe => generated 1320 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.373449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.399184 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1805b5e-3701-4558-9af5-31f51278c0e0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.886119 Oct 04 18:11:44.404075 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 868/3914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.456159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.456797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.486209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.486723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.498876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.502144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.502852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.504585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.534866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.535994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.552534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.553040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.553490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.554222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.554710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.555178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.796294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.804887 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9690597e-6d20-41fb-b6aa-9950166a7813 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1300 microversion: 2.1 time: 0.274865 Oct 04 18:11:44.805823 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 869/3915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:44.852831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-unplugged", "status": "completed", "tag": "acd4770c-3b15-4922-a6b2-3bd6ed249eca"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-unplugged", "status": "completed", "tag": "dbaf9de8-4490-44cd-8050-c66a830aa234"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-unplugged", "status": "completed", "tag": "ad62896c-72ad-460e-977d-df032390cb99"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:44.864410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.864884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.865501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.882733 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Creating event network-vif-unplugged:acd4770c-3b15-4922-a6b2-3bd6ed249eca for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:44.883595 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Creating event network-vif-unplugged:dbaf9de8-4490-44cd-8050-c66a830aa234 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:44.884206 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] Creating event network-vif-unplugged:ad62896c-72ad-460e-977d-df032390cb99 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:44.900419 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f8aa9554-7c58-48ec-b5ea-166e8e66a30f req-6b05da19-8bed-4f87-8bca-bc57a8d793a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.059819 Oct 04 18:11:44.904005 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 870/3916] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:45.098185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.109161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.111063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.112639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-799fcc72-cb92-4f5c-b916-ce59fbdbde14 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2916 microversion: 2.32 time: 0.674255 Oct 04 18:11:45.128595 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3047/3917] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2916 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:45.303936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.305682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 72738a25-a21d-4010-91f6-bd1dc2bc5afe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.327741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.329002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.330233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.331268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.331925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.332533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.432408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.432784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.452850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.453370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.453820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.455273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.455742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.456179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.118742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.135785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d9962f3-8a2f-4fd7-98aa-c62947ff857d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe" status: 200 len: 1509 microversion: 2.1 time: 0.838371 Oct 04 18:11:46.142736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.150250 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 871/3918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:46.159693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8eb283db-f674-47e0-a827-c7f2ff7d292d tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.731249 Oct 04 18:11:46.160303 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3048/3919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:46.181219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.182844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.194025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.195590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.198452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.200101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.201204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.202607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.202760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.203805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.217755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.220927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.222359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.223401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.225483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.227398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.318300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.328573 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e147b6c5-efcf-49d9-b63e-7ee3a584cef8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 1.176370 Oct 04 18:11:47.359058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 872/3920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:47.365030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.365554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 72738a25-a21d-4010-91f6-bd1dc2bc5afe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.368112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.378419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.378919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.391366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.392138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.393863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.394641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.395403 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7a22bfe-aea3-44d1-b59d-df99349dc2ae tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2916 microversion: 2.32 time: 1.215083 Oct 04 18:11:47.396077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.396390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3049/3921] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2916 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:47.399121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.401368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.403863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.412677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.413486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.414170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.415164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.415851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.416295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.463276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 72738a25-a21d-4010-91f6-bd1dc2bc5afe] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:47.637996 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3c60469-6511-48bf-a713-b15d00774ad8 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe" status: 204 len: 0 microversion: 2.1 time: 0.287277 Oct 04 18:11:47.639268 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 873/3922] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:47 2022] DELETE /compute/v2.1/servers/72738a25-a21d-4010-91f6-bd1dc2bc5afe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:47.654262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.655361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.667923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.668859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.669623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.670591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.671305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.671981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.748462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: d686ff3f-2f58-4cc6-a5c6-86751d7397df] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:47.804325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:47.938321 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1cec38ae-e973-4bce-8eed-5955996e0701 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df" status: 204 len: 0 microversion: 2.1 time: 0.293138 Oct 04 18:11:47.938967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 874/3923] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:47 2022] DELETE /compute/v2.1/servers/d686ff3f-2f58-4cc6-a5c6-86751d7397df => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:48.125718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-893577841", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5eeaded7-990f-48da-b97a-403c6be2c564"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:48.224914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] validate_networks() for [('5eeaded7-990f-48da-b97a-403c6be2c564', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:48.439396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:48.839472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:48.973072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.986311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a487d99d-7475-429e-9ca5-90a66d262ba3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.588691 Oct 04 18:11:48.989426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3050/3924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:47 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.008398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.009030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.019215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.020103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.020721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.021957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.022585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.023199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.899649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.907957 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06c5571d-aad6-4d3a-9975-a8ec11ade89e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.917139 Oct 04 18:11:49.908588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3051/3925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.949650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.950333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.982646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.983681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.984808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.988801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.990206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.999465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.264091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:51.899978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.936760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.941079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.946051 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-56d512fb-ba86-433f-a22d-e1651d40bfc0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2869 microversion: 2.32 time: 2.009597 Oct 04 18:11:51.975361 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3052/3926] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2869 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:51.997541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-deleted", "tag": "0f7f691a-70c9-4c81-9bdf-3ee37b61118f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:52.039938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.042424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.043556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.088198 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] Creating event network-vif-deleted:0f7f691a-70c9-4c81-9bdf-3ee37b61118f for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:52.111836 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2ce9fa42-42e2-4b4c-a999-6aff34b760eb req-378fc271-bcab-4f64-a2aa-caed8c440c47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130890 Oct 04 18:11:52.115457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3053/3927] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:52.129799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.130569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.144519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.145445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.146462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.148524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.149256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.150534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.362452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:52.371855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:52.373281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:52.375433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:52.376092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:52.409260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.409760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.410342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.411591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.415437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.415951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.464158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Getting quotas for project 93a56014897c4ceabc35e431c73493b4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:52.476465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Getting quotas for user cec6b5be8c454b37b347e297344bee37 and project 93a56014897c4ceabc35e431c73493b4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:52.509798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Going to run 2 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:52.529291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:52.599463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=2b7f787d-8ec9-449d-b4ec-38788e567a00,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:52.704583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.721799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bc1a952-843e-456e-b345-497fccea70f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.603331 Oct 04 18:11:52.723386 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3054/3928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:52.729704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.738940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.747223 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba6e2b71-e166-475d-990f-f24e8cfb374e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.626346 Oct 04 18:11:52.747887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.748873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.750234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.751242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.751878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.752475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.752592 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 875/3929] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 4632 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:11:52.771642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d686ff3f-2f58-4cc6-a5c6-86751d7397df", "name": "network-vif-deleted", "tag": "418d972b-5f8c-48d7-b85a-543d851c770b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:52.800487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.800987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.801425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.830471 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] Creating event network-vif-deleted:418d972b-5f8c-48d7-b85a-543d851c770b for instance d686ff3f-2f58-4cc6-a5c6-86751d7397df on n-h1-831193-17 Oct 04 18:11:52.842476 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0fa4de09-76af-4bab-a0f7-49bdd3891c35 req-6293bf29-6807-499e-b4e0-cb880eecd770 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088634 Oct 04 18:11:52.843699 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 876/3930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:52.850959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.859873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.861819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Searching by: {'deleted': False, 'project_id': '93a56014897c4ceabc35e431c73493b4'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:52.888503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.889310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.890026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.893561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.895365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.896333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.934589 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-72fa4d22-6ee5-4293-9f22-3003a47710af tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.089156 Oct 04 18:11:52.935688 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 877/3931] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers => generated 671 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:52.958771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0fa6bd65-22ac-434b-bb1e-a4de14af5294 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.960921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0fa6bd65-22ac-434b-bb1e-a4de14af5294 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.191551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0fa6bd65-22ac-434b-bb1e-a4de14af5294 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.200973 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0fa6bd65-22ac-434b-bb1e-a4de14af5294 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1217 microversion: 2.1 time: 0.254881 Oct 04 18:11:53.205145 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 878/3932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:53.221163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.221804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.236250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.236748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.237189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.237900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.238354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.238781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.703910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.719212 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ddfee8fc-218f-475a-a7ed-17e15715c97e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.994453 Oct 04 18:11:53.734560 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3055/3933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:53.754783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.755734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.784176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.784688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.785137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.785906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.786367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.786815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.207850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.225689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.230449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.240603 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a7a8221d-574e-44d2-951c-60a954762652 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2535 microversion: 2.32 time: 1.034307 Oct 04 18:11:54.255151 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 879/3934] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2535 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:54.255151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c", "tag": "020df383-fbc8-4ce5-8664-4c2697aa699b"}, {"server_uuid": "72738a25-a21d-4010-91f6-bd1dc2bc5afe", "name": "network-vif-deleted", "tag": "373256c4-91cf-4ff7-aba8-76b6adde85b3"}, {"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-deleted", "tag": "acd4770c-3b15-4922-a6b2-3bd6ed249eca"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.283933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.284651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.288865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.326305 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Creating event network-changed:020df383-fbc8-4ce5-8664-4c2697aa699b for instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c on n-h2-831193-17 Oct 04 18:11:54.326985 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Creating event network-vif-deleted:373256c4-91cf-4ff7-aba8-76b6adde85b3 for instance 72738a25-a21d-4010-91f6-bd1dc2bc5afe on n-h2-831193-17 Oct 04 18:11:54.328262 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] Creating event network-vif-deleted:acd4770c-3b15-4922-a6b2-3bd6ed249eca for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:54.354422 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-92bbf7a6-2cba-452f-9dbd-a666f417e06a req-e89e97c4-df87-4c7a-b442-1369e8639a43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.104623 Oct 04 18:11:54.355447 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 880/3935] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:54.367453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3fac7ad3-4784-4bcb-9cbd-627a00c521ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.370141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3fac7ad3-4784-4bcb-9cbd-627a00c521ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.445070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.463954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-125cd441-ab48-4688-bceb-e50a6ed87ea4 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.713733 Oct 04 18:11:54.465956 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3056/3936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.554602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3fac7ad3-4784-4bcb-9cbd-627a00c521ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.564836 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3fac7ad3-4784-4bcb-9cbd-627a00c521ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1217 microversion: 2.1 time: 0.207898 Oct 04 18:11:54.568315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 881/3937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.746616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.747942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.761826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.764106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.767663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.770321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.772286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.777763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.273773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.282425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.294727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.305097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.307023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.308247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.309590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.310123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.458854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.510438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e58d875-f1eb-4878-9a65-0eee0a17e3d1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.761946 Oct 04 18:11:55.535786 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3057/3938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:55.562816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.575121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.586581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.587899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.588560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.589538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.590298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.590822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.366927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.420942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32a12ecb-613c-4d61-8ad3-dba15da8820c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.883830 Oct 04 18:11:57.432740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3058/3939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:57.453670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.457046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.473479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.475465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.478747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.481216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.487935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.488949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.744372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.757824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.759773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.763119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.764076 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ed6028c9-2dd1-45a4-bd82-14d56343ec8d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2421 microversion: 2.32 time: 2.494176 Oct 04 18:11:57.768113 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 882/3940] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2421 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:57.775023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc61d5d8-181a-4343-a354-811ad819f2ef tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1275 microversion: 2.1 time: 0.338670 Oct 04 18:11:57.779717 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3059/3941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:57.783542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.784461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.796766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:57.800813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.812215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-deleted", "tag": "ad62896c-72ad-460e-977d-df032390cb99"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:57.814233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.816896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.817988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.830728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.833225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.836777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.837213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.837577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.908636 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] Creating event network-vif-deleted:ad62896c-72ad-460e-977d-df032390cb99 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:11:57.938819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-754ac371-9a88-44aa-8f34-e31dd562d7f7 req-15fee527-952a-42ef-af88-928a8d6368a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157527 Oct 04 18:11:57.940212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3060/3942] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:58.463789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.464534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.488569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.489125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.489560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.490279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.490745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.505760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.708517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:58.723102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba971292-ff09-4584-a8d4-bd1f63ffc9bb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.953581 Oct 04 18:11:58.723898 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 883/3943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:58.797695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.798929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.805438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.805892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.806330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.807070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.807516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.807945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.100985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.112060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72effe37-54f2-4c14-91f2-5ee5e93d6bac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.656885 Oct 04 18:11:59.120508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3061/3944] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:59.131170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.136643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.173571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.174258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.178405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.178607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.179410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.183074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.668692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.678708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.680194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.696463 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9a0efbb9-07fb-4f1f-b229-49414db72b32 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2170 microversion: 2.32 time: 0.900453 Oct 04 18:11:59.699455 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 884/3945] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2170 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:59.720636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c", "name": "network-vif-plugged", "status": "completed", "tag": "020df383-fbc8-4ce5-8664-4c2697aa699b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:59.758839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.761143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.761739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.838950 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] Creating event network-vif-plugged:020df383-fbc8-4ce5-8664-4c2697aa699b for instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c on n-h2-831193-17 Oct 04 18:11:59.858495 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5e546296-b1b4-4480-beb7-d2ed70e527b5 req-b10c2d12-3867-4aaf-bf4e-4426fdd82cdb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155782 Oct 04 18:11:59.865562 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 885/3946] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:59.921132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.925012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.948588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.959350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.960313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.961708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.962603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.963515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.051904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.073177 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3dcbe99d-9401-4bb2-aa14-3e70668356f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 0.947956 Oct 04 18:12:00.079883 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3062/3947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.142655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-deleted", "tag": "faa992a7-5058-4ea9-a4f0-2b9848cbf70a"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:00.177799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.179765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.181451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.231353 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] Creating event network-vif-deleted:faa992a7-5058-4ea9-a4f0-2b9848cbf70a for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:12:00.240367 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-91099877-f54a-43eb-894b-18afe3729516 req-4c478dec-a65d-4470-8a40-8f828a9bea77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123847 Oct 04 18:12:00.242133 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3063/3948] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:00.251161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.252528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.262442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.265075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.267564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.268880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.270134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.271168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.626960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.643432 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c73ea4c-37c3-4b20-945e-bdbf5d3d4e92 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.772901 Oct 04 18:12:00.644547 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 886/3949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.739157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.740053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.754493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.755672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.756346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.757298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.760437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.761009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.443436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.462718 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb98f6f7-9b54-4df9-a658-42b8335f3190 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.218506 Oct 04 18:12:01.463378 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3064/3950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.467997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.468612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.480882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.481393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.481842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.482552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.483024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.483467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.535752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:01.549096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.564601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.568918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.570321 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03c4d012-094c-407f-a626-bfe95d2fa9b7 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 2057 microversion: 2.32 time: 0.837085 Oct 04 18:12:01.570921 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 887/3951] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 2057 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:01.691508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.692127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.701352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.701867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.706623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.707811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.708463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.710116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.096866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.129163 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75bf7313-5bc7-4ee6-aafe-46f2537a82dd tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 0.664688 Oct 04 18:12:02.148130 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3065/3952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.153420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f787d-8ec9-449d-b4ec-38788e567a00", "tag": "f24ed6b2-0576-4411-8c0a-681466a25d32"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:02.186225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.187065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.187671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.201660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] Creating event network-changed:f24ed6b2-0576-4411-8c0a-681466a25d32 for instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 on n-h1-831193-17 Oct 04 18:12:02.212902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-48f8b282-e35e-49a1-bf33-d4d4dfb8269d req-f0f50e5b-26b6-4a5f-a118-449cc9f7a48e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060369 Oct 04 18:12:02.214781 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3066/3953] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:02.272482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.300877 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab0235ea-fd1f-4f13-9f1e-02c0968ac0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1368 microversion: 2.1 time: 0.612645 Oct 04 18:12:02.304799 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 888/3954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1368 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:02.403393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63e3a18-7a79-4fae-84af-f259ddb86963", "name": "network-vif-deleted", "tag": "dbaf9de8-4490-44cd-8050-c66a830aa234"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:02.426672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.427523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.428161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.453625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] Creating event network-vif-deleted:dbaf9de8-4490-44cd-8050-c66a830aa234 for instance c63e3a18-7a79-4fae-84af-f259ddb86963 on n-h1-831193-17 Oct 04 18:12:02.471284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e052974a-fb08-4c50-832e-648d78428c5d req-a902c528-abf9-4aca-ba85-3cfe9a6f8ba9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069776 Oct 04 18:12:02.472223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3067/3955] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:02.492530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.497109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.513208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.513781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.514296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.515169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.515985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.517181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.614233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.614957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.628301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.628819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.632245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.633088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.633580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.634030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.899446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.903986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:02.922436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.924748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.926497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed75b387-9f57-441e-b0a1-4714e3471ae0 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.317306 Oct 04 18:12:02.955215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3068/3956] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:03.164008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.164858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.175513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.178670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.179422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.185636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.186373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.187006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.403886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.412806 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4b0e7c07-136b-4872-897f-3a8c3d3f9786 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 0.925571 Oct 04 18:12:03.422285 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 889/3957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.433181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.453361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.490686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.491416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.492244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.493514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.494679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.495764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.563890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=10 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:04.588819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.604635 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-accd074e-6bb3-46c4-8b37-253cbccd544c tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 1.444752 Oct 04 18:12:04.605460 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3069/3958] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.633010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.633628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.661950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.662489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.670688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.671617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.672120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.672606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.928646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.932476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.940122 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2ccaf7f4-dfd9-4562-bd3c-37898abcb3b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1558 microversion: 2.1 time: 1.516051 Oct 04 18:12:04.940742 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 890/3959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1558 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.959287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.959287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.965492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.970614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.972780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.974763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.975559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.976469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.976661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad1e74fe-0f7b-4946-a57c-d1b9635cf6d3 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.370378 Oct 04 18:12:04.978047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.979547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.983222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3070/3960] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:05.001947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c73652-1207-48ae-bd4f-a919a88ef265", "tag": "313c4102-2c20-4e80-91a7-488bf542f5d0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:05.030723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.031259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.032965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.058924 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] Creating event network-changed:313c4102-2c20-4e80-91a7-488bf542f5d0 for instance 38c73652-1207-48ae-bd4f-a919a88ef265 on n-h2-831193-17 Oct 04 18:12:05.070970 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e47dc8c2-daee-43c3-88c5-c583a0a696fc req-c307b38a-0274-45c7-85be-8980207d00fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084850 Oct 04 18:12:05.074905 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3071/3961] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:05.085982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.086586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.101137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.103988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.104676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.105588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.106227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.107548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.389888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd6b8cda-81f8-453e-83e9-d125f58c928a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313574 Oct 04 18:12:05.390769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3072/3962] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:05.633135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.634902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.654805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:05.657405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.668843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.669397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.670638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.671176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.671627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.004570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.022008 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f620326e-931c-4c85-a971-5538858ac837 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.078965 Oct 04 18:12:06.024888 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 891/3963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.045469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.046518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.058446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.059825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.062066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.064605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.067275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.068904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.456146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.472627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.474414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.482017 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-68df35c3-b3ec-4a63-a937-da2d00517b46 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.455455 Oct 04 18:12:06.483077 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 892/3964] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:06.835937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.901890 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d67e9ee2-a090-413c-803c-823d0f14a073 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 1.273131 Oct 04 18:12:06.924696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3073/3965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:07.052652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.055074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.086184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.093449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.095400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.095400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.095400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.095814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.514594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.515817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.535125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.537259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.539177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.540443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.541251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.543520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.111148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.126515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.135221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.136691 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-781e9849-1e40-4c41-8715-236bf7cdc97f tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.626594 Oct 04 18:12:08.137791 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3074/3966] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:08.149672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.152339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.169313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.171585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.173358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.175647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.178759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.179415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.305352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.319968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a60c0109-7185-40be-bcaf-977d356ef8e9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1736 microversion: 2.1 time: 1.272737 Oct 04 18:12:08.323754 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 893/3967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1736 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.040477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.082564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-328565da-3d08-4059-b901-e6fc619e28f2 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 0.940600 Oct 04 18:12:09.083232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3075/3968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.169699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.170720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.195631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.196148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.196606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.197347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.197807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.198314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.350806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.351487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.363915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.372392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.375155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.376064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.376562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.377012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.620013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.645386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.646862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.661935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ca69e12-0df1-4d13-88b8-6fb305a22950 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.496396 Oct 04 18:12:09.662561 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 894/3969] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:09.760682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.784167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8145fb4c-c966-4040-a41c-cb04d24b6df9 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1716 microversion: 2.1 time: 0.437781 Oct 04 18:12:09.792190 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3076/3970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1716 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:09.840451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c", "tag": "020df383-fbc8-4ce5-8664-4c2697aa699b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:09.865043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.865889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.867546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.902210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] Creating event network-changed:020df383-fbc8-4ce5-8664-4c2697aa699b for instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c on n-h2-831193-17 Oct 04 18:12:09.920083 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2cb621e8-5fb0-472b-b6c6-8d860ddc8e48 req-98eceff9-50f6-4f51-b0b6-d905d26f792e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083554 Oct 04 18:12:09.921663 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 895/3971] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:10.093806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.095508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.108348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.119856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.120383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.120665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.128153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.129580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.130235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.130841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.143833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.146908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.150780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.151705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.152213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.152646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.260768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:10.477708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Cannot 'detach_volume' instance c06de75c-4497-40f4-8b8f-be8f62545404 while it is in vm_state rescued Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments/6aaab1e7-04bf-4e71-9769-c57415e33c38 HTTP/1.1 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'detach_volume' instance c06de75c-4497-40f4-8b8f-be8f62545404 while it is in vm_state rescued Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': 'c06de75c-4497-40f4-8b8f-be8f62545404', 'id': '6aaab1e7-04bf-4e71-9769-c57415e33c38'} Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c06de75c-4497-40f4-8b8f-be8f62545404 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c06de75c-4497-40f4-8b8f-be8f62545404 while it is in vm_state rescued Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.484766 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c06de75c-4497-40f4-8b8f-be8f62545404 while it is in vm_state rescued Oct 04 18:12:10.489121 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.497950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 409 to user: Cannot 'detach_volume' instance c06de75c-4497-40f4-8b8f-be8f62545404 while it is in vm_state rescued {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:10.500728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d2d294b-9a17-467f-a0c8-1c092bd01ef3 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments/6aaab1e7-04bf-4e71-9769-c57415e33c38" status: 409 len: 152 microversion: 2.1 time: 0.411950 Oct 04 18:12:10.507349 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3077/3972] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:12:10 2022] DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments/6aaab1e7-04bf-4e71-9769-c57415e33c38 => generated 152 bytes in 419 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:12:10.519711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f787d-8ec9-449d-b4ec-38788e567a00", "name": "network-vif-plugged", "status": "completed", "tag": "f24ed6b2-0576-4411-8c0a-681466a25d32"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:10.543587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.546726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.547504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.576785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] Creating event network-vif-plugged:f24ed6b2-0576-4411-8c0a-681466a25d32 for instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 on n-h1-831193-17 Oct 04 18:12:10.587582 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c02fb8e8-2459-460a-9853-1614a0c73906 req-1809b52c-7f95-42a0-98c4-22d82e22e178 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078046 Oct 04 18:12:10.589184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3078/3973] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:10.603390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:10.604573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.622004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.622777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.623762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.626019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.628011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.628724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.804321 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8eb7ab7d-a093-40ac-88ed-e616e5f44f30 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/action" status: 202 len: 0 microversion: 2.1 time: 0.209031 Oct 04 18:12:10.807683 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3079/3974] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:10 2022] POST /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:10.826999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.833182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.851389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.853406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.856191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.869445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.869970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.870492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.890157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.911128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.913263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.914991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef6f0df7-749a-40f9-b2e1-49123577f928 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 1.105587 Oct 04 18:12:11.939898 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3080/3975] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:11.949292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.951321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.952144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.968510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.971844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-216065d7-8bb0-4336-8ec6-d7c36ca721a7 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 1.869851 Oct 04 18:12:11.975371 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 896/3976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:11.981723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.982527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.983637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.987065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.987672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.564517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.574065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19148183-099b-4583-a382-7e615d59c834 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1724 microversion: 2.1 time: 0.632650 Oct 04 18:12:12.600128 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3081/3977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1724 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:12.945796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.951591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.963274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.976578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.977371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.980153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.981821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.983276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.001520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.002556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.014592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.026882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.027989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.028923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.033256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.034356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.405488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.417837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.419940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.421366 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2f26c0ea-f7d8-4d41-b136-ddf9550944d4 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.479457 Oct 04 18:12:13.422943 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 897/3978] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:13.607054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.609099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.624967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.627714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.628359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.629422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.631834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.634456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.863261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.877305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b991aeb7-3574-4d2d-8c45-d854b4cc1d42 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 0.879414 Oct 04 18:12:13.881031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3082/3979] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:13.902946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c73652-1207-48ae-bd4f-a919a88ef265", "name": "network-vif-plugged", "status": "completed", "tag": "313c4102-2c20-4e80-91a7-488bf542f5d0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:13.924325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.925920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.927514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.954359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] Creating event network-vif-plugged:313c4102-2c20-4e80-91a7-488bf542f5d0 for instance 38c73652-1207-48ae-bd4f-a919a88ef265 on n-h2-831193-17 Oct 04 18:12:13.971658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3e562f47-84ee-4834-a300-2da47bd135e3 req-ca68056f-2e31-4edf-9fcf-e4ffbf25e812 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088863 Oct 04 18:12:13.975359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3083/3980] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:14.099461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.109958 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b298ecf-9bec-4939-8903-2f6638f4b2f8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1724 microversion: 2.1 time: 0.506814 Oct 04 18:12:14.119284 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 898/3981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:14.455637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.456510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.494399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.495225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.495873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.497021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.497679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.498690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.677605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.687357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:14.697149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.702207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.703510 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4978de45-b4d3-4c76-808d-e01321902914 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.254507 Oct 04 18:12:14.725888 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3084/3982] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:14.905231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.905860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.918478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.918985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.919462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.920183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.920647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.921080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.146465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.147347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.166186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.167148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.167826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.169110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.169809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.170465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.550953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.560541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fb38b968-b56c-4c27-ba6b-993cc021016e tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1317 microversion: 2.1 time: 0.659069 Oct 04 18:12:15.580106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 899/3983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.734434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.736752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.751828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.753029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.756621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.757583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.758590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.760446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.772075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.781822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c47b009e-0162-4975-953e-74aa5a44d9c5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1724 microversion: 2.1 time: 0.640879 Oct 04 18:12:15.800236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3085/3984] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1724 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.886767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.900362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.903779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.905303 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-67bf40b3-6c1e-4d68-944a-a28b262bed4b tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.179451 Oct 04 18:12:15.906372 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 900/3985] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:16.593467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.594145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.621198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.621783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.629083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.630020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.630500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.630945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.816413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.818085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.836377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.837294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.846329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.849368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.850737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.851583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.082261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.099824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5a96268-5a7b-4daf-8c2c-a8c3c0b16038 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 200 len: 1505 microversion: 2.1 time: 0.510969 Oct 04 18:12:17.111073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3086/3986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:17.111073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.111073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.121875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.121875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.121875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.122509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.122974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.123561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.317548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.332738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3d599eb-087a-48dd-af4e-bbc853a6dd55 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1730 microversion: 2.1 time: 0.518800 Oct 04 18:12:17.343736 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 901/3987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1730 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:17.355970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.358304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.389760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.391761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.393023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.393809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.394277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.394706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.403461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.416759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.418230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.442489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50297823-7a2f-4b27-8735-2c38dfaddb8a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.317689 Oct 04 18:12:17.443575 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3087/3988] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:17.456463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.459866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.476322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.477144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.477909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.478808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.479454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.480047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.662891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.671559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0ef0718-cfbe-4532-8426-0d273650b2d3 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 200 len: 1506 microversion: 2.1 time: 0.326061 Oct 04 18:12:17.681071 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 902/3989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:17.711700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.712224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.722135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-052885b3-f5c7-4885-a04e-51bf5a1ca4d8 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276256 Oct 04 18:12:17.722741 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3088/3990] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:17.724320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.725410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.726020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.727638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.728347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.729048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.835017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:17.967438 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc04eee4-d885-4818-ae53-719592ac53ea tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 204 len: 0 microversion: 2.1 time: 0.259709 Oct 04 18:12:17.968632 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 903/3991] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:17 2022] DELETE /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:17.977190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.978237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.991671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.992364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.994091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.995006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.997286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.999660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.055086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:18.257843 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-393b1477-8acf-40a4-8ba6-438c214d3c0d tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 204 len: 0 microversion: 2.1 time: 0.282823 Oct 04 18:12:18.259696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3089/3992] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:17 2022] DELETE /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:18.269950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.270975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.279591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.280404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.280850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.281566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.282733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.283216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.476784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.478176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.494144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.495539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.497625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.498612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.501660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.503814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.775962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.795704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.796181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.800903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.804167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37257263-eda6-4d32-ac94-ac0c1c416446 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.333278 Oct 04 18:12:18.806946 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3090/3993] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:18.826496 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aaac31af-98b0-4be7-809f-24bd2ee4d0d0 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 200 len: 1512 microversion: 2.1 time: 0.562090 Oct 04 18:12:18.844732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 904/3994] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:19.770930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:19.793590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.801049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.801889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.834401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.835023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.858501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.863165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.867296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.869004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] Creating event network-changed:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:12:19.871152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.871663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.876566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.893560 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a4ddbad6-8e16-41ce-ad65-aeab730c8e2c req-20f19f03-fc1c-47fa-8f0d-8ae16b7d222e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128321 Oct 04 18:12:19.898232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3091/3995] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:19.915058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.919700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.943957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.944477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.947389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.948191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.948677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.949114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.259415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.278301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.282948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.286137 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3ad80ec-5fe5-4199-9ba3-7f7c3126c30a tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.458029 Oct 04 18:12:20.290221 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 905/3996] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:20.975384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.989062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f270f55f-d7eb-4fd8-8314-2c620c7c68ab tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 200 len: 1512 microversion: 2.1 time: 1.089437 Oct 04 18:12:21.008844 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3092/3997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 1512 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.272546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f787d-8ec9-449d-b4ec-38788e567a00", "name": "network-vif-deleted", "tag": "f24ed6b2-0576-4411-8c0a-681466a25d32"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:21.305341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.305835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.306275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.319536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.320320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.342368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.342958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.343443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.352398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.352924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.353377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.376648 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] Creating event network-vif-deleted:f24ed6b2-0576-4411-8c0a-681466a25d32 for instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 on n-h1-831193-17 Oct 04 18:12:21.394539 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c205f6d8-afcd-4009-ac5d-8c245ded91fa req-f91e1f1a-bd17-477a-b75a-dbb20350593d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128492 Oct 04 18:12:21.404284 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 906/3998] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:21.554859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.571924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.585635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.590538 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c5960bd-312c-4bc9-bed3-a6da5631d354 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.274954 Oct 04 18:12:21.592873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3093/3999] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:21.991301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}, {"server_uuid": "38c73652-1207-48ae-bd4f-a919a88ef265", "name": "network-vif-deleted", "tag": "313c4102-2c20-4e80-91a7-488bf542f5d0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:22.013827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.014470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.023479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.023479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.023479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.038155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.038577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.039399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.042075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.043547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.048555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.082144 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Creating event network-changed:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:12:22.083076 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] Creating event network-vif-deleted:313c4102-2c20-4e80-91a7-488bf542f5d0 for instance 38c73652-1207-48ae-bd4f-a919a88ef265 on n-h2-831193-17 Oct 04 18:12:22.110951 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-cfa04c18-621c-4dcc-b7f2-a9377c1f8857 req-1d018dc1-2c7e-46f2-82a7-567d2ae22faa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.121167 Oct 04 18:12:22.112627 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 907/4000] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:22.189820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.192208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.193952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.195900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lazy-loading 'fault' on Instance uuid 2b7f787d-8ec9-449d-b4ec-38788e567a00 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:22.334034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec6b5be8c454b37b347e297344bee37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a56014897c4ceabc35e431c73493b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.352952 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2ccd6d5-9b2f-426f-ba72-ab3039b3f265 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 200 len: 1307 microversion: 2.1 time: 0.340248 Oct 04 18:12:22.353593 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3094/4001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:22.622068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.623877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.639340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.641913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.643598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.645283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.648237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.653451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.384857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.386208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 2b7f787d-8ec9-449d-b4ec-38788e567a00] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.399733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.400544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.401696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.403657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.406862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.408505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.410919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.413856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.418089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.421341 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ca510cc-9dba-4c5a-8f2d-d7fc43537715 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.804180 Oct 04 18:12:23.423274 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 908/4002] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:23.443912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] HTTP exception thrown: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Request method failure captured: Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 HTTP/1.1 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHc_ZM0JSe6O9UUVnwHFcRoU2y-4Svbz1h1GXoa0UvEzqT2IKwGcVSelaSOJfxNsfgH7qZwz6qfieQr5m2P8DPGPUK-TgRdKw2K2i0ZtAdV8eTO6kJMxk4w2KCUDWFDLjtF4LMq7g7hLydIcVoMUPld-rnMv6fX9JUW6ab6lZp14tLw Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 93a56014897c4ceabc35e431c73493b4 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93a56014897c4ceabc35e431c73493b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 93a56014897c4ceabc35e431c73493b4 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-MultipleCreateTestJSON-1900042478-project Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: cec6b5be8c454b37b347e297344bee37 Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-MultipleCreateTestJSON-1900042478-project Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2b7f787d-8ec9-449d-b4ec-38788e567a00'} Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.477054 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Returning 404 to user: Instance 2b7f787d-8ec9-449d-b4ec-38788e567a00 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3b9d323-8bff-4303-8c1d-3c1b910386d4 tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00" status: 404 len: 111 microversion: 2.1 time: 0.101561 Oct 04 18:12:23.481929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3095/4003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/2b7f787d-8ec9-449d-b4ec-38788e567a00 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:23.490010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.490744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] [instance: 38c73652-1207-48ae-bd4f-a919a88ef265] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.496972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.506376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.506845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.507645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.508115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.508545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.580976 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] HTTP exception thrown: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Request method failure captured: Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 HTTP/1.1 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHc_ZM0JSe6O9UUVnwHFcRoU2y-4Svbz1h1GXoa0UvEzqT2IKwGcVSelaSOJfxNsfgH7qZwz6qfieQr5m2P8DPGPUK-TgRdKw2K2i0ZtAdV8eTO6kJMxk4w2KCUDWFDLjtF4LMq7g7hLydIcVoMUPld-rnMv6fX9JUW6ab6lZp14tLw Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 93a56014897c4ceabc35e431c73493b4 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93a56014897c4ceabc35e431c73493b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93a56014897c4ceabc35e431c73493b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 93a56014897c4ceabc35e431c73493b4 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1900042478 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-MultipleCreateTestJSON-1900042478-project Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: cec6b5be8c454b37b347e297344bee37 Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-MultipleCreateTestJSON-1900042478-project Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '38c73652-1207-48ae-bd4f-a919a88ef265'} Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.582680 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] Returning 404 to user: Instance 38c73652-1207-48ae-bd4f-a919a88ef265 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b85aa3c2-fc3e-45c8-9bf8-0c0f536278ad tempest-MultipleCreateTestJSON-1900042478 tempest-MultipleCreateTestJSON-1900042478-project] 10.222.0.33 "GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265" status: 404 len: 111 microversion: 2.1 time: 0.099336 Oct 04 18:12:23.588461 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 909/4004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/38c73652-1207-48ae-bd4f-a919a88ef265 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:24.457528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:24.458892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:24.477041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.479438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.481749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.482596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.483444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.485980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.644471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.672723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.678242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.682235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f84283a-d155-4287-89c1-bff6a84b714d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.231106 Oct 04 18:12:24.685310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3096/4005] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:24 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:25.717301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.717919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.738094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.738588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.739059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.739760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.740217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.746209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.912924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.933288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.937290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.939194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3c793c3-53a6-4db1-ac0e-a5e6b643404d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.225893 Oct 04 18:12:25.946704 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 910/4006] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:25 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:26.973303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.975660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.984059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.985698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.986328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.987332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.987959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.988554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.234849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.255911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.257989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.259461 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-073c1dc4-a708-4479-b41b-01f533d53367 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.291072 Oct 04 18:12:27.260507 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3097/4007] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:28.287767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.288384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.292333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:28.312373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.315457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.317110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.323173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.324065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.326429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.557209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.577280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.586698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd608be5dc41f4cc486dfe306b72ab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e65f5db8d314ebb8ccc0d1f517cc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.591723 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-66cc4234-6086-4b6d-883e-58a204cc1000 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 200 len: 1605 microversion: 2.32 time: 0.308590 Oct 04 18:12:28.593041 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 911/4008] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:29.628139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.628842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:29.654967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.655502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.655947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.656727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.657156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.657594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.708237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] HTTP exception thrown: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Request method failure captured: Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 HTTP/1.1 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHX-qJgT6KWlU5nqN2Vg5pGT7noUKAoxG4i8KhZceZqTSkeOWnwxLLP3u4PCaFdyOZxU_Nv3-DveaIFcXcPg8JiUu8mafZUx_NSFF2gn1LVNZy3RedHtK0BxFsRB09MO1yYwlvihTyuawPngbzfrNYHU0D-uj-p7xONpg1AnZ-oVPEI Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d608be5dc41f4cc486dfe306b72ab8da Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c63e3a18-7a79-4fae-84af-f259ddb86963'} Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:29.710154 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:29.714566 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:29.718332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Returning 404 to user: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:29.719645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16fb2a86-be75-41b2-9535-376e8c3de5fc tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 404 len: 111 microversion: 2.32 time: 0.101091 Oct 04 18:12:29.720418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3098/4009] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:29 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:29.730272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7e48d2a1-b0b3-41fa-be46-a6cce8a2e87d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '.version_select at 0x7f6342096040>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.765457 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7e48d2a1-b0b3-41fa-be46-a6cce8a2e87d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110894610" status: 204 len: 0 microversion: 2.32 time: 0.040045 Oct 04 18:12:29.773282 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 912/4010] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 18:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110894610 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:12:35.662738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.663415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.677871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.679860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.680404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.683202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.683785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.685044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.756900 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c9fbb84-ce44-403f-9ab0-795317844cf1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/ips" status: 200 len: 150 microversion: 2.1 time: 0.092793 Oct 04 18:12:35.764918 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3099/4011] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/ips => generated 150 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:36.611627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.612271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.626750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.627771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.629917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.632161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.633317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.634174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.669135 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] HTTP exception thrown: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Request method failure captured: Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 HTTP/1.1 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHX-qJgT6KWlU5nqN2Vg5pGT7noUKAoxG4i8KhZceZqTSkeOWnwxLLP3u4PCaFdyOZxU_Nv3-DveaIFcXcPg8JiUu8mafZUx_NSFF2gn1LVNZy3RedHtK0BxFsRB09MO1yYwlvihTyuawPngbzfrNYHU0D-uj-p7xONpg1AnZ-oVPEI Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: d608be5dc41f4cc486dfe306b72ab8da Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c63e3a18-7a79-4fae-84af-f259ddb86963'} Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:36.673382 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.678497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.683472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Returning 404 to user: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:36.684545 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7ea4f52a-1c47-4e13-8560-c3bbc32a3e2d tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 404 len: 111 microversion: 2.32 time: 0.078111 Oct 04 18:12:36.685338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 913/4012] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:12:36 2022] DELETE /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:36.694465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.695715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] [instance: c63e3a18-7a79-4fae-84af-f259ddb86963] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.698616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:36.723917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.724806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.725979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.735202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.735920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.736551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.782444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] HTTP exception thrown: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Request method failure captured: Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 HTTP/1.1 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHX-qJgT6KWlU5nqN2Vg5pGT7noUKAoxG4i8KhZceZqTSkeOWnwxLLP3u4PCaFdyOZxU_Nv3-DveaIFcXcPg8JiUu8mafZUx_NSFF2gn1LVNZy3RedHtK0BxFsRB09MO1yYwlvihTyuawPngbzfrNYHU0D-uj-p7xONpg1AnZ-oVPEI Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e65f5db8d314ebb8ccc0d1f517cc3a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5e65f5db8d314ebb8ccc0d1f517cc3a5 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103332002 Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d608be5dc41f4cc486dfe306b72ab8da Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TaggedBootDevicesTest-1103332002-project Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c63e3a18-7a79-4fae-84af-f259ddb86963'} Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.792989 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. Oct 04 18:12:36.797795 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.810745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] Returning 404 to user: Instance c63e3a18-7a79-4fae-84af-f259ddb86963 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:36.811944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73c15d4b-ace0-4e7d-9b57-14cad2c6eb65 tempest-TaggedBootDevicesTest-1103332002 tempest-TaggedBootDevicesTest-1103332002-project] 10.222.0.33 "GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963" status: 404 len: 111 microversion: 2.32 time: 0.121638 Oct 04 18:12:36.817217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3100/4013] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/c63e3a18-7a79-4fae-84af-f259ddb86963 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:38.652738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62e38145-f411-4776-a2ef-d27083df7381"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:38.655786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.674512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.675331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.675994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.677228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.677902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.678551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.907405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:39.198128 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b3d1688-86ef-460b-953c-9924b610b30c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549793 Oct 04 18:12:39.201615 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 914/4014] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:12:38 2022] POST /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:44.585889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-296240083", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:44.655127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] validate_networks() for [('46b6949a-dd95-4566-a085-d4968e6d76bb', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:45.683507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:45.684557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:45.685256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:45.685668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:45.686088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:45.703714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.705746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.707129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.710500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.713517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.714562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.748578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:45.782069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Getting quotas for project 25aac5259dfb40dbb5efa48d37547e62. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:45.796005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Getting quotas for user f822a74c50124a08b1c144f3083597a7 and project 25aac5259dfb40dbb5efa48d37547e62. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:45.832048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:45.847684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:45.964308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d138895-feed-45a6-886f-2ded5a8c0e99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.846234 Oct 04 18:12:45.964978 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3101/4015] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:45.977520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-80ae5afa-64ab-4842-8611-7553e336c2de tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.979409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-80ae5afa-64ab-4842-8611-7553e336c2de tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.109979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-80ae5afa-64ab-4842-8611-7553e336c2de tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.121582 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-80ae5afa-64ab-4842-8611-7553e336c2de tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1222 microversion: 2.1 time: 0.148350 Oct 04 18:12:46.127177 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 915/4016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:47.155586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.156267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.167570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.168069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.168514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.176632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.181027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.181511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.381284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.389824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb93423e-97ef-4686-a1ca-ab8ce730d12b tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1274 microversion: 2.1 time: 0.239277 Oct 04 18:12:47.390408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3102/4017] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:48.419252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:48.422608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:48.440469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.443379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.443949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.444787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.445249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.462252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.630935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.644154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6dee6083-d931-46ae-a41e-c9bc81736536 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1280 microversion: 2.1 time: 0.230268 Oct 04 18:12:48.645181 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 916/4018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:48 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.673210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.675501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.688868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.689364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.689809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.690514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.691672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.692216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.044149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.063855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1dcae600-ff08-4bb7-bc23-e70749020b09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.393169 Oct 04 18:12:50.067168 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3103/4019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:50.340016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.340839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.358225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.360734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.361204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.364953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.366000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.367938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.449272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:50.471871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.472363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.472801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.497002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] Creating event network-changed:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:12:50.516874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4a536c98-9872-4118-939e-9bf5d6f21796 req-d69d2e88-5d44-4b78-a3e8-15df432c60e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070666 Oct 04 18:12:50.517894 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3104/4020] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:50.580434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'services' on Instance uuid c06de75c-4497-40f4-8b8f-be8f62545404 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:50.836501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e45f22f-f694-4dd7-a639-76dfb5b402f0 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments/6aaab1e7-04bf-4e71-9769-c57415e33c38" status: 202 len: 0 microversion: 2.1 time: 0.501386 Oct 04 18:12:50.838726 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 917/4021] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:12:50 2022] DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments/6aaab1e7-04bf-4e71-9769-c57415e33c38 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:50.848753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.853099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.874690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.880864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.881518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.882685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.883775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.884711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.956301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90f81391-59e4-4cdc-8be6-3d856d812885 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113170 Oct 04 18:12:50.959654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3105/4022] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:51.116934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.118588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.149854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.153803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.154516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.157092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.158523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.160377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.501018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.520275 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31a279ca-9b83-4033-9e68-47766c86afc5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.417369 Oct 04 18:12:51.520967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 918/4023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:51.968970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.971022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.981007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.981507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.981958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.982666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.991230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.991779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.060416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b479c24a-efba-4abc-b128-3a0cbba95df5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095454 Oct 04 18:12:52.064133 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3106/4024] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:52.560532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.562112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.582556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.584536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.585722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.587884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.590118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.591755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.917246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.940662 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b69e5eea-1500-4384-980b-9b7a01bf8839 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.397743 Oct 04 18:12:52.944936 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 919/4025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:53.081843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.087415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.114094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.115405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.116124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.118921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.121803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.126540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.242862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-223badcc-9eaa-4e5f-82fa-324cee8e2159 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171174 Oct 04 18:12:53.243415 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3107/4026] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:53.971694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.972547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.989038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.990755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.991419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.993280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.996692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.005545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.245167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.260437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:54.267363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:54.273815 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a45a984b-9a07-48dd-8dc6-14c89811fb1c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.307386 Oct 04 18:12:54.275329 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 920/4027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:54.294840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.295598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.296361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.297223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.300672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.301219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.351318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1fa7b82b-f5a8-4616-822e-2699982232d5 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099629 Oct 04 18:12:54.352862 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3108/4028] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:55.125426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "name": "network-vif-plugged", "status": "completed", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:55.152419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.152912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.153350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.197287 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] Creating event network-vif-plugged:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:12:55.208971 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e93cb326-cb99-475e-9879-f140f1b7f657 req-d1680b4c-42b7-4591-8567-7bff748b8b97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094262 Oct 04 18:12:55.209768 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 921/4029] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:55.299941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.300574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.316782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.317294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.317922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.318581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.319199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.319648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.367340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.369746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.390828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.391630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.392100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.403853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.406574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.407068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.510118 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a218cf72-b3d8-44ea-92ff-25e53feb0aab tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148725 Oct 04 18:12:55.511488 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 922/4030] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:55.602359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.610925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49c90ea8-5a59-4af6-aae7-e1ababb8e070 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.314943 Oct 04 18:12:55.613408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3109/4031] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:56.524183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.531481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-846947560", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "0f4b44f7-0ef4-4ddc-9402-93923f0eddc7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:56.534480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.554352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:56.558532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.558532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.558532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.559059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.559532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.559957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.567515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:56.568241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:56.658199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] validate_networks() for [('0f4b44f7-0ef4-4ddc-9402-93923f0eddc7', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:56.659192 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6bd176a8-6c36-4f10-a1f0-152ca9822564 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139004 Oct 04 18:12:56.663706 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 923/4032] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:56.673864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.674484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.686979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.688162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.689353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.690384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.691130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.691763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.011739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.036104 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a30ca0f-d735-4d8e-b368-791a9d0e6111 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1322 microversion: 2.1 time: 0.355773 Oct 04 18:12:57.043719 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 924/4033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.525590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:57.525866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:57.526343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:57.526758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:57.527882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:57.544206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.544884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.545135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.545873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.546332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.549289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.576311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Getting quotas for project 54ae765ee8d840a183c31042c04a77e7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:57.583766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Getting quotas for user ab24f5754daf4459b3ffabc071d436bf and project 54ae765ee8d840a183c31042c04a77e7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:57.596545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:57.598863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:57.650763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0219814-560d-4c7c-a642-00b7a93b2fac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123998 Oct 04 18:12:57.651763 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3110/4034] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:57.662609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e2d79f5-51fc-425f-aab7-832c3020dbdb tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.663386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e2d79f5-51fc-425f-aab7-832c3020dbdb tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.675408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.678143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.687003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.688313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.689017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.689895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.690582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.691157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.727870 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f00ddf80-7e40-46cc-9394-c6795f291237 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059705 Oct 04 18:12:57.734876 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3111/4035] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:57.822140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e2d79f5-51fc-425f-aab7-832c3020dbdb tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.831536 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e2d79f5-51fc-425f-aab7-832c3020dbdb tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1218 microversion: 2.1 time: 0.172446 Oct 04 18:12:57.835288 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 925/4036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:58.066484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.067149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.075974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.086228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.086337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.087076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.087768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.088213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.388010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.401823 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-054a232b-cb12-4f92-a824-227044b486ba tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1517 microversion: 2.1 time: 0.340282 Oct 04 18:12:58.402854 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3112/4037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:58.426827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:58.429046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.442718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:58.447071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.447648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.450086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.450877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.452979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.453476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.522894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lazy-loading 'flavor' on Instance uuid 92f60ae7-f333-4429-88eb-543c71734fe1 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:58.670442 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fc493f6d-ec53-4659-b7a3-d81a62a10b02 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action" status: 200 len: 32 microversion: 2.1 time: 0.248798 Oct 04 18:12:58.672384 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 926/4038] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:58 2022] POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:12:58.682502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.683700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.694350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.694855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.696174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.696903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.697776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.698224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.742051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.746838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.791792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.792287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.792740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.799549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.800173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.801737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.876238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e56f84f7-c095-4942-8456-9ae9d607de42 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138799 Oct 04 18:12:58.877644 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 927/4039] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:58.882746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.883708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.891711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.892333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.892878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.893690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.894398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.895094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.982831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.994263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1eff4498-975f-498d-af57-2d71f33656e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.315666 Oct 04 18:12:58.997057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3113/4040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:59.000863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.014939 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a390c6c5-da6c-4034-92ff-3fe81a6ba935 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1270 microversion: 2.1 time: 0.135947 Oct 04 18:12:59.016569 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 928/4041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:59.890111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.893301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.902953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.914793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.917799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.918897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.919670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.922401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.997892 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73ef66fd-8ae5-4e11-9f4c-22933a9cfa84 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112186 Oct 04 18:12:59.999245 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3114/4042] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:00.025560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:00.027664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:00.041305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:00.042377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:00.044699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.050821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.052686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.054159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.055578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.055831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.056342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.056789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.057507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.057975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.058405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.058614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.159117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.172431 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c7b583a5-53ec-42bc-8927-06a9083e8b68 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1276 microversion: 2.1 time: 0.134690 Oct 04 18:13:00.174938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3115/4043] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:00 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:00.360519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.369142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-02a448ce-7991-4df8-a3db-b64abf9d46af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.353590 Oct 04 18:13:00.369794 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 929/4044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:00 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:00.663356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cb40e3d-b330-402b-a8a1-e4cafbc594bd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: .version_select at 0x7f63401659d0>, body: {"keypair": {"name": "tempest-keypair-1058304868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBsFqZ62Cffrz5HcTd89hCMYGAnePGhSQfQlYFZB4N3it8cE9ftzmk7noK+IoZ9sGGKYfH2MPiedHHNtdzvzD1fGx1jhxon84fq3kEJ7cAZ55CmT8j6XUQTO54FUSu8SQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:00.685100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4cb40e3d-b330-402b-a8a1-e4cafbc594bd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:00.694093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-4cb40e3d-b330-402b-a8a1-e4cafbc594bd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:00.731224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cb40e3d-b330-402b-a8a1-e4cafbc594bd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073021 Oct 04 18:13:00.732705 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3116/4045] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:13:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:01.014359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.021369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.043273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.043833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.045124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.048109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.050410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.051179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.115859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:01.131073 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1453a753-a8a4-43d2-ab6c-a9a35a240c25 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123922 Oct 04 18:13:01.131695 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 930/4046] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:01.202501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.203195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.218861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.224200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.226370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.228910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.230531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.231893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.395243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.396167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.403781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.404540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.405186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.406675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.407568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.408256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.133854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.162088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68fb84d9-2b3c-4159-bf86-8771c8b04c93 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.963766 Oct 04 18:13:02.163627 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3117/4047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:02.168936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.172230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.180001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.180798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.181512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.182508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.183295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.184142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.226094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f5a6cb7-6c82-4c16-8b92-d95b6605af65 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061080 Oct 04 18:13:02.227877 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3118/4048] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:13:02 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:02.331914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.366942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:02.368059 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1bc9dd20-dde3-41b1-8149-4d4606b89784 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.972645 Oct 04 18:13:02.369208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.369338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 931/4049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:02.381008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.382114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.398112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.400715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.401219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.401663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.436702 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Cannot 'reboot' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action HTTP/1.1 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 28 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: {"reboot": {"type": "HARD"}} Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'reboot' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0fc6d772-4435-4ee5-995a-b0ba25de7df2', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:13:02.440612 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.445782 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.448331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 409 to user: Cannot 'reboot' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:02.449719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd926924-ee1a-4ffd-ae22-b3292376a356 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action" status: 409 len: 145 microversion: 2.1 time: 0.087767 Oct 04 18:13:02.455785 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3119/4050] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:02 2022] POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:13:02.460348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:02.463265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.474647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.475451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.476062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.477034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.477687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.479341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.518204 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Cannot 'rebuild' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action HTTP/1.1 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 65 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'rebuild' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '0fc6d772-4435-4ee5-995a-b0ba25de7df2', 'body': {'rebuild': {'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857'}}} Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:02.521503 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued Oct 04 18:13:02.526637 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.537636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 409 to user: Cannot 'rebuild' instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 while it is in vm_state rescued {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:02.540210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-47cf88f6-4c0c-4ed8-9ea9-f61e3e0f9c71 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action" status: 409 len: 146 microversion: 2.1 time: 0.082605 Oct 04 18:13:02.545248 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 932/4051] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:02 2022] POST /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2/action => generated 146 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:13:02.558860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.560612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.589109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.590063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.592031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.595744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.597403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.598043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.685986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:02.702722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:02.826966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d0de20d-198d-4a5c-b648-41547a8137fb tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 204 len: 0 microversion: 2.1 time: 0.277831 Oct 04 18:13:02.840764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3120/4052] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:02 2022] DELETE /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:02.849339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.850106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.860190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.860909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.862099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.864617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.866182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.867116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.200097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.202306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.234503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.239194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.239791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.241764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.242335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.242832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.352863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.371314 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-541b00d5-6d9b-4b51-8956-3ce7d44378f7 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1690 microversion: 2.1 time: 0.520833 Oct 04 18:13:03.371963 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 933/4053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:02 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1690 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:03.389745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab290747-63ae-4936-a904-a09687e4af13", "tag": "c9866a0b-7194-4014-ba95-9373e6a8fef6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:03.411560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.415105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.418589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.442103 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] Creating event network-changed:c9866a0b-7194-4014-ba95-9373e6a8fef6 for instance ab290747-63ae-4936-a904-a09687e4af13 on n-h2-831193-17 Oct 04 18:13:03.457173 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f76b7839-ca18-4718-92f3-f32e5f3bb16f req-d01f0929-695b-4447-b0f6-1cd74e775a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083161 Oct 04 18:13:03.458081 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 934/4054] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:03.469578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.470301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.483213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.483717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.484209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.484932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.489991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.490659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.993339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.004157 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-21b12b72-8cea-4bcf-a171-e5116bf5587c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.544387 Oct 04 18:13:04.004743 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 935/4055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:04.232877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.246056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f32b6bd-1899-48b7-bdc7-5273295f4eb6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 1.059734 Oct 04 18:13:04.247531 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3121/4056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:04.400232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.401684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.410797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.416427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.417069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.418759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.422064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.422966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.592799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2044148316", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "026cefdc-3a81-4fee-9860-a3ebae88796b"}], "security_groups": [{"name": "tempest-securitygroup--171707028"}], "key_name": "tempest-keypair-1058304868", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:04.958285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] validate_networks() for [('026cefdc-3a81-4fee-9860-a3ebae88796b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:05.012549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.023687 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3068ae9a-9000-4f52-8713-711350ab943a tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1690 microversion: 2.1 time: 0.627336 Oct 04 18:13:05.029737 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 936/4057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1690 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:05.035109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.035902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.052347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.054223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.054857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.057346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.058011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.059780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.346569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.360047 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-acc09dfb-a7b2-40c3-a672-772fd139a3af tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.328942 Oct 04 18:13:05.360650 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 937/4058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:05.386598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.387316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.394388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.395147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.395829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.396693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.397311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.397897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.730216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.740268 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-185583a9-ca2a-48f9-9162-5e466f005609 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.357914 Oct 04 18:13:05.744679 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 938/4059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:05.787724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:05.788207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:05.788653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:05.789077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:05.789501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:05.808794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.809536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.810153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.811224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.811913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.813104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.836369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:05.844135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:05.860550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:05.862392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:05.866024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:05.962966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0641c792-0695-4654-b1c8-cb5b01a1ebc7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.375164 Oct 04 18:13:05.973419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3122/4060] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:13:05.978792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-936ffd85-a7b5-420e-b3c2-ffb64dd236ea tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.980149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-936ffd85-a7b5-420e-b3c2-ffb64dd236ea tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.051078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.051725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.069637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.074596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.076580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.078328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.078447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.079001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.183795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-936ffd85-a7b5-420e-b3c2-ffb64dd236ea tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.191148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-936ffd85-a7b5-420e-b3c2-ffb64dd236ea tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1242 microversion: 2.1 time: 0.217268 Oct 04 18:13:06.195397 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 939/4061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1242 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:06.388248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.388878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.404921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.405420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.405808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.411102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.413665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.414318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.554279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.572592 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f067d732-95b3-4c78-9007-ff7af912d96c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1690 microversion: 2.1 time: 0.525512 Oct 04 18:13:06.575335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3123/4062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1690 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:06.769930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.771093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.781468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.785204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.786084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.787080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.791954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.793531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.855593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.874242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b94a2dc-3bd5-4e41-b71e-a798d228f8a3 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.491915 Oct 04 18:13:06.875442 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 940/4063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:07.219250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.220260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.230920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.231453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.231899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.239657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.240182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.240646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.372190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.382199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26abcd50-dbe0-40db-9ae9-18277c4d161e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.616214 Oct 04 18:13:07.382811 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3124/4064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:07.460329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.477289 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-434ffd5f-8ba0-4ece-ab73-6e9e20850605 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1238 microversion: 2.1 time: 0.263225 Oct 04 18:13:07.477907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 941/4065] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:07.603570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.604624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.613679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.614192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.614792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.615982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.616990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.617891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.829512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.840144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-446b9328-6451-4585-bba1-031aeb1fa873 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1690 microversion: 2.1 time: 0.240647 Oct 04 18:13:07.841251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3125/4066] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:07.898339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.899575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.907946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.908826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.909501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.910525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.911215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.911843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.406947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.407823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.419816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.420746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.421228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.422652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.423500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.426925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.765213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.782848 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a981ca6-6206-44ea-9d56-ccc8b8336d80 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.888480 Oct 04 18:13:08.784671 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 942/4067] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.799692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.800890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.820306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.821054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.821826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.824684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.828501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.830869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.045695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.061420 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ccc2af00-14d2-45d1-a716-9bb5c5ef3c4c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1300 microversion: 2.1 time: 0.275406 Oct 04 18:13:09.064489 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 943/4068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.071809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.072738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.082849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.083863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.084555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.085512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.086191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.087526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.177129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.198624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7b62f6c-1444-4f99-9d55-f444780baca6 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.796468 Oct 04 18:13:09.215060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3126/4069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:09.215060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06de75c-4497-40f4-8b8f-be8f62545404", "name": "network-vif-deleted", "tag": "03561e92-811d-4daa-ab04-f44dd6f40dc2"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:09.238781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.239489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.240036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.272581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.284304 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d26a889c-91fa-49e0-986c-bf920ea10303 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 200 len: 1622 microversion: 2.1 time: 0.218496 Oct 04 18:13:09.302231 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 944/4070] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 1622 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.323706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] Creating event network-vif-deleted:03561e92-811d-4daa-ab04-f44dd6f40dc2 for instance c06de75c-4497-40f4-8b8f-be8f62545404 on n-h1-831193-17 Oct 04 18:13:09.340261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-15de2d62-087b-432a-bd59-0b7101fc5b6d req-55d53d5f-d0a5-45b9-8849-ef3b36595df0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136113 Oct 04 18:13:09.341319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3127/4071] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:09.810584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.812096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.823552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.824934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.826852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.829730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.830604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.831363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.090735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.091457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.103055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.103573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.104016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.104734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.105383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.105654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.262059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.274978 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65966456-578d-4386-b989-84d899348cb3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1300 microversion: 2.1 time: 0.188671 Oct 04 18:13:10.284940 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3128/4072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:10.298485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.299364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.306501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.307874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.308954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.309888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.310546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.312665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.701893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.710459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da39ecb0-2b50-4e70-a039-ce747c733ac1 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.906757 Oct 04 18:13:10.724656 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 945/4073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:10.739965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.740596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: c06de75c-4497-40f4-8b8f-be8f62545404] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.753132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.754458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.755133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.758697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.759455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.760565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.783291 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 HTTP/1.1 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c06de75c-4497-40f4-8b8f-be8f62545404'} Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.785946 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. Oct 04 18:13:10.791230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.794253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 404 to user: Instance c06de75c-4497-40f4-8b8f-be8f62545404 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:10.795680 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a885d064-1a96-4cce-ab83-58f83fb5d749 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404" status: 404 len: 111 microversion: 2.1 time: 0.070072 Oct 04 18:13:10.796898 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 946/4074] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/c06de75c-4497-40f4-8b8f-be8f62545404 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:10.807292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36d0388e-43b3-4e27-bbbb-c0d132d42866 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '.version_select at 0x7f6341056c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.835582 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36d0388e-43b3-4e27-bbbb-c0d132d42866 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523140279" status: 202 len: 0 microversion: 2.1 time: 0.034059 Oct 04 18:13:10.837192 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 947/4075] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523140279 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:10.837521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.847506 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-65a1766c-b0b0-4a32-8917-e5cb7abcb639 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.561038 Oct 04 18:13:10.848622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3129/4076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:11.300984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.301607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.323107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.323616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.324061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.324782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.325244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.325668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.569592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab290747-63ae-4936-a904-a09687e4af13", "name": "network-vif-plugged", "status": "completed", "tag": "c9866a0b-7194-4014-ba95-9373e6a8fef6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:11.602734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.604604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.605069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.636747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] Creating event network-vif-plugged:c9866a0b-7194-4014-ba95-9373e6a8fef6 for instance ab290747-63ae-4936-a904-a09687e4af13 on n-h2-831193-17 Oct 04 18:13:11.647323 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2c6aa531-27e2-4dcf-8744-fe6073321a98 req-219cf76f-45c7-48d1-afaa-c4c647201207 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085789 Oct 04 18:13:11.649835 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3130/4077] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:11.738610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.739626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.746851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.747391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.747836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.748550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.749058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.749443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.779500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.789005 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c861f24f-2a80-4a3d-8013-2b50a6cc0f9d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.492344 Oct 04 18:13:11.803054 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 948/4078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:11.871085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.873165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.880507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.881217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.881752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.882597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.883320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.883856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.233635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.250585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5c65494-85de-4687-97c3-3acc7e94ca53 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.515166 Oct 04 18:13:12.253060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3131/4079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.274361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.286183 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad3eed12-6d37-4948-93ba-8cd85784ed3e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1318 microversion: 2.1 time: 0.419627 Oct 04 18:13:12.286793 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 949/4080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.800994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c262ea-b902-4d9f-8138-a12f645e0112", "tag": "9c81383e-19a8-472f-ac22-291974519d84"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:12.827117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.832488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.850900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.852798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.863736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.864285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.864723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.881876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.884659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.884917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] Creating event network-changed:9c81383e-19a8-472f-ac22-291974519d84 for instance 69c262ea-b902-4d9f-8138-a12f645e0112 on n-h2-831193-17 Oct 04 18:13:12.885274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.887638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.893686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e3471a62-8187-4fcc-b4c3-67a1dc9e457b req-81f22253-bf4d-4abf-8dfc-4c3af94a291a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097538 Oct 04 18:13:12.894691 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3132/4081] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:13.280291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:13.283384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:13.296017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.300892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.301708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.302627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.303779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.304400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.448025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:13.450507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:13.460597 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2961ffb6-8344-453a-a981-0cc71422b793 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.651486 Oct 04 18:13:13.464009 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 950/4082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:13.478684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:13.480036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:13.500321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.501202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.502888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.504566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.507742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.508402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.443990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.461065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c491685a-cfee-4427-be18-3f2369d91dd4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 1.178936 Oct 04 18:13:14.468109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3133/4083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:13 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:14.488579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.489321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.503798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.504890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.505564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.512557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.513437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.514261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.549167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.563698 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f668a65-391e-4617-a294-1e8b88ddd442 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1507 microversion: 2.1 time: 1.095418 Oct 04 18:13:14.564586 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 951/4084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:13 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1507 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:15.028737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.046553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abc7bc09-7c20-41e7-b3e7-98520f0e89a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.562676 Oct 04 18:13:15.049297 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3134/4085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:15.487813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.488739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.496117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.496870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.497470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.498378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.498989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.500165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.847160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.857353 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5c23215b-cee6-4da2-bc38-271775f176d4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.376864 Oct 04 18:13:15.870648 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 952/4086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:16.072135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.072968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.083196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:16.085483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=16 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:16.091426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.092761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.094642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.097849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.099753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.101116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.676833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.685263 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de47ec60-01bc-49b3-92f1-b3903a51b31b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.617021 Oct 04 18:13:16.695331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3135/4087] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:16.894277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.903945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.906618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:16.921531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.922032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.922476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.923221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.923677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.924102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.568938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.586192 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-850afcb1-4b23-4cf6-a577-c4b6a976c7cd tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.694095 Oct 04 18:13:17.586733 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 953/4088] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.715351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.717205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.741965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.742782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.745235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.748156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.752715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.754496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.320953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.337728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-575d2284-e3d8-4755-bab6-958980761482 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.628915 Oct 04 18:13:18.339436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3136/4089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:18.613282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.613890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.620989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.622531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.623416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.624849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.625465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.626064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.922691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.930910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-24a2326d-6afe-4534-8f18-5637295cdabb tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.321812 Oct 04 18:13:18.931617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 954/4090] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.367500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.369421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.388686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.392213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.394993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.399775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.400284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.400737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.750928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.766408 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b231ccb-1da9-48b3-8399-e9816cba8324 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.404121 Oct 04 18:13:19.779457 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3137/4091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.958816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.960404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.970988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.972104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.973094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.974053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.975458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.976246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.165915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.177499 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d001cea5-1655-47a8-a245-5ee2a5decd48 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.222240 Oct 04 18:13:20.195076 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 955/4092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.732551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.733070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.753377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.753885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.754331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.755068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.758065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.758498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.794533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.795963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.816923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.828705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.828705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.828705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.831203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.838063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.881628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:20.895225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:21.153715 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96063114-99e3-40fa-b55a-893536df303b tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 204 len: 0 microversion: 2.1 time: 0.439988 Oct 04 18:13:21.154872 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3138/4093] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:20 2022] DELETE /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:21.174847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.178473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.191949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.200170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.200950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.202318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.204948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.206680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.837380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.855810 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e94d1ccf-f5f6-41ca-9cdf-ae5ffd4c8939 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 1.066475 Oct 04 18:13:21.856090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.862562 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 956/4094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.873673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1ac3977-3a55-443a-babd-b61280f77c5f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1508 microversion: 2.1 time: 0.713826 Oct 04 18:13:21.886795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.891856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3139/4095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1508 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.892023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.899324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c262ea-b902-4d9f-8138-a12f645e0112", "name": "network-vif-plugged", "status": "completed", "tag": "9c81383e-19a8-472f-ac22-291974519d84"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:21.910396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.910835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.912753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.913548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.914222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.914930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.915869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.916207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.916651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.940298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] Creating event network-vif-plugged:9c81383e-19a8-472f-ac22-291974519d84 for instance 69c262ea-b902-4d9f-8138-a12f645e0112 on n-h2-831193-17 Oct 04 18:13:21.952465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e62ed37e-c85d-46e5-a47e-822f71a2a146 req-ede3bb8a-d8b5-45d3-8445-009f5dd8e57e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058845 Oct 04 18:13:21.956403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3140/4096] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:22.471175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.484110 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df607665-3402-4a52-8944-6e2754e52e22 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.618431 Oct 04 18:13:22.484841 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 957/4097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.888066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.889289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.897953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.898852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.904285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.905109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.906321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.908054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.908706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.909578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.910753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.914956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.918351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.921400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.922232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.925775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.768144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.783063 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aaaaccbd-075e-4136-a66f-2265537f3e29 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1367 microversion: 2.1 time: 0.898113 Oct 04 18:13:23.783761 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3141/4098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.791627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.792770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.811339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.812870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.813071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.813809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.814829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.815511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.816169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.827997 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e95674f3-269d-4d9f-aae7-e01a86d72b05 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1508 microversion: 2.1 time: 0.929980 Oct 04 18:13:23.827997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 958/4099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1508 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:24.120718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.131424 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4c67c2e-6cad-47b6-a8aa-3debef971cdf tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.346442 Oct 04 18:13:24.144806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3142/4100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.602408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6d772-4435-4ee5-995a-b0ba25de7df2", "name": "network-vif-deleted", "tag": "e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:24.621281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.622079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.622874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.645307 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] Creating event network-vif-deleted:e64c0b0c-9c2c-477b-8ec7-afa73ca6ce71 for instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 on n-h1-831193-17 Oct 04 18:13:24.651861 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ac20751d-3869-4dd5-856c-4255ec0afdad req-cbe4f505-29f8-4851-ae2c-6ed4bc26e998 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052759 Oct 04 18:13:24.659018 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 959/4101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:24.805742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.806572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.814387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.816141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.816593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.817311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.817773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.818205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.857337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.858199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.886479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.886978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.891669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.892479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.892955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.893386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.985889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.986389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.988881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.989373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'fault' on Instance uuid 0fc6d772-4435-4ee5-995a-b0ba25de7df2 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:25.130793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.149925 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c3ec041-5f33-45fa-b697-814be15ab1ac tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 200 len: 1312 microversion: 2.1 time: 0.293987 Oct 04 18:13:25.164224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.185834 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 960/4102] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:25.191894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0d5e713-6708-499b-9837-68af7a935537 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1558 microversion: 2.1 time: 0.389653 Oct 04 18:13:25.197152 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3143/4103] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:25.201787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.204488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.223321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.224117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.225294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.226254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.226968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.228499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.229014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.229599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.235441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.236158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.236964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.237854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.240795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.241452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.437757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-570faa0b-ca81-4a7d-8fa9-cc6fc25f2684 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215025 Oct 04 18:13:25.446342 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3144/4104] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:25.586814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.599397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40caa8c6-4e57-48a7-8440-7b7406abf210 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.411903 Oct 04 18:13:25.602018 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 961/4105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.172726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.173556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: 0fc6d772-4435-4ee5-995a-b0ba25de7df2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.185566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.191320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.191889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.192714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.193261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.193768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.222230 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 HTTP/1.1 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0fc6d772-4435-4ee5-995a-b0ba25de7df2'} Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:26.223952 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 404 to user: Instance 0fc6d772-4435-4ee5-995a-b0ba25de7df2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:26.232297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52d17744-4b5f-49e7-9b7e-ee0e3d86c801 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2" status: 404 len: 111 microversion: 2.1 time: 0.058096 Oct 04 18:13:26.234469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.234981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.247483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3145/4106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/0fc6d772-4435-4ee5-995a-b0ba25de7df2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:26.247752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.248515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.248978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.250509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.251219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.255000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.329161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:26.456853 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b3417f6-64b7-49af-935d-fa305806d09c tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 204 len: 0 microversion: 2.1 time: 0.226088 Oct 04 18:13:26.458514 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 962/4107] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:26 2022] DELETE /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:13:26.471272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.473664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.482092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.483423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.484075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.484972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.485611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.486173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.631627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.632653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.646760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.649013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.650315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.652972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.656246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.656905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.272640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.292781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cce51aa-15fc-454d-9893-21afd5b10d9e tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.830077 Oct 04 18:13:27.296833 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3146/4108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.414336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.430211 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3b39a918-08ef-417b-b699-d75f0705dd78 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1523 microversion: 2.1 time: 0.803126 Oct 04 18:13:27.430839 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 963/4109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1523 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:28.236797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c262ea-b902-4d9f-8138-a12f645e0112", "tag": "9c81383e-19a8-472f-ac22-291974519d84"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:28.272151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.278379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.279086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.313144 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] Creating event network-changed:9c81383e-19a8-472f-ac22-291974519d84 for instance 69c262ea-b902-4d9f-8138-a12f645e0112 on n-h2-831193-17 Oct 04 18:13:28.325370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.325552 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5618b330-86a4-40e0-b436-fddea8a7a0ae req-ca62b730-3629-434b-b6b4-b3528d74de57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095971 Oct 04 18:13:28.328042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.328227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3147/4110] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:28.344819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.351700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.355092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.356615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.358626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.360072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.460105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.461271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.474459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.475418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.476371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.477314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.477934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.478521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.053839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.077785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4bd3dfd-c95e-4de7-9a03-68a49d2a7d40 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 0.758247 Oct 04 18:13:29.092428 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 964/4111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:29.472291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.481857 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a81ef38-061f-4c80-95ab-b6bb889f57d7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1503 microversion: 2.1 time: 1.026468 Oct 04 18:13:29.487519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3148/4112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1503 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:29.514473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-76a3381d-6865-4bd6-9bbc-39d8f6eea2ce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'create', calling method: .version_select at 0x7f63411aba60>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500378647", "description": "tempest-description-817408220"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:30.103225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.103838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.110989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.118573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.130496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.131317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.134788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.135353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.538291 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-76a3381d-6865-4bd6-9bbc-39d8f6eea2ce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 3.029637 Oct 04 18:13:32.540598 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 965/4113] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:29 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 3033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:32.557606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500378647"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:32.567848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.570199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:32.596970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.597500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.597960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.598709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.599204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.604587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.712334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.724815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-566fc1b3-e91c-4f0e-acdd-45c025186938 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1521 microversion: 2.1 time: 2.625529 Oct 04 18:13:32.726545 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3149/4114] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1521 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:33.141764 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.network.security_group_api [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Adding security group e6ede833-d23e-487c-85fd-8c952046f8c5 to port 49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 Oct 04 18:13:33.327781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec12e6b2-7e7d-47f3-99d2-06c84492a474", "name": "network-vif-deleted", "tag": "ff49ff1b-fa97-4b57-961e-efc10a4879c6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:33.354569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.355582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.359061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.397722 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] Creating event network-vif-deleted:ff49ff1b-fa97-4b57-961e-efc10a4879c6 for instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 on n-h2-831193-17 Oct 04 18:13:33.419345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-71bcab53-75e1-4ddc-9001-23097992da34 req-5c4c820a-7dd5-40ca-aca7-09b01a6e9e22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095013 Oct 04 18:13:33.420562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3150/4115] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:33.774662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.776191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.794790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.808366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.812670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.816604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.817401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.818950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.922906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.925917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.926646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.928200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lazy-loading 'fault' on Instance uuid ec12e6b2-7e7d-47f3-99d2-06c84492a474 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:34.074379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4ef2f4be1046a2869572360d9aa168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3067da6039458f917440765eda4a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.093431 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0486dabe-ef1a-44cd-8da0-2acdeb336bb6 tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 200 len: 1311 microversion: 2.1 time: 0.340290 Oct 04 18:13:34.109151 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3151/4116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:34.480466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b5ebbc2f-475f-423d-9f43-f84f24fe0d8c tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action" status: 202 len: 0 microversion: 2.1 time: 1.929293 Oct 04 18:13:34.485014 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 966/4117] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:32 2022] POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action => generated 0 bytes in 1931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:34.492283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500378647"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:34.492816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.521754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.523447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.523447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.523698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.524320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.524758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.890788 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Removing security group e6ede833-d23e-487c-85fd-8c952046f8c5 from port 49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 Oct 04 18:13:35.119963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.120819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] [instance: ec12e6b2-7e7d-47f3-99d2-06c84492a474] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.132066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.136118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.136844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.137776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.138409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.139000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.201661 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] HTTP exception thrown: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Request method failure captured: Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 HTTP/1.1 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHai_9HKlQUShJ22NoxDpvBnjcGaLZDA608K4AbRY0KZ2LN07aoH-FUIXpCCJ3Nscp0Zcbp_AiWypyhwjPCm7zWKoptfV_A1Krvsrx77sOWktk_060rU0ELEh4OI00iDZQcUc5wunvfXzYEv5rDzpNt72hYez3I5pncs7beMoNJXitA Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b3067da6039458f917440765eda4a7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b3067da6039458f917440765eda4a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b3067da6039458f917440765eda4a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1b3067da6039458f917440765eda4a7f Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-665172728 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1e4ef2f4be1046a2869572360d9aa168 Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-665172728-project Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ec12e6b2-7e7d-47f3-99d2-06c84492a474'} Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:35.205570 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. Oct 04 18:13:35.212083 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:35.219486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] Returning 404 to user: Instance ec12e6b2-7e7d-47f3-99d2-06c84492a474 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:35.220669 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c2a0034-2429-4942-8558-8c95553da76f tempest-ServerRescueNegativeTestJSON-665172728 tempest-ServerRescueNegativeTestJSON-665172728-project] 10.222.0.33 "GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474" status: 404 len: 111 microversion: 2.1 time: 0.104680 Oct 04 18:13:35.227397 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 967/4118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/ec12e6b2-7e7d-47f3-99d2-06c84492a474 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:13:35.912057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d2f0971-62f7-4480-8e0b-31fa1cc09c09 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action" status: 202 len: 0 microversion: 2.1 time: 1.424062 Oct 04 18:13:35.919739 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3152/4119] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:34 2022] POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:36.207142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-997503584", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2072034b-6e21-4b7a-9493-4d035d819d48"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:36.209794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:36.227115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.228405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.228919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.231530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.253188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.258576 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] Creating event network-changed:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:13:36.272389 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-98b746a3-0c3e-46aa-afad-a402c527ff3f req-e7f322a9-4b96-4968-8c29-bb3ad23c3900 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438683 Oct 04 18:13:36.275302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 968/4120] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:36.293937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] validate_networks() for [('2072034b-6e21-4b7a-9493-4d035d819d48', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:36.308359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-32447b56-d2de-47e5-b636-4c9c80d67f3d tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'create', calling method: .version_select at 0x7f6341056b80>, body: {"pool": null} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:38.177532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:38.178056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:38.178432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:38.178850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:38.179622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:38.229382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.230784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.231620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.232675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.234185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.236837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.269161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:38.276538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for user e495f9ba7f7f4ec6ba19d7a3cf10f2d1 and project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:38.294412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:38.297577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:38.422304 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-82287181-d8b9-46b1-a68f-9881fcbf6aab tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501225 Oct 04 18:13:38.425752 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3153/4121] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:38.448368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be088332-e076-403e-b25e-3c17d1d2f035 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.449457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be088332-e076-403e-b25e-3c17d1d2f035 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.694817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-be088332-e076-403e-b25e-3c17d1d2f035 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.704873 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be088332-e076-403e-b25e-3c17d1d2f035 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1217 microversion: 2.1 time: 0.271459 Oct 04 18:13:38.706253 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3154/4122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:38.734147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:38.797404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.804201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.805548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.865975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] Creating event network-changed:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:13:38.885500 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5c690646-f5a8-4491-8f08-a37deb1e294e req-0e585245-092c-4025-8b0e-07ee2b646cb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177159 Oct 04 18:13:38.889613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3155/4123] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.441377 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-32447b56-d2de-47e5-b636-4c9c80d67f3d tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.147229 Oct 04 18:13:39.450313 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 969/4124] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 18:13:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.468102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.193"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:39.474984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.482542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.483692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.484414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.485366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.486049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.486704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.634102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:13:39.635203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquired lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:13:39.733816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.734752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.771785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.772730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.775401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.776525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.779540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.783624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.266735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.278658 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16c75db2-93e5-46c7-a907-3516ae7406d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1221 microversion: 2.1 time: 0.549717 Oct 04 18:13:40.281433 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 970/4125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1221 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:41.275293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Calling method '.version_select at 0x7f6341064f70>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.277234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.277862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.278612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.314333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.318281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.318835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.348844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.349358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.354833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.376928 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b94cfbb-c4cc-4a55-a860-1b4979738c69 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004 tempest-PortsAdminExtendedAttrsIpV6TestJSON-77596004-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.557636 Oct 04 18:13:41.383589 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 971/4126] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:41.390125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.390761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.444545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.447851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.449620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.450571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.451787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.452455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.629566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.640218 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-46fbd6f5-4247-49f7-9cbe-3bbf60cbe875 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1275 microversion: 2.1 time: 0.255433 Oct 04 18:13:41.647440 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 972/4127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:42.685604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.688215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.696659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.697855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.698564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.700549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.703015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.704484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.889710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.900227 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88c522be-f3b1-418c-b715-fc614ccf001c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1275 microversion: 2.1 time: 0.227196 Oct 04 18:13:42.900799 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 973/4128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:42.987895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:13:43.034187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:43.056305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.060707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.061392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.097420 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] Creating event network-changed:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:13:43.103687 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-7282bbed-3661-4983-a9ba-a50af768dd46 req-b0426b78-33c9-40ef-9cf1-6033289213aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073643 Oct 04 18:13:43.104404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 974/4129] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:43.927549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.928262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.953203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.954013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.954620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.963671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.964181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.964811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.017518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Updating instance_info_cache with network_info: [{"id": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6", "address": "fa:16:3e:c6:76:75", "network": {"id": "46b6949a-dd95-4566-a085-d4968e6d76bb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1534565732-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "25aac5259dfb40dbb5efa48d37547e62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap49b2f1ee-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:13:44.033810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Releasing lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:13:44.034887 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b028126d-96eb-4e0a-b373-0cbde4bdd6a7 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action" status: 202 len: 0 microversion: 2.1 time: 4.579946 Oct 04 18:13:44.038701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3156/4130] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:39 2022] POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action => generated 0 bytes in 4584 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:13:44.049314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.193"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:44.434252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.442137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.442634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.443100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.443966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.447858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.448556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.539466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.556947 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26cc3a05-ce66-46dc-a1b3-f5ea9e918f90 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.634465 Oct 04 18:13:44.557791 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 975/4131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:44.881306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:13:44.882818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquired lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:13:45.581371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.582911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.591310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.592041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.593236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.594224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.594897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.595562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.823581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.833142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9515298d-89ab-45fb-9726-e852f35c10b9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.254754 Oct 04 18:13:45.851542 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 976/4132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.982433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Building network info cache for instance {{(pid=128770) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:13:46.007146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:46.018843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.019889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.020544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.042423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] Creating event network-changed:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:13:46.049529 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-7712a1e3-830a-47b8-899b-a52dea356925 req-4e23c32a-2ae0-41c3-a54c-d97ac010f200 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060195 Oct 04 18:13:46.056087 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 977/4133] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:46.865945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.866575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.885236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.885756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.886215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.886987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.890287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.890793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.502700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Updating instance_info_cache with network_info: [{"id": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6", "address": "fa:16:3e:c6:76:75", "network": {"id": "46b6949a-dd95-4566-a085-d4968e6d76bb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1534565732-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "25aac5259dfb40dbb5efa48d37547e62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap49b2f1ee-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128770) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:13:47.507871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:47.528438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Releasing lock "refresh_cache-92f60ae7-f333-4429-88eb-543c71734fe1" {{(pid=128770) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:13:47.529404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-413ecda7-f727-44fa-aa1b-4ced8cb99d87 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action" status: 202 len: 0 microversion: 2.1 time: 3.488464 Oct 04 18:13:47.531295 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3157/4134] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:44 2022] POST /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1/action => generated 0 bytes in 3491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 18:13:47.541042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3fb30cb4-4aa0-409c-9ee7-23104ce33329 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '.version_select at 0x7f63400a61f0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.714800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.734540 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08822297-f983-47e8-a112-ca9c9cc0f7eb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.878996 Oct 04 18:13:47.757044 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 978/4135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:48.249341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:48.481315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a93df-ffa7-4532-857e-ea3354746160", "tag": "18c172bb-ba8a-44c3-8c77-ebdc50fd5228"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:48.505523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.505807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.506242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.531160 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] Creating event network-changed:18c172bb-ba8a-44c3-8c77-ebdc50fd5228 for instance ee6a93df-ffa7-4532-857e-ea3354746160 on n-h1-831193-17 Oct 04 18:13:48.538634 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-760572d5-167a-464b-9bc1-b05640536dd6 req-e14cfcf9-614d-4b9e-98b6-5967f03237f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186310 Oct 04 18:13:48.540168 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 979/4136] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:48.704011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:48.765139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.769830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.782137 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3fb30cb4-4aa0-409c-9ee7-23104ce33329 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/43c171d6-a541-40c8-a55b-d1488e558b68" status: 202 len: 0 microversion: 2.1 time: 1.245438 Oct 04 18:13:48.782889 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3158/4137] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 18:13:47 2022] DELETE /compute/v2.1/os-floating-ips/43c171d6-a541-40c8-a55b-d1488e558b68 => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:48.785679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.786470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.787006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.787768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.792114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.792855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.793083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f0540af-e699-4f4b-827c-23f4f7f78a99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '.version_select at 0x7f63400a90d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.117812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.130282 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-631ec5e2-c47a-4c8a-9b60-d44da7a27630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.366446 Oct 04 18:13:49.146349 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 980/4138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:49.230674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f0540af-e699-4f4b-827c-23f4f7f78a99 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e6ede833-d23e-487c-85fd-8c952046f8c5" status: 202 len: 0 microversion: 2.1 time: 0.442251 Oct 04 18:13:49.231331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3159/4139] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:13:48 2022] DELETE /compute/v2.1/os-security-groups/e6ede833-d23e-487c-85fd-8c952046f8c5 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:13:49.241491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.241995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.252700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.253200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.253631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.258638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.259855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.275127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.337219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:49.456741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b7653e-f4df-4eb9-8ad5-95f7a2437416", "device": "/dev/sdb"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:49.459537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.473996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.474696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.475873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.478074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.479008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.480154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.542222 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0210239f-9ed4-4c98-ab89-1d4a9441fb1e tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 204 len: 0 microversion: 2.1 time: 0.305447 Oct 04 18:13:49.542809 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 981/4140] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:49 2022] DELETE /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:49.553490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.558640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.576098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.576592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.582112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.582888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.583421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.583851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.756567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.772361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e60ef13-98d4-4a3b-94d5-94b74a5430e4 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1509 microversion: 2.1 time: 0.224500 Oct 04 18:13:49.779067 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 982/4141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:50.014884 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b6af234-f575-4312-9563-31eb82ac3bfd tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "POST /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563436 Oct 04 18:13:50.016217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3160/4142] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:13:49 2022] POST /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:50.157363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.158084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.170443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.172872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.173572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.175438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.180333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.182964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.440302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.451904 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5619593c-165d-4815-a3b5-205f83c52611 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.301895 Oct 04 18:13:50.454499 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 983/4143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.806522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.807524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.825698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.826326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.826911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.827917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.828605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.829266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.174045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.196594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e994e1f1-3920-47e4-9f54-7fc51a045888 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1509 microversion: 2.1 time: 0.392750 Oct 04 18:13:51.207608 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3161/4144] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:51.477421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.478279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.494115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.495390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.496583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.498967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.500990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.502361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.090385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.105312 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5f08fc98-b3bc-4c69-abd6-a7ed0649f03b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.632056 Oct 04 18:13:52.109526 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 984/4145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.222480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.223135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.237846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.239910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.240549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.242390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.245991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.246581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.560230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.568990 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23a22576-509b-43f0-89d4-f2503a651889 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1509 microversion: 2.1 time: 0.351074 Oct 04 18:13:52.569901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3162/4146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.987937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f60ae7-f333-4429-88eb-543c71734fe1", "name": "network-vif-deleted", "tag": "49b2f1ee-ae5b-42e7-926b-ce17328d0dd6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:53.009861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.010554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.011509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.042069 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] Creating event network-vif-deleted:49b2f1ee-ae5b-42e7-926b-ce17328d0dd6 for instance 92f60ae7-f333-4429-88eb-543c71734fe1 on n-h1-831193-17 Oct 04 18:13:53.062891 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-dad4c166-aa32-46b0-b3e8-7944a57d1cfc req-5b632075-4fe9-4f54-bfb9-95fa199ac008 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082902 Oct 04 18:13:53.066532 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 985/4147] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:53.133430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.134127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.146049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.146570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.147024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.147811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.148261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.152792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.596104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.596874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.609163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.614264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.616515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.617276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.619530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.624063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.624636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.635825 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3187d31f-b25b-44c8-ac67-3e13707de84c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.500688 Oct 04 18:13:53.637558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3163/4148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:53.741267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.741759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.742205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.742677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lazy-loading 'fault' on Instance uuid 92f60ae7-f333-4429-88eb-543c71734fe1 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:53.884695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f822a74c50124a08b1c144f3083597a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aac5259dfb40dbb5efa48d37547e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.898920 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3eece14-9214-42ce-a5ce-0c3ad7a29cce tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 200 len: 1312 microversion: 2.1 time: 0.307682 Oct 04 18:13:53.906870 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 986/4149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:54.666715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.668027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.687501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.690626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.691289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.692913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.693478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.694825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.937719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.940634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] [instance: 92f60ae7-f333-4429-88eb-543c71734fe1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.960772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.964276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.967432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.973171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.974151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.976018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.004579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:55.062541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] HTTP exception thrown: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Request method failure captured: Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 HTTP/1.1 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHebEF0zM_tr9bQtqJQptWyrhiMHi1JUfamn7cHV6_Atb7BPCfC2MFkfnMQNJXaTTqnsUoTDjxZkzlTImC_46RDF7EEuhSaDsOhgRQ8sSZiOs3Gd772RwuSyki9Iw3duZj82VxrNw4yAosEDxLjmou8ksTsl2kaTfZJf8b3aze4Mm5w Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 25aac5259dfb40dbb5efa48d37547e62 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-227246853 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25aac5259dfb40dbb5efa48d37547e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25aac5259dfb40dbb5efa48d37547e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25aac5259dfb40dbb5efa48d37547e62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25aac5259dfb40dbb5efa48d37547e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-227246853 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 25aac5259dfb40dbb5efa48d37547e62 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-227246853 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerRescueTestJSONUnderV235-227246853-project Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: f822a74c50124a08b1c144f3083597a7 Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-227246853-project Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '92f60ae7-f333-4429-88eb-543c71734fe1'} Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:55.077930 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:13:55.082099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] Returning 404 to user: Instance 92f60ae7-f333-4429-88eb-543c71734fe1 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:55.083775 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-09f3bb7e-7339-4588-b5a2-733ed8cef3c5 tempest-ServerRescueTestJSONUnderV235-227246853 tempest-ServerRescueTestJSONUnderV235-227246853-project] 10.222.0.33 "GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1" status: 404 len: 111 microversion: 2.1 time: 0.151407 Oct 04 18:13:55.091063 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 987/4150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/92f60ae7-f333-4429-88eb-543c71734fe1 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:13:55.370400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.378611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b72e09d1-97d5-4d17-aff7-0ef1e97d5f9c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.716649 Oct 04 18:13:55.383315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3164/4151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:56.408439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.408982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.430425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.430920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.435383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.441167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.441666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.444010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.788637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.800731 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bbbd18a2-e91d-4a61-963c-d86671566731 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.396915 Oct 04 18:13:56.801976 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 988/4152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:57.836185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.840507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.847828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.848559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.849011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.849734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.850189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.850813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.032973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.042725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0526c66-15f8-44cc-8e5f-e08c9b96f0e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.209967 Oct 04 18:13:58.043692 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3165/4153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:59.073797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:59.074465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.099457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.100558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.101184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.102284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.102750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.104826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.323865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a93df-ffa7-4532-857e-ea3354746160", "name": "network-vif-plugged", "status": "completed", "tag": "18c172bb-ba8a-44c3-8c77-ebdc50fd5228"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:59.346597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.348999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.349759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.386590 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] Creating event network-vif-plugged:18c172bb-ba8a-44c3-8c77-ebdc50fd5228 for instance ee6a93df-ffa7-4532-857e-ea3354746160 on n-h1-831193-17 Oct 04 18:13:59.390260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.400651 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ddecf48f-a244-4f9c-aad3-d1fc204f939e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.335140 Oct 04 18:13:59.410490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-727e68dd-0d3a-4522-8831-2c8a0ac7ebde req-dde5cfff-967f-4626-9496-0e2c1cb034f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090782 Oct 04 18:13:59.413899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3166/4154] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:59.416034 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 989/4155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:59 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:00.425195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.426080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.437971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.438460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.440507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.442124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.443084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.443868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.978946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:00.990110 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2b65642-35e6-4113-99f5-297dca8f7008 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1317 microversion: 2.1 time: 0.568319 Oct 04 18:14:00.991396 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3167/4156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:01.542285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1822680692", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "16707635-6dda-4bc9-875c-baf7320bbca9"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:01.710105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] validate_networks() for [('16707635-6dda-4bc9-875c-baf7320bbca9', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:02.021410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.022159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.033542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.037650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.038674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.043547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.044183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.045051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.723361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.739380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3efe035-dc1e-4c14-b95e-ff1a3ba20c32 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1507 microversion: 2.1 time: 0.720289 Oct 04 18:14:02.741670 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3168/4157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:02.766017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.767766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.781214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.786057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.786850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.788682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.793452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:02.793452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:02.794058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:02.794631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:02.795176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:02.800287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:02.802033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.805701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.820348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.824331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.825641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.830179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.831571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.832437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.897215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Getting quotas for project df6d4fb1b2704e929c0371d74ee20e29. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:02.909322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Getting quotas for user e9771c9f0a4d412a94a1243ef4f8f682 and project df6d4fb1b2704e929c0371d74ee20e29. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:02.945665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:02.949802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:03.063950 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7aa273fd-3415-4649-97b4-6aaaf051f3db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.728560 Oct 04 18:14:03.064616 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 990/4158] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:14:03.076286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.078518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.145092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.156315 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-222e3640-6d27-4f23-a0c8-d04e41c008cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1507 microversion: 2.1 time: 0.396161 Oct 04 18:14:03.167113 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3169/4159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:03.186868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.191557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.207938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.215548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.216017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.216780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.217299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.218237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.228183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.236882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.243817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.245960 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-993a1d9c-18a8-40af-815d-2afcd8373c02 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1262 microversion: 2.26 time: 0.172708 Oct 04 18:14:03.250039 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 991/4160] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1262 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:03.391948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.392461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.411128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.411627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.412109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.412818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.413280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.413951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.438638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:03.445091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:03.445628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:03.446048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:03.448582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:03.505872 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4131bbcb-060e-4d51-a391-d365c01a1352 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/ips" status: 200 len: 151 microversion: 2.1 time: 0.119135 Oct 04 18:14:03.509499 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 992/4161] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:03.522600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62e38145-f411-4776-a2ef-d27083df7381"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.530472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.547277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.549029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.551251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.552388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.554056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.557799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.610131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.636992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.639710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.642983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.645401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.646768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.648711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.765981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-952357f6-2934-4aaf-bff0-60391c389ccb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "POST /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160/action" status: 202 len: 1109 microversion: 2.1 time: 0.585261 Oct 04 18:14:03.770031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3170/4162] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160/action => generated 1109 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:14:03.812402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.817513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.824300 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/os-volume_attachments HTTP/1.1 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 74 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: {"volumeAttachment": {"volumeId": "62e38145-f411-4776-a2ef-d27083df7381"}} Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '69c262ea-b902-4d9f-8138-a12f645e0112', 'body': {'volumeAttachment': {'volumeId': '62e38145-f411-4776-a2ef-d27083df7381'}}} Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:03.831647 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c Oct 04 18:14:03.836034 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.846675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 400 to user: Invalid volume: volume 62e38145-f411-4776-a2ef-d27083df7381 is already attached to instances: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:03.849908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d55cc9d-79eb-4aec-b5c2-e6ce7d2422bc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.332063 Oct 04 18:14:03.855105 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 993/4163] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112/os-volume_attachments => generated 174 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:14:03.872382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.876507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.877040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.879944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.880421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.882289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.885739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.886413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.900752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.904110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.906028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.911270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.912611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.918261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.989058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:04.452871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.461161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50131064-7720-4861-b695-c94dd43b23be tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.671363 Oct 04 18:14:04.461880 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3171/4164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.519649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.520331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.534017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.534542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.535452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.536249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.536725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.537248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.790837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.802009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.824108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.829479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23ba1c2d-4167-45a5-817f-0197c5054dbf tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1258 microversion: 2.26 time: 0.318949 Oct 04 18:14:04.841962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3172/4165] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1258 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:04.870735 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b64c0b8-dc45-4d3b-9e00-b2f59e4bcf08 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 204 len: 0 microversion: 2.1 time: 1.009617 Oct 04 18:14:04.871350 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 994/4166] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:03 2022] DELETE /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:04.880003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.880884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.899332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.899332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.899332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.903364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.904265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.905471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.935133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:05.488138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.489019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.495619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.496119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.496562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.497396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.497863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.498298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.138930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.153380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0432b3d-4642-4d72-a02c-c374208de0e7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1683 microversion: 2.1 time: 1.277115 Oct 04 18:14:06.154540 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3173/4167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1683 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:06.166204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.168659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.182328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.184084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.187143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.189784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.194114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.194932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.539831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.547924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.549429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.550650 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6e928a0-e447-4a33-bbbd-ca0e563eb25f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1314 microversion: 2.26 time: 0.394354 Oct 04 18:14:06.554751 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3174/4168] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:06.588723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.613623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da6a2a51-073d-4919-b4a3-5e47a2213320 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 1.130968 Oct 04 18:14:06.619959 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 995/4169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.773979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1220355493", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:06.782212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:06.852543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:06.853218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:06.853879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:06.854493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:06.855144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:06.865746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.866618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.867375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.868400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.869045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.869703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.892262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Getting quotas for project a94585303b2844fcaf2bb00be0fa1de6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:06.898174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Getting quotas for user 1a224b0ebf0946a19e3d669720daaebb and project a94585303b2844fcaf2bb00be0fa1de6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:06.911766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:06.914373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:06.972281 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d89450d-095b-4ebd-8c3f-a41af9aa7c5f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.415831 Oct 04 18:14:06.973339 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3175/4170] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:14:06.985950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.986950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.178873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.179486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.193272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.195124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.195855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.200611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.202169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.202898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.312730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.330274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.333167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.337669 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b93cc86d-6b68-47c8-9a46-0d90532f7da7 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1278 microversion: 2.54 time: 0.356622 Oct 04 18:14:07.338261 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 996/4171] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:07.588039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.589335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.608514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.609337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.610578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.612361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.613525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.614794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.920588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.935793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.938271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.940419 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a85c8b7-7d44-489b-965d-1f1d7aa66603 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1320 microversion: 2.26 time: 0.356454 Oct 04 18:14:07.966217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 997/4172] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:07.971396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.986191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.018194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.029335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.032098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.033096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.035656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.036224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.755326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.763585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b0061c0a-8f56-4d71-b8d2-4cd960a5acff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1683 microversion: 2.1 time: 1.589498 Oct 04 18:14:08.764741 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3176/4173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1683 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:08.775315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.775942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.791216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.791725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.792170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.792892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.793355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.793788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.174639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.193557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.200558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.204315 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e273fdab-364d-4b09-b6b8-f10cbbfc7ac5 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1330 microversion: 2.54 time: 0.438583 Oct 04 18:14:09.208883 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3177/4174] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1330 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:09.225628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.226347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.233955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.244932 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e93d497f-8672-4a21-b1ac-d42100829438 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 1.277199 Oct 04 18:14:09.245973 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 998/4175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.250549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.253773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.261288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.262490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.263249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.263909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.791636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.792344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.800871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.804303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.805001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.805922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.806550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.807183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.986321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.996749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.003010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.004562 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba7a246b-fd78-4e87-9e5b-0e8c3adef92f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1320 microversion: 2.26 time: 0.792309 Oct 04 18:14:10.010509 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3178/4176] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1320 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:10.020408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c262ea-b902-4d9f-8138-a12f645e0112", "name": "network-vif-unplugged", "status": "completed", "tag": "9c81383e-19a8-472f-ac22-291974519d84"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:10.041402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.046423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.047080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.079426 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] Creating event network-vif-unplugged:9c81383e-19a8-472f-ac22-291974519d84 for instance 69c262ea-b902-4d9f-8138-a12f645e0112 on n-h2-831193-17 Oct 04 18:14:10.085127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ffed867d-5cd0-43d3-a61e-7252e2d76927 req-8cfb7b93-db54-40b5-825d-e398d646f086 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072856 Oct 04 18:14:10.086510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3179/4177] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:10.239911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.240672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.255007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.255526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.255973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.259914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.260674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.261337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.541327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.545033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.553434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.554966 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc794284-fc88-4ee0-a177-8941de63366b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1683 microversion: 2.1 time: 0.768852 Oct 04 18:14:10.560943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.562414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab18b0ed-0b4f-4b49-b10f-651e4ec9ac7e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1336 microversion: 2.54 time: 0.327738 Oct 04 18:14:10.563126 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 999/4178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1683 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.565201 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3180/4179] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1336 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:10.586133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.595667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.618328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.627278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.628095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.629151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.629790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.634747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.040504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.041818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.053868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.054379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.054823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.062789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.063329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.063777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.688665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.721438 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5625ca51-b86b-4663-87fb-e3de716df364 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 1.156359 Oct 04 18:14:11.727731 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1000/4180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:11.769333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.777230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.839256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.839857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.840381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.841118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.843376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.843822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.531713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.566018 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62f5d0ff-2b2a-4932-af12-251dc96de7dc tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1616 microversion: 2.1 time: 0.828028 Oct 04 18:14:12.567281 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1001/4181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1616 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.583425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.584473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.603828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.607831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.608615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.609632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.610325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.611709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.860749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:12.934035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.946125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.947869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.949794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.951023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31cba282-e9aa-4e33-abe5-0f490c0e29a8 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 1.914335 Oct 04 18:14:12.969446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3181/4182] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:12.973186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.974365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.974987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.989008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.990480 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9d07a27-fa3e-491d-911c-8b664134f94b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1357 microversion: 2.54 time: 0.419324 Oct 04 18:14:12.991195 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1002/4183] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1357 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:13.004357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.004869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.005313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.006041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.006498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.006923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.023750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d0559e9-814d-4a41-9f7d-6b68045c4117 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Action: 'create', calling method: .version_select at 0x7f6340fcec10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-634948520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8gVLYiquS4gozqtu7o8Mhy7M8qpk1OtCMnc94lZoTsHMoUqKUQ/Bklm3oYCvDiFRaRuDuVIp2WQvcrhTlPEljurfTvee/rUj4lZgIWR9uwQl6CvXJM52WDE6CNhjpMqA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:13.064644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-4d0559e9-814d-4a41-9f7d-6b68045c4117 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Getting quotas for project a94585303b2844fcaf2bb00be0fa1de6. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:13.075741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-4d0559e9-814d-4a41-9f7d-6b68045c4117 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Getting quotas for user 1a224b0ebf0946a19e3d669720daaebb and project a94585303b2844fcaf2bb00be0fa1de6. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:13.176801 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d0559e9-814d-4a41-9f7d-6b68045c4117 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.158514 Oct 04 18:14:13.185419 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1003/4184] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 18:14:13 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:14:13.202768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-634948520", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:13.217767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.239418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.241483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.242041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.243336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.248827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.249446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.513066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:13.514948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:13.515721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:13.516356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:13.518233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:13.692293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.704902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.709329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.711645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.712554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.716448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.717899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.795813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:13.803892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.821118 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-070ce050-15b5-48ab-aecf-c8c7ebeb34b9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "POST /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed/action" status: 202 len: 1139 microversion: 2.54 time: 0.632510 Oct 04 18:14:13.828225 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1004/4185] 10.222.0.33 () {62 vars in 1320 bytes} [Tue Oct 4 18:14:13 2022] POST /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed/action => generated 1139 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:14:13.829730 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e680516-6e7b-4cf8-95f4-50e55edcf214 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.859097 Oct 04 18:14:13.847774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3182/4186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.866224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.866973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c262ea-b902-4d9f-8138-a12f645e0112", "name": "network-vif-deleted", "tag": "9c81383e-19a8-472f-ac22-291974519d84"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:13.869951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.896820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.901724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.907202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.907738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.909618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.911664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.915951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.919712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.921247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.981846 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] Creating event network-vif-deleted:9c81383e-19a8-472f-ac22-291974519d84 for instance 69c262ea-b902-4d9f-8138-a12f645e0112 on n-h2-831193-17 Oct 04 18:14:14.008896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-79545356-f8f7-491c-95bf-129d23866125 req-6a8de7c5-7202-4488-9387-ba47f2978c63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178902 Oct 04 18:14:14.020807 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1005/4187] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:14.050734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.064287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.083407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.085209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.099211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.101719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lazy-loading 'fault' on Instance uuid 69c262ea-b902-4d9f-8138-a12f645e0112 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:14.126233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.128404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.139717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.143933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.145425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.150660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.309040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.323196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c5abb08-5223-462e-a547-8ee25eac6973 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 200 len: 1332 microversion: 2.1 time: 0.472476 Oct 04 18:14:14.325095 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3183/4188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 1332 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:14.356852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.357933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.388597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.393698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.394787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.397526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.398424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.401721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.602173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.612028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.632001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.633872 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6faa427c-4648-4112-bce1-56b569e2b092 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.604400 Oct 04 18:14:14.638366 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1006/4189] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:14.859553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.860412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.873176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.878412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.879239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.880887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.882209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.884401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.285951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.299968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.309040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.317318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0105a8e-7447-4458-939f-cde403e5e1db tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 0.989175 Oct 04 18:14:15.324334 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3184/4190] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:15.354200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.359729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.382844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.395661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.396387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.397228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.399873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.404005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.449671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:14:15.450369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 HTTP/1.1 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '69c262ea-b902-4d9f-8138-a12f645e0112'} Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:15.457545 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:14:15.463211 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:15.470273 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c190e022-e47f-4870-986f-7bc149f7768a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.615736 Oct 04 18:14:15.472015 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1007/4191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.473519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:15.477567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4113ac55-9198-433e-b214-10ca45266203 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 404 len: 111 microversion: 2.1 time: 0.127398 Oct 04 18:14:15.496507 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3185/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:15.508464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57d2e5ce-7c70-4e26-bdf5-c561970be290 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '.version_select at 0x7f634110de50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.562327 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57d2e5ce-7c70-4e26-bdf5-c561970be290 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058304868" status: 202 len: 0 microversion: 2.1 time: 0.059995 Oct 04 18:14:15.567732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1008/4193] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058304868 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:15.673017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.673750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.686758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.687564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.688691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.689787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.690966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.691670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.876745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.886509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.905996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.908544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43c55a2c-d923-4df6-8b3f-aeec954f04c4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.244810 Oct 04 18:14:15.912233 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3186/4194] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:16.044213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d04e90-7621-4e07-be7a-880033c96969", "tag": "8e743750-3262-49f0-8d26-47548b8a701e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:16.089970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.090621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.091195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.129938 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] Creating event network-changed:8e743750-3262-49f0-8d26-47548b8a701e for instance a4d04e90-7621-4e07-be7a-880033c96969 on n-h2-831193-17 Oct 04 18:14:16.148698 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-1ee544c9-5670-4eef-ac11-515123e18f59 req-ad5e34d0-313b-40d3-8528-b8f02040e2b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110299 Oct 04 18:14:16.152779 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1009/4195] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:16.356555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.361214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.384229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.385049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.385985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.386960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.387685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.388353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.494719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.495873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.510971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.515024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.515799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.518971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.520212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.520915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.881291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:16.905859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:18.228852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.283205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.284857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.288953 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1bdbb80a-3f60-4193-b9e0-5a1ddfce7269 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 1.939713 Oct 04 18:14:18.304561 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3187/4196] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:18.310120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.311684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.328454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.329012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.329393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.330112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.330568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.330996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.349834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.361376 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-962bf46d-48d6-4915-9fef-8fbdfb83acb5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 1.870912 Oct 04 18:14:18.366059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1010/4197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:18.382576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.383127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.407075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.407784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.411331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.413899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.413899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.414626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.571207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.586022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.595415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.597154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f59c6d96-22ce-4e87-8d60-546ec32592d3 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.292402 Oct 04 18:14:18.599759 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3188/4198] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:18.625284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lazy-loading 'services' on Instance uuid f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:18.759146 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3491de88-fd23-4894-bc3e-1de0236417e9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments/62e38145-f411-4776-a2ef-d27083df7381" status: 202 len: 0 microversion: 2.1 time: 0.391157 Oct 04 18:14:18.767160 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1011/4199] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:14:18 2022] DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments/62e38145-f411-4776-a2ef-d27083df7381 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:18.771115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.773510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.785803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.788676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.789276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.790091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.793114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.793954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.919298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6b3d156-3827-4191-a50d-b24390f2db27 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152510 Oct 04 18:14:18.922177 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3189/4200] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:19.324786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.327764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.349795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.353591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.354706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.356951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.359163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.359992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.394861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.395773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.412477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.412988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.413433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.414155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.414610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.415082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.050587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.061503 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f0414f0-c8a4-489d-a116-4481373fad41 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.670919 Oct 04 18:14:20.062104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3190/4201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.073231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.079875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.086844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.091969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.092727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.093678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.094336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.094951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.281826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.285080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:20.296946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.298397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.307005 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d280748-f895-4804-a31c-97091cdd1b46 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.238663 Oct 04 18:14:20.307654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3191/4202] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:20.315958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.318465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.319940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.325519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.326385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.327064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.327990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.328650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.329273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.335997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.337461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.338628 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-92904414-22e3-48bb-9d09-85155dffd3dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 1.019625 Oct 04 18:14:20.355313 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1012/4203] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:20.411328 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4394de75-79c4-4bc5-9088-398ab5dbc21f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102497 Oct 04 18:14:20.411977 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3192/4204] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:21.087539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.088569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.134683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.148818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.149280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.150025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.158265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.160360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.337397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.338019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.350192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.350694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.351156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.355832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.356351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.356794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.453162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.461604 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61a26ddd-14c6-4139-beef-4a4fe84cdb7f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.379106 Oct 04 18:14:21.482006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1013/4205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:21.488519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.489392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.492125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.495912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.496938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.497554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.498971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.499606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.500328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.509601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.511270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.513406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0fcf838e-7bfe-4c3b-b135-88e9124847e1 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.180136 Oct 04 18:14:21.523207 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3193/4206] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:21.529036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.534751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.555922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.556649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.557356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.562897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.564360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.564924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.618112 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c6fda14-7c99-4594-9e0c-114467775e66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092871 Oct 04 18:14:21.618769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3194/4207] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:21.815663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d04e90-7621-4e07-be7a-880033c96969", "name": "network-vif-plugged", "status": "completed", "tag": "8e743750-3262-49f0-8d26-47548b8a701e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:21.835766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.835766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.836217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.855866 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] Creating event network-vif-plugged:8e743750-3262-49f0-8d26-47548b8a701e for instance a4d04e90-7621-4e07-be7a-880033c96969 on n-h2-831193-17 Oct 04 18:14:21.869559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c1ca65c1-cf4c-4357-ae4d-15d4950a3382 req-074208ef-3944-4078-937d-91cd965f82e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062321 Oct 04 18:14:21.870634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3195/4208] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:21.884315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.906430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.913570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.916962 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-baf8e638-fe08-4b64-8a89-bdaf747182f1 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 0.433452 Oct 04 18:14:21.918278 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1014/4209] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:22.491664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.492745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.501786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.502697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.503440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.504422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.505120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.505784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.540141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.540695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.554581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.555405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.556041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.556945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.557796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.558398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.677551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.696458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.698226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.699701 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-002ef76d-bd90-43d8-874c-d35657421dd4 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.163479 Oct 04 18:14:22.712048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.715460 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1015/4210] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:22.724865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.727678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.728680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eed589c5-b222-4c7b-8c2d-7af9759b404c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.242479 Oct 04 18:14:22.729868 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3196/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.750315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.751117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.751765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.752671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.753304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.753904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.797847 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-13dbcef3-cc30-4fce-a8b6-3609b6ad5015 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080961 Oct 04 18:14:22.798608 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1016/4212] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:22.946259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.947778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.956076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.957350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.958742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.959884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.960609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.961276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.730669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.731313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.741584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:23.746125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.749821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.750508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.752107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.753987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.754934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.838564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.852141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.861101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.863097 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed58bfb7-686f-4efa-acac-d36bb191db14 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1362 microversion: 2.26 time: 0.921138 Oct 04 18:14:23.866570 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3197/4213] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1362 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:23.886597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.887617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.906850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.907785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.908431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.909345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.909974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.910900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.961883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.988351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.992432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.993726 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b05699fd-f766-4520-ae0b-e85da855421b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.267745 Oct 04 18:14:23.997674 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1017/4214] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:24.012460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.019924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.031760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.034243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.034943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.039924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.040643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.041277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.109871 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-66874184-b1c9-4ce2-b219-4b4e8dd51b99 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110679 Oct 04 18:14:24.111120 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1018/4215] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:24.521853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.530892 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-559e6218-45cb-41b9-8391-45ec1dfba6d5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.661680 Oct 04 18:14:24.532366 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3198/4216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:24.902449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.903011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.911301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.911796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.912244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.912955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.913407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.914058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.025003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.025630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.040756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.041277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.041710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.042658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.043406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.043851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.280239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.292585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.294893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.298525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23d4497c-cffd-4877-be88-eb4046e6293b tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.277538 Oct 04 18:14:25.301253 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3199/4217] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:25.308549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.312163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.318579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.319103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.319603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.320567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.321405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.321832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.375257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.379454 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5cbd53f-dc98-4b0e-8c79-60371b97704c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068188 Oct 04 18:14:25.381973 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3200/4218] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:25.394132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.395870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.397104 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e15d75be-8f52-42c3-a9be-90fea64a0244 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1545 microversion: 2.26 time: 0.504881 Oct 04 18:14:25.397671 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1019/4219] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1545 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:25.428292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634006b940>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.441790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.442825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.443564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.444297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.451877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.453051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.453614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.454602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.455251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.456060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.488487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.489245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.489966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.508385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.509390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.510062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.560150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.561008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.566965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:25.586751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.587062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:25.587307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.587751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.588479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.588935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.589423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.631908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf6afcfd-9059-4fdf-a11a-095ab95a95dc tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-162981653" status: 201 len: 0 microversion: 2.26 time: 0.208483 Oct 04 18:14:25.633702 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3201/4220] 10.222.0.33 () {62 vars in 1377 bytes} [Tue Oct 4 18:14:25 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-162981653 => generated 0 bytes in 213 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:14:25.644636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdf2d957-6d7d-446c-a680-6d0be4670999 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f63400a9700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.671332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdf2d957-6d7d-446c-a680-6d0be4670999 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.672133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdf2d957-6d7d-446c-a680-6d0be4670999 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.673999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdf2d957-6d7d-446c-a680-6d0be4670999 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.700837 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdf2d957-6d7d-446c-a680-6d0be4670999 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-162981653" status: 204 len: 0 microversion: 2.26 time: 0.062346 Oct 04 18:14:25.702125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3202/4221] 10.222.0.33 () {60 vars in 1358 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-162981653 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:25.714244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634005e040>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.730720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.733980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.735292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.741814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.748613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.751974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.752537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.753383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.754909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.756014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.820038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.826916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.832750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.863806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:25.920023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d195ea4e-79bb-4cd9-a825-8a6b5968441f tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 204 len: 0 microversion: 2.26 time: 0.213699 Oct 04 18:14:25.921392 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3203/4222] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 18:14:25 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:25.948780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7882bae0-8561-455b-8b2c-693bc1ca86b9 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634005ec10>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.976663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7882bae0-8561-455b-8b2c-693bc1ca86b9 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.984416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7882bae0-8561-455b-8b2c-693bc1ca86b9 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.985260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7882bae0-8561-455b-8b2c-693bc1ca86b9 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.005610 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7882bae0-8561-455b-8b2c-693bc1ca86b9 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 12 microversion: 2.26 time: 0.076858 Oct 04 18:14:26.009637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3204/4223] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 12 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.021746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f63400a0dc0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.045324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.046558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.049857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.050780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.064678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.069434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.070025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.071137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.071719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.072288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.132303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.135157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.135738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.158519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.162494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.163243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.216455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:26.224623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:26.245496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.260006 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a971218c-f3f4-4369-be2d-32f17c9e6a45 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.704803 Oct 04 18:14:26.260765 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1020/4224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:26.268923 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a9bc7196-a1f4-438c-ad70-6483ff624e20 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-2116577100" status: 201 len: 0 microversion: 2.26 time: 0.252603 Oct 04 18:14:26.270872 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3205/4225] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 18:14:26 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-2116577100 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 18:14:26.281058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9902004f-b9c1-40cc-aa4b-a4d30b1d3426 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634103a8b0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.300199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9902004f-b9c1-40cc-aa4b-a4d30b1d3426 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.300913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9902004f-b9c1-40cc-aa4b-a4d30b1d3426 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.301471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9902004f-b9c1-40cc-aa4b-a4d30b1d3426 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.327342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.328271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.345820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.353411 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9902004f-b9c1-40cc-aa4b-a4d30b1d3426 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 36 microversion: 2.26 time: 0.076679 Oct 04 18:14:26.358521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.359390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.360399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.367214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.367878 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1021/4226] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 36 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.370009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.379344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f6341afbd30>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.400981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.401609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.403575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.404331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.428478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.430200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.435726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.437364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.443551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.444903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.511063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.511680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.512132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.542587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:26.559264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:26.586775 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f89b49e8-5851-408e-b34d-386f4d6a3157 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-2116577100" status: 204 len: 0 microversion: 2.26 time: 0.217123 Oct 04 18:14:26.587760 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1022/4227] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 18:14:26 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-2116577100 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:26.593459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.601716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.620192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.620898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.621515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.622416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.623278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.623914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.693757 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2ecd5f61-5048-4365-99a1-85b229916460 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104570 Oct 04 18:14:26.695101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1023/4228] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:14:26.700792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de5add71-15ab-40d3-be04-bb517f6c0ca5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f6340ffec10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.713356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5add71-15ab-40d3-be04-bb517f6c0ca5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.715772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5add71-15ab-40d3-be04-bb517f6c0ca5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.716398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5add71-15ab-40d3-be04-bb517f6c0ca5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.739622 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de5add71-15ab-40d3-be04-bb517f6c0ca5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 12 microversion: 2.26 time: 0.042974 Oct 04 18:14:26.740247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1024/4229] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.753704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f6341adf1f0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.771694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.772280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.774955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.775409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.777829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.787522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.789952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.790776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.791318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.791766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.792490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.792996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.793378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.796824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c57235f5-5b63-478d-98bd-af6d2a888373 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.471976 Oct 04 18:14:26.811731 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3206/4230] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:26.823359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.823952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.829117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.829464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.829912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.842328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.842974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.847568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.847568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.847568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.847932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.861148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:26.896694 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eb1c5c5a-57ff-463a-a9c9-02405a6c38e7 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 204 len: 0 microversion: 2.26 time: 0.149782 Oct 04 18:14:26.900194 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1025/4231] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 18:14:26 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:26.911350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f6341133310>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.921897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:26.932628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.933121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.933565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.934051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.960043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.960775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.961568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.969217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.970091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.970707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.037617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.038384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.039004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.065530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.066287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.067066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.128384 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc26812a-9a5d-457b-b2f0-f301b3975f91 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 204 len: 0 microversion: 2.1 time: 0.312367 Oct 04 18:14:27.131258 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3207/4232] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:26 2022] DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:27.138317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:27.150557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.157924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.167319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.169598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.170412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.174053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.174971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.175613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.178637 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ac8b0ba7-4a76-4b6c-b7d3-96bd90bc1b4b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1592776994" status: 201 len: 0 microversion: 2.26 time: 0.273258 Oct 04 18:14:27.181571 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1026/4233] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 18:14:26 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1592776994 => generated 0 bytes in 277 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:14:27.207292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f6341158280>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.218081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.223182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.223927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.226404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.239450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.240232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.240875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.241767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.242749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.243422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.273470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.274841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.275516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.288227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.288582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.289218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.328707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:27.364388 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2f214c9b-5f17-47fb-94d4-d3b7b8a8a517 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1998875837" status: 201 len: 0 microversion: 2.26 time: 0.177121 Oct 04 18:14:27.365068 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1027/4234] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 18:14:27 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1998875837 => generated 0 bytes in 178 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:14:27.383662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.385267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.409331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.410054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.410671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.411615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.412560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.416844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.580913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.594165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f10dd93-f355-4375-9ef1-bc5d28242bbd tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1683 microversion: 2.1 time: 0.458779 Oct 04 18:14:27.598086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3208/4235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1683 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:27.610447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f63400c59d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.641472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.645237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.645705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.646202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.664071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.667073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.667073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.667828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.668304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.668734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.718973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.719493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.719934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.746291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.753935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:27.760124 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a229f071-7dfd-421e-bb29-c8cc79b844d7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.390343 Oct 04 18:14:27.762129 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1028/4236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:27.793016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-066bbb2f-1471-4e6d-8289-9d4f7567fe34 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 204 len: 0 microversion: 2.26 time: 0.193507 Oct 04 18:14:27.803931 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3209/4237] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 18:14:27 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:27.813934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-51d29339-c248-41af-920e-babdada99d66 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634110df70>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.827983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.828629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.833004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51d29339-c248-41af-920e-babdada99d66 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.834302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51d29339-c248-41af-920e-babdada99d66 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.835905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51d29339-c248-41af-920e-babdada99d66 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.840315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:27.841952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.842474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.842906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.843666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.844129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.844567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.863641 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-51d29339-c248-41af-920e-babdada99d66 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 12 microversion: 2.26 time: 0.055096 Oct 04 18:14:27.867312 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1029/4238] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:27.879556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f63410b6160>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.896424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.896919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.897362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.915989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.944866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.945725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.945838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.946529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.946986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.947516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.978269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.978940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.979746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.992548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:28.003333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.023527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.024995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.028594 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-32b34677-4da3-4213-a5dc-cd37e13fd0a4 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 204 len: 0 microversion: 2.26 time: 0.155108 Oct 04 18:14:28.029932 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1030/4239] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 18:14:27 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:14:28.033150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c2cdf39-3edd-4895-afe6-4d8a6ff1e264 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.209137 Oct 04 18:14:28.033623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3210/4240] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:28.042534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f63410b63a0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.056199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.056993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.057694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.058440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.066318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.066964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.067632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.068467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.069038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.069593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.099997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.100577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.101124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.111588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.112313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.113026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.139256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:28.157014 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3edcf54-a5e2-42b7-b22f-0d0122639e16 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1169389135" status: 201 len: 0 microversion: 2.26 time: 0.118856 Oct 04 18:14:28.158194 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1031/4241] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 18:14:28 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-1169389135 => generated 0 bytes in 121 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 18:14:28.168390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634006b160>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.179338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.180141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.180844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.181547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.188629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.189431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.190119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.191201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.191914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.192571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.231602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.233485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.234181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.248351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.248847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.249294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.279160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:28.297330 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f16df12e-1015-421d-8254-40300ec7011b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-792726779" status: 201 len: 0 microversion: 2.26 time: 0.133397 Oct 04 18:14:28.303008 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3211/4242] 10.222.0.33 () {62 vars in 1377 bytes} [Tue Oct 4 18:14:28 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags/tempest-tag-792726779 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 04 18:14:28.313902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Action: 'update_all', calling method: .version_select at 0x7f6345d70d30>, body: {"tags": ["tempest-tag-1442798250", "tempest-tag-1805943040"]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:28.340075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.345370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.346099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.346692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.368237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.369046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.369688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.370618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.371405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.372010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.410307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.411093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.411707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.437559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:28.450580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:28.473505 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e69c428f-ae6b-41b6-b9d6-1d00cdb8f1b5 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 62 microversion: 2.26 time: 0.169429 Oct 04 18:14:28.485630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-09861c34-66da-4b48-be85-e3bfe151c639 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634006b4c0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.489087 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1032/4243] 10.222.0.33 () {62 vars in 1312 bytes} [Tue Oct 4 18:14:28 2022] PUT /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 62 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:28.496730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09861c34-66da-4b48-be85-e3bfe151c639 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.497624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09861c34-66da-4b48-be85-e3bfe151c639 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.498206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09861c34-66da-4b48-be85-e3bfe151c639 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.510601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-09861c34-66da-4b48-be85-e3bfe151c639 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 200 len: 62 microversion: 2.26 time: 0.029214 Oct 04 18:14:28.518425 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3212/4244] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 62 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.525015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '.version_select at 0x7f634216e670>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.536403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.536987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.537528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.537977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.546120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.546625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.547228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.547881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.549638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.550123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.583161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.583670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.584282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.614334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'flavor' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:28.624156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.624769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.633141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.633533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.634080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.634864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.635356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.635973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.651153 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-05305e51-2f3e-4a13-9527-d6fcaea8c9cb tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags" status: 204 len: 0 microversion: 2.26 time: 0.128055 Oct 04 18:14:28.656971 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1033/4245] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 18:14:28 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969/tags => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:28.666144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.670334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.686384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.691436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.692280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.693336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.694041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.694726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.733215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:28.833999 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ede536b3-1401-42f4-83db-4cbc62d0562b tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 204 len: 0 microversion: 2.26 time: 0.175243 Oct 04 18:14:28.835072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1034/4246] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:28 2022] DELETE /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:28.841288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.842317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.848671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.849453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.850030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.851263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.851671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.852409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.105043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.112876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5687f731-0b4e-473f-9b5f-f6275dd93708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1683 microversion: 2.1 time: 0.494993 Oct 04 18:14:29.113461 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3213/4247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1683 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:29.118053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.118661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.125240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.125735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.126202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.126887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.127461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.128077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.260236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.269468 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aac326eb-ae2a-4276-82f5-289e0be865e7 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 0.432824 Oct 04 18:14:29.283772 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1035/4248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:29.290432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.291113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.297930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.298433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.298908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.299635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.300627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.300627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.428278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.437561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.439397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.440777 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6ed4c3c-b6fe-4d1a-b7ac-0138cd297667 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.156102 Oct 04 18:14:29.441477 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1036/4249] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:29.469144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.470057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.477661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.479206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.479721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.480628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.481349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.481865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.493468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.519455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.520909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.522133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7c24dd36-aeda-445e-a3df-3a10a754f8fd tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1551 microversion: 2.26 time: 0.407741 Oct 04 18:14:29.522891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3214/4250] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1551 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:29.595703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lazy-loading 'services' on Instance uuid ab290747-63ae-4936-a904-a09687e4af13 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:29.677063 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7f9f512f-7802-4f92-950e-8b16c6068808 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13/os-volume_attachments/43b7653e-f4df-4eb9-8ad5-95f7a2437416" status: 202 len: 0 microversion: 2.1 time: 0.223562 Oct 04 18:14:29.678348 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1037/4251] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:14:29 2022] DELETE /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13/os-volume_attachments/43b7653e-f4df-4eb9-8ad5-95f7a2437416 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:30.139064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.139717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.149338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.149899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.150409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.151306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.151810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.152487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.298043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.299163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.314310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.315163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.315797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.316694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.318914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.319589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.377447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.393799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d56d6c55-70a6-4c08-a688-3c0df5178ee2 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1615 microversion: 2.1 time: 0.259488 Oct 04 18:14:30.394411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3215/4252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1615 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.475417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.476047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.493532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.497193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.497670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.499623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.500107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.503775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.801683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.813652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.819116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.820919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08ff72b7-36db-465c-947a-3712599df743 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.350886 Oct 04 18:14:30.831943 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3216/4253] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:30.837395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.839339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.849294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.855858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.856734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.857980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.858641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.859460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.582120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.605519 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fa18b59b-e421-4a72-94b6-2cb3eee367cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1514 microversion: 2.1 time: 1.312535 Oct 04 18:14:31.627768 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1038/4254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1514 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:31.668951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c", "name": "network-vif-deleted", "tag": "020df383-fbc8-4ce5-8664-4c2697aa699b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:31.699954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.708182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.709332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.757850 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] Creating event network-vif-deleted:020df383-fbc8-4ce5-8664-4c2697aa699b for instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c on n-h2-831193-17 Oct 04 18:14:31.778905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-69e52bfe-3ce4-4259-9c11-58b8d8813818 req-51eb62bd-5848-4afa-a6f9-8e96e32f9fa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148824 Oct 04 18:14:31.780886 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1039/4255] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:31.791851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:31.805575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:31.829555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.830569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.831494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.833557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.835501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.837986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.014434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.015259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.016022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.016950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lazy-loading 'fault' on Instance uuid f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:32.105792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.110906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.114672 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df866aea-616f-497c-82ce-f6003bc0f0f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 200 len: 1332 microversion: 2.1 time: 0.330880 Oct 04 18:14:32.116083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1040/4256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:31 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.120953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.121565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.127602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.128385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.128985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.129438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.130071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.130839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.130983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.131609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.132149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-461e4cd2-1a1b-4f9c-be6d-186870cfcbb3 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1551 microversion: 2.26 time: 1.298862 Oct 04 18:14:32.142673 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3217/4257] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1551 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:32.306171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.323499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.325450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.331215 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1848c490-7385-4e1a-962c-3c65df4b4d01 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.209918 Oct 04 18:14:32.333426 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1041/4258] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:32.659759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.660798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.670247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.674136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.675596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.676744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.677569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.678623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.908522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.919489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37ceeb0e-ba8b-4f62-a157-7f6296e2d84a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1520 microversion: 2.1 time: 0.261032 Oct 04 18:14:32.929610 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3218/4259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:33.139820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.140378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.151559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.152085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.152517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.153245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.153709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.154139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.165220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.165843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.177505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.178009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.178453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.179193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.179675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.180084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.201049 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c HTTP/1.1 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c'} Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:33.203326 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea27e24b-868a-41e9-b238-945709e63708 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 404 len: 111 microversion: 2.1 time: 0.069138 Oct 04 18:14:33.210142 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1042/4260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:33.216798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-629206ce-88b4-4a3a-a916-8e28f20a2191 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '.version_select at 0x7f6341f4d670>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.231302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:33.251010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.251529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.251983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.252526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lazy-loading 'fault' on Instance uuid a4d04e90-7621-4e07-be7a-880033c96969 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:33.256784 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-629206ce-88b4-4a3a-a916-8e28f20a2191 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077403980" status: 202 len: 0 microversion: 2.1 time: 0.044074 Oct 04 18:14:33.257688 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1043/4261] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:14:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077403980 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:33.359109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.365680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.369307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.377098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.378320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9771c9f0a4d412a94a1243ef4f8f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6d4fb1b2704e929c0371d74ee20e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.386031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f74467f1-004d-45ca-b905-8207d94e436e tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 200 len: 1352 microversion: 2.26 time: 0.224589 Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.399152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.399893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3219/4262] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 1352 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:33.509619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.523702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.527006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.534591 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fa2a4d66-cd95-4adb-899c-671c5ec09d51 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.178343 Oct 04 18:14:33.535497 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1044/4263] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:33.877190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d04e90-7621-4e07-be7a-880033c96969", "name": "network-vif-deleted", "tag": "8e743750-3262-49f0-8d26-47548b8a701e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:33.898973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.899498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.899937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.912331 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] Creating event network-vif-deleted:8e743750-3262-49f0-8d26-47548b8a701e for instance a4d04e90-7621-4e07-be7a-880033c96969 on n-h2-831193-17 Oct 04 18:14:33.917218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e829f770-d582-44d4-a111-be9beaa11cd5 req-345dda7d-aef0-40fe-9cd2-4c2c2e6f4d76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043677 Oct 04 18:14:33.918179 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3220/4264] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:33.945078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.946097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.954748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.956832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.957941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.960259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.960919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.963845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.307812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.317802 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf57b303-498a-46f4-8b72-abb74aba8ff2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1520 microversion: 2.1 time: 0.376587 Oct 04 18:14:34.319013 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1045/4265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.416724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.417340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] [instance: a4d04e90-7621-4e07-be7a-880033c96969] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.431625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.432136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.432580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.433300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.433972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.434578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.450396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] HTTP exception thrown: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Request method failure captured: Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 HTTP/1.1 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHfp19U1QaZAg5F7dOGMWHnugJgvgqmkfcOYMDuuWzuWOG7Fu6QqqMF0ENXNBExtFmOmtGOcY_ppF97admvI4pbpFo9h-BZtHmCRW6WbFKb1cqZXTBbQi5BpDzB8ccmMq6GthSlGxkpuyTtMwwfDch8pT85ZPlTwS5bJsSfP5ZUvwaI Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: df6d4fb1b2704e929c0371d74ee20e29 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerTagsTestJSON-548905244 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df6d4fb1b2704e929c0371d74ee20e29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df6d4fb1b2704e929c0371d74ee20e29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df6d4fb1b2704e929c0371d74ee20e29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df6d4fb1b2704e929c0371d74ee20e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerTagsTestJSON-548905244 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: df6d4fb1b2704e929c0371d74ee20e29 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerTagsTestJSON-548905244 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerTagsTestJSON-548905244-project Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: e9771c9f0a4d412a94a1243ef4f8f682 Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerTagsTestJSON-548905244-project Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a4d04e90-7621-4e07-be7a-880033c96969'} Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.453480 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. Oct 04 18:14:34.458894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.460302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] Returning 404 to user: Instance a4d04e90-7621-4e07-be7a-880033c96969 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:34.461374 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91e98230-256d-4f02-bf4c-5e12b9a31509 tempest-ServerTagsTestJSON-548905244 tempest-ServerTagsTestJSON-548905244-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969" status: 404 len: 111 microversion: 2.26 time: 0.049060 Oct 04 18:14:34.462547 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3221/4266] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/a4d04e90-7621-4e07-be7a-880033c96969 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:34.572286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.578897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.592146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.595050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.596172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.597143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.598799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.599553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.772571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.784752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.791644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.793373 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26b26ae4-7fce-4a24-883c-5c73d6cfa6e9 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.232726 Oct 04 18:14:34.795869 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1046/4267] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:34.976055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d662484-76e6-4d42-a54b-9e70e512e227 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: .version_select at 0x7f634006b310>, body: {"keypair": {"name": "tempest-keypair-743899917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChLCOl7hjeO2VKGETDySLQsykoxI6tfyFFLIvX50lm0RKffTjhbEMJGp3sw98oosua32kysbpU3FNSPOMoVUNFyLtdgr19Zve3zzvQHIZvPuPJC/XzVM13GfVKAcBK64w=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:35.037722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5d662484-76e6-4d42-a54b-9e70e512e227 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:35.053390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5d662484-76e6-4d42-a54b-9e70e512e227 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:35.108929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d662484-76e6-4d42-a54b-9e70e512e227 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137777 Oct 04 18:14:35.109895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3222/4268] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:14:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:35.343693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.351420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.367563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.376820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.378988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.381782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.387485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.391293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.759670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.769791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-43222369-9487-49df-8620-98003b7e4630 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1520 microversion: 2.1 time: 0.430254 Oct 04 18:14:35.770517 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1047/4269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:35.823875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.825358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.836382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.837759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.838483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.840048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.841123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.842686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.929600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.941220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.943990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.946432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e4765ca-a694-4c24-b28b-c8230ab1f99e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.128329 Oct 04 18:14:35.947714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3223/4270] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:35.976504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a93df-ffa7-4532-857e-ea3354746160", "name": "network-vif-unplugged", "status": "completed", "tag": "18c172bb-ba8a-44c3-8c77-ebdc50fd5228"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:35.998693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.000766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.002310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.018035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:36.020813 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] Creating event network-vif-unplugged:18c172bb-ba8a-44c3-8c77-ebdc50fd5228 for instance ee6a93df-ffa7-4532-857e-ea3354746160 on n-h1-831193-17 Oct 04 18:14:36.027183 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-11780bf6-8aab-4441-9bf7-7e20f6d2b73e req-e6443c7a-86c8-4a62-a2d0-71d13e842560 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056559 Oct 04 18:14:36.028308 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1048/4271] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:36.798984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.799818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.820024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.821668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.822841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.824369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.824917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.827550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.978830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.979658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.993107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.998608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.999309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.000203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.000788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.003648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.159560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.182380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.185039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.187332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f8ce60f1-b43b-4e00-9f97-1e4dcf7188c0 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.212751 Oct 04 18:14:37.188223 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1049/4272] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:37.307063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.316460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7970eeb4-73b8-42e9-a79f-871d3a8b0181 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1520 microversion: 2.1 time: 0.522450 Oct 04 18:14:37.318372 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3224/4273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:37.622837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:37.623398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.648606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.650208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.652612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.657850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.659181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.660068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.724625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:37.898123 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36b17c1d-29fc-4dcd-ab7f-df33fd745aa9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 204 len: 0 microversion: 2.1 time: 0.278900 Oct 04 18:14:37.898985 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1050/4274] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:37 2022] DELETE /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:37.908614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:37.909988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.923774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.924851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.925562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.926524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.927199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.927859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.065534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a93df-ffa7-4532-857e-ea3354746160", "name": "network-vif-plugged", "status": "completed", "tag": "18c172bb-ba8a-44c3-8c77-ebdc50fd5228"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:38.108417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.115846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.117869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.150512 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] Creating event network-vif-plugged:18c172bb-ba8a-44c3-8c77-ebdc50fd5228 for instance ee6a93df-ffa7-4532-857e-ea3354746160 on n-h1-831193-17 Oct 04 18:14:38.164461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-cbf8b969-a4dd-4ce6-ab50-61454751b6f5 req-4e9b8d32-c35e-4501-b77d-86e5669a6a53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103439 Oct 04 18:14:38.166150 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1051/4275] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:38.224441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.226231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.251159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.252671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.254423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.255506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.257136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.257458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.294387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.308381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-833eee3c-a8f5-4aeb-80df-65bdae12e401 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1513 microversion: 2.1 time: 0.403993 Oct 04 18:14:38.310176 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3225/4276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:37 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1513 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:38.350270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.350884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.362170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.363383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.364258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.367442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.368117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.369298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.423963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.437259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.442486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.444008 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df3098ea-5fa9-4a85-a30b-4baf1b2aa46e tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1408 microversion: 2.54 time: 0.232509 Oct 04 18:14:38.447737 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1052/4277] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:38.695043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.707347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-821f45c0-84fe-43ec-adf2-b024a1772fca tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1520 microversion: 2.1 time: 0.362564 Oct 04 18:14:38.708219 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3226/4278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:39.339395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.340015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.366089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.366685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.368934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.369701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.370165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.370601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.422566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1662874261", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "026cefdc-3a81-4fee-9860-a3ebae88796b"}], "security_groups": [{"name": "tempest-securitygroup--978108175"}], "key_name": "tempest-keypair-743899917", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:40.529889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] validate_networks() for [('026cefdc-3a81-4fee-9860-a3ebae88796b', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:41.283480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.291849 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5da5481f-fa4a-44cc-9d43-de6ed05a32f8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1513 microversion: 2.1 time: 1.956825 Oct 04 18:14:41.298662 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1053/4279] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1513 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.303651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.304271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.306222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:41.331917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.332787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.333237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.333971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.334427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.335063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.652404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.682266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.690905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.696994 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-75208590-a25d-48a1-ac59-8b8b78bd9002 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1414 microversion: 2.54 time: 0.396940 Oct 04 18:14:41.698472 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1054/4280] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:41 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1414 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:41.728759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.729380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.752357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.756506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.758006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.759395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.761060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.761798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.232410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:42.232992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:42.233565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:42.234356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:42.235224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:42.244353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.247834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.248748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.249065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.249911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.250943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.250943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.257539 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0a64f50-5416-49b6-ae6f-112cecf0d373 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1505 microversion: 2.1 time: 0.542099 Oct 04 18:14:42.258144 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1055/4281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:41 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.278289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab290747-63ae-4936-a904-a09687e4af13", "name": "network-vif-deleted", "tag": "c9866a0b-7194-4014-ba95-9373e6a8fef6"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:42.306397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.307114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.307382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.335907 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] Creating event network-vif-deleted:c9866a0b-7194-4014-ba95-9373e6a8fef6 for instance ab290747-63ae-4936-a904-a09687e4af13 on n-h2-831193-17 Oct 04 18:14:42.339960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:42.342230 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8aacb71b-f1f6-40ce-b121-a00f63c764ba req-19192568-56c8-4072-9447-a812113725b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082651 Oct 04 18:14:42.343337 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1056/4282] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:42.352824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.356659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:42.360011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.376796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.377459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.377898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.378615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.379093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.379304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:42.379524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.382013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:42.438093 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4f17f8e-e9c9-4a48-a315-e93f95ac0a3f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.020637 Oct 04 18:14:42.443172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3227/4283] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 3026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:42.453237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.453860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.471237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.471745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.472390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.473298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.473929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.474527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.520136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.520948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.521553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.522186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lazy-loading 'fault' on Instance uuid ab290747-63ae-4936-a904-a09687e4af13 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:42.620871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.637695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b942098-4d15-4995-b883-e969298d5b19 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 200 len: 1308 microversion: 2.1 time: 0.193432 Oct 04 18:14:42.640047 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3228/4284] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.645100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17f586b8-32b6-438f-9998-0910b0ac5b0d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.645728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17f586b8-32b6-438f-9998-0910b0ac5b0d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.786283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17f586b8-32b6-438f-9998-0910b0ac5b0d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.822602 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17f586b8-32b6-438f-9998-0910b0ac5b0d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1241 microversion: 2.1 time: 0.180073 Oct 04 18:14:42.824354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3229/4285] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1241 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.839085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.846015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.868113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.876575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.881560 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-97c9ceb0-f999-451d-b717-2310ded231f0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 200 len: 1505 microversion: 2.1 time: 0.532811 Oct 04 18:14:42.881945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.884047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.885079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.885755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.886379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.888341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1057/4286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.922048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.926257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.946899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.947432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.947874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.948591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.949047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.949474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.978667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:43.057067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.069291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.070877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.072470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a797cd5c-e0c5-4836-b013-4ccd6380cb8c tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1414 microversion: 2.54 time: 0.245448 Oct 04 18:14:43.074251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3230/4287] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1414 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:43.145250 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c7c2490-58ed-4e5c-8679-35df49a0bee6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 204 len: 0 microversion: 2.1 time: 0.230371 Oct 04 18:14:43.152027 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1058/4288] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:42 2022] DELETE /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:43.308274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1033118442", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2072034b-6e21-4b7a-9493-4d035d819d48"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:43.664894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.666851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: ab290747-63ae-4936-a904-a09687e4af13] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.676544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.677551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.678879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.679871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.681293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.681953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.730533 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] HTTP exception thrown: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Request method failure captured: Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 HTTP/1.1 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHc1GNHiBQ7n_is9pcP83PWAEtT7P4ND4H20lJ60rGC7O5rtGvNR4NYy4ZPtufEK3hVAVB_reoeZuwx6v_DnkkyuzkBBZHT_Znl_xQDP-p4Gp0Cw2OsL2HqET0L8x4HB5XMpKC8vq9JkFTkL7ezb901eEeylSv-Q6xO2alJJ9NuB1ws Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 54ae765ee8d840a183c31042c04a77e7 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 54ae765ee8d840a183c31042c04a77e7 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesSnapshotTestJSON-381460991-project Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: ab24f5754daf4459b3ffabc071d436bf Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesSnapshotTestJSON-381460991-project Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ab290747-63ae-4936-a904-a09687e4af13'} Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:43.732606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. Oct 04 18:14:43.737515 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:43.742073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Returning 404 to user: Instance ab290747-63ae-4936-a904-a09687e4af13 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:43.743675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d850ad79-0fae-4848-b981-0de792a32302 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13" status: 404 len: 111 microversion: 2.1 time: 0.085154 Oct 04 18:14:43.744763 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1059/4289] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/ab290747-63ae-4936-a904-a09687e4af13 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:43.846448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.847192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.856807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.860027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.860464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.861262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.867843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.868555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.909945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] validate_networks() for [('2072034b-6e21-4b7a-9493-4d035d819d48', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:43.991574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.001789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c053b452-7d2d-4925-a31b-32ce8c940267 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1293 microversion: 2.1 time: 0.159405 Oct 04 18:14:44.003938 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1060/4290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:44.105918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.106682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.131382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.135187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.142492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.143349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.143843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.144289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.359865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.384776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.386427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.387695 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5421e26d-ba58-4c07-809f-515000e916ad tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1399 microversion: 2.54 time: 0.288595 Oct 04 18:14:44.396782 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1061/4291] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1399 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:44.417344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f9870bea-7744-46d7-85a4-ce29f7c82b87 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '.version_select at 0x7f6341d48c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.488160 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f9870bea-7744-46d7-85a4-ce29f7c82b87 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-634948520" status: 204 len: 0 microversion: 2.54 time: 0.075565 Oct 04 18:14:44.490399 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1062/4292] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-634948520 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:44.502338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.503090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.511997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.513549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.514258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.515370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.516674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.517910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.565956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:44.643997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:44.702940 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dca3c638-eeb2-4fa3-9191-cd71a8716274 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 204 len: 0 microversion: 2.54 time: 0.205309 Oct 04 18:14:44.708034 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1063/4293] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:44 2022] DELETE /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:44.717821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.719074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.727071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.728616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.729407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.730361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.730992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.731956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.941777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.954141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.961245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.962606 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9425c82f-c856-4919-b58f-3cbfd2aca299 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1405 microversion: 2.54 time: 0.252861 Oct 04 18:14:44.963303 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1064/4294] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:45.027553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.028264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:45.036724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.039563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.040143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.047948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.048586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.049442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.193350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.215352 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b8bd524-0830-4227-9edd-d0f3f8f42601 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1299 microversion: 2.1 time: 0.182812 Oct 04 18:14:45.217532 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1065/4295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:45 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:45.318269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:45.319437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:45.320178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:45.321029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:45.321651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:45.336481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.339814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.340998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.342206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.343073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.343855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.398052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:45.411894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for user e495f9ba7f7f4ec6ba19d7a3cf10f2d1 and project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:45.442927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:45.450487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:45.549872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b92cf1b1-0a5e-43b0-af94-ac27c9d87efd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246979 Oct 04 18:14:45.555873 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3231/4296] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:45.567667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96a4f23f-e88e-4306-9dc4-57eefd1e4efc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.568283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-96a4f23f-e88e-4306-9dc4-57eefd1e4efc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:45.680305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-96a4f23f-e88e-4306-9dc4-57eefd1e4efc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.698986 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-96a4f23f-e88e-4306-9dc4-57eefd1e4efc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1218 microversion: 2.1 time: 0.133496 Oct 04 18:14:45.700762 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1066/4297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:45 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:45.991553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.992573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.013487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.016508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.017527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.020631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.022015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.023264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.201690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.226592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.235700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.241675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.242476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.257159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66f879ab-54f4-4f24-89dc-cbe439c1961f tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1405 microversion: 2.54 time: 0.270680 Oct 04 18:14:46.270119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3232/4298] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:45 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:46.291264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.291890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.294043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.295001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.295614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.297987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.534913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a93df-ffa7-4532-857e-ea3354746160", "name": "network-vif-deleted", "tag": "18c172bb-ba8a-44c3-8c77-ebdc50fd5228"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:46.565131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.565816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.568754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.632468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] Creating event network-vif-deleted:18c172bb-ba8a-44c3-8c77-ebdc50fd5228 for instance ee6a93df-ffa7-4532-857e-ea3354746160 on n-h1-831193-17 Oct 04 18:14:46.644115 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-87b10883-c61d-4c66-8baf-0d36a8196a0e req-083fa690-5e46-4c77-a35b-3c7e1cc14f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113124 Oct 04 18:14:46.647630 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3233/4299] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:46.724378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.725271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.741143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.741812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.743230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.749444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.750312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.752628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.836158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.847482 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-399fb3b8-1de9-4e70-a943-d521dc92f126 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.610320 Oct 04 18:14:46.871411 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1067/4300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.968023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.979824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-347a6d4d-3fe5-4f34-9bfa-e8e6f9e38401 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1222 microversion: 2.1 time: 0.258775 Oct 04 18:14:46.983697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3234/4301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:47.301368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:47.302013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:47.341162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.342542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.345933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.346712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.349821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.350342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.421402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.422180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.422808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.423659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lazy-loading 'fault' on Instance uuid 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:47.681744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:47.839353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:47.868132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a224b0ebf0946a19e3d669720daaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94585303b2844fcaf2bb00be0fa1de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:47.878341 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e50eb867-3f46-4711-a668-1bb6e54f1846 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 200 len: 1410 microversion: 2.54 time: 0.580667 Oct 04 18:14:47.881996 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1068/4302] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:47 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 1410 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:47.887020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:47.887898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:47.900741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.901578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.903660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.905516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.910381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.911166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.009746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.010621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:48.048897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.050742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.058065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.062661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.064004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.066840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.010535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.019485 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e5299184-6b85-4269-8cdc-040804dbd9ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1270 microversion: 2.1 time: 1.014051 Oct 04 18:14:49.020330 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1069/4303] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1270 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.025245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.026082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] [instance: 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.032979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.033769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.034443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.035465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.036179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.036842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.051658 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] HTTP exception thrown: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Request method failure captured: Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed HTTP/1.1 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfuoox2t3ROST0cQkBbNiBiwV4SOc4vdmZkZEk00ajbFA_bsWl0IVffFzqn9Z_q3jy8s_pYvvaSmqIFofqmsvhg2P_anM8YxmjQ375xAitgm1wsGHrH6v9wCbaKRYA8YSUPUjKhdmgt3dEvJye4pj-QIF7lye7B2V4EMLu6Zc_1cCc Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a94585303b2844fcaf2bb00be0fa1de6 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerShowV254Test-1715933601 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94585303b2844fcaf2bb00be0fa1de6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94585303b2844fcaf2bb00be0fa1de6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94585303b2844fcaf2bb00be0fa1de6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94585303b2844fcaf2bb00be0fa1de6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerShowV254Test-1715933601 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a94585303b2844fcaf2bb00be0fa1de6 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerShowV254Test-1715933601 Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerShowV254Test-1715933601-project Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 1a224b0ebf0946a19e3d669720daaebb Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerShowV254Test-1715933601-project Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed'} Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:49.053713 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. Oct 04 18:14:49.058337 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:14:49.060766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] Returning 404 to user: Instance 223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:49.061879 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a76909d9-d722-464b-b5a3-85e9ff131524 tempest-ServerShowV254Test-1715933601 tempest-ServerShowV254Test-1715933601-project] 10.222.0.33 "GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed" status: 404 len: 111 microversion: 2.54 time: 0.040453 Oct 04 18:14:49.071684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1070/4304] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/223a78bd-b4a9-4c8e-a2aa-c32b6c06d8ed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:49.396757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.410150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06f939c6-1e80-4dcb-bdb1-67bdf3d37024 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 1.525645 Oct 04 18:14:49.410801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3235/4305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:47 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:50.046812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.047682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.064032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.064828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.065298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.068843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.069678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.070327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.309510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.322844 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0ba0600-0799-4dee-8639-54691288cd04 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1276 microversion: 2.1 time: 0.282335 Oct 04 18:14:50.329927 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1071/4306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:50.434632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.435383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.438345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:50.452562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.453327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.454074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.479409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.484002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.491422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.554590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f940f1-1345-4356-94f8-4578d1ea8581", "tag": "ddf62a7c-3a4b-4d07-9449-122cbecbaf07"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:50.609254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.609749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.610190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.631664 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] Creating event network-changed:ddf62a7c-3a4b-4d07-9449-122cbecbaf07 for instance e5f940f1-1345-4356-94f8-4578d1ea8581 on n-h2-831193-17 Oct 04 18:14:50.649336 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4dd0c927-5bc4-454d-8eb7-7e2ae1dbfcdf req-88ab0cac-a176-4f15-b4cb-5f117b66892a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105645 Oct 04 18:14:50.668450 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1072/4307] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:51.363748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.364148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.365431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.376386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.377106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.382485 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e1576f9-15d0-43e9-9c11-e64511b12d42 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.943664 Oct 04 18:14:51.383396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.384342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.384971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.385559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.392286 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3236/4308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.752503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.767002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f99b8b2b-bb7f-42e0-94e5-c88ff7d620d4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.409979 Oct 04 18:14:51.768204 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1073/4309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.418873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.421344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.436614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.437300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.438667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.441998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.442611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.444387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.796535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.797316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.810565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.813781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.835577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.836710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.837369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.838853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.839181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.849253 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b040b48-e404-4a36-a0e7-14816afa05e5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.434655 Oct 04 18:14:52.861003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3237/4310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.274913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.305459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0ad5ade2-5709-41cb-b8ad-3f30a4f30750 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.511870 Oct 04 18:14:53.306673 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1074/4311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.428222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95345312-6bce-4ce9-827f-01c28809a7b5", "tag": "1617263b-7f74-426c-9069-e8640635a084"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:53.447431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.447927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.448360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.474597 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Creating event network-changed:1617263b-7f74-426c-9069-e8640635a084 for instance 95345312-6bce-4ce9-827f-01c28809a7b5 on n-h2-831193-17 Oct 04 18:14:53.489738 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065495 Oct 04 18:14:53.491261 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3238/4312] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.879473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.880350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.896855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.897649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.898314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.900712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.901458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.902104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.034095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.035166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-25f6099e-f452-4025-a4f1-49b6dcbd118f req-4027a619-d484-44e2-836e-9cba1fb86ff8 service nova] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001544 Oct 04 18:14:54.035525 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3239/4313] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 18:14:54.330631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.331422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.348630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.349177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.352580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.353420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.353915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.354364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.744857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.757783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08ab2969-4205-47f8-9b1e-cdd849dbf6b6 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.885642 Oct 04 18:14:54.763072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1075/4314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.371877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:55.431016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=18 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:55.563776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.587016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9843499a-b8b1-4369-a8a7-f4c21d909824 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 1.257642 Oct 04 18:14:55.595398 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3240/4315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.627737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1759228536", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:55.697364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:55.739590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] validate_networks() for [('c840ae96-230e-4b77-adf7-e2780d10b5d7', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:55.784919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.785737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.799356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.800806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.801527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.802530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.806526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.807305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.187543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.201224 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-465b23c2-d52b-4bd7-b4ce-ca012e8f8a1c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.419607 Oct 04 18:14:56.203206 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3241/4316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:56.216040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1210365028", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "0f4b44f7-0ef4-4ddc-9402-93923f0eddc7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:56.323693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] validate_networks() for [('0f4b44f7-0ef4-4ddc-9402-93923f0eddc7', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:57.173874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:57.175197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:57.175823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:57.176399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:57.176917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:57.198061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.199518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.201764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.203499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.205393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.207187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.260794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Getting quotas for project b40e31e7143c4569ab5cb1c37989b048. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:57.277354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Getting quotas for user 8af2155917fb4782857c0a1a218813cd and project b40e31e7143c4569ab5cb1c37989b048. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:57.318231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:57.323803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:57.387405 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-12153924-06f3-4964-8f0f-19504c2f25a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090904 Oct 04 18:14:57.395166 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1076/4317] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:57.402157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.403067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.412184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.413046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.413680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.415016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.415920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.416524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.762482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:57.762974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:57.763441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:57.763882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:57.764393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:57.785187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.785711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.786193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.787123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.787594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.788117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.837061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:57.875251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Getting quotas for project 54ae765ee8d840a183c31042c04a77e7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:57.893682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Getting quotas for user ab24f5754daf4459b3ffabc071d436bf and project 54ae765ee8d840a183c31042c04a77e7. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:57.916783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:57.919139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:57.927863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.938744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab368696-ed19-4d71-8dbc-a76f3fb07eb0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.542149 Oct 04 18:14:57.941315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1077/4318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.955601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.956611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.968440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.972905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.973656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.974633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.975366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.976067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.039965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3deacf67-1595-4747-80ce-62e6fdb7dbac tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835484 Oct 04 18:14:58.058084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3242/4319] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:58.063449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.072001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.221540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.227279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.237447 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1217 microversion: 2.1 time: 0.177917 Oct 04 18:14:58.239312 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.293257 Oct 04 18:14:58.241148 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1078/4320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.242791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.244212 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1b68804-ae5e-4895-96ff-d099b6329158 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001784 Oct 04 18:14:58.244945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1079/4321] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:14:58.252059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8beeba33-29a5-42b8-89de-d29acd514a2d tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.253032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8beeba33-29a5-42b8-89de-d29acd514a2d tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.264961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3243/4322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.270517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.271870 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001835 Oct 04 18:14:58.278534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3244/4323] 10.222.0.33 () {54 vars in 1035 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 18:14:58.280909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.281935 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 04 18:14:58.299539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3245/4324] 10.222.0.33 () {54 vars in 1041 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/ => generated 388 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:58.301390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.302864 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-874df1c4-4a92-4359-8235-c4de1e2f18e7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002092 Oct 04 18:14:58.311412 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3246/4325] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:14:58.384940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8beeba33-29a5-42b8-89de-d29acd514a2d tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.403004 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8beeba33-29a5-42b8-89de-d29acd514a2d tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1219 microversion: 2.1 time: 0.154803 Oct 04 18:14:58.404989 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1080/4326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.970484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.973853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.994943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.995434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.995880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.996607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.998175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.002918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.136658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f940f1-1345-4356-94f8-4578d1ea8581", "name": "network-vif-plugged", "status": "completed", "tag": "ddf62a7c-3a4b-4d07-9449-122cbecbaf07"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:59.160094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.160637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.163132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.185300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] Creating event network-vif-plugged:ddf62a7c-3a4b-4d07-9449-122cbecbaf07 for instance e5f940f1-1345-4356-94f8-4578d1ea8581 on n-h2-831193-17 Oct 04 18:14:59.195701 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-85000c10-2e9c-426f-9c2d-9a47e7ac2610 req-f5895caa-d8a7-4a76-bd7a-7d182c6d2377 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.656101 Oct 04 18:14:59.196317 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3247/4327] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:59.246067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.257434 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad50ec07-4a1f-40e8-a5b3-c75795a752e4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.293334 Oct 04 18:14:59.275215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1081/4328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:59.284146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.285099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.296108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.296751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.298370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.303795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.304506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.305417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.306044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.306786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.315871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.316408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.317153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.327876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.336798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.337550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.652893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.688552 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e53924b9-8ded-4b34-8fb8-9ade599cf5aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1269 microversion: 2.1 time: 0.396789 Oct 04 18:14:59.691077 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1082/4329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1269 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:59.728230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.731399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.753931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.756181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.764004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.766049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.770712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.771452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.089250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.105350 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1df02a01-ffc2-425f-9726-1de24373c39c tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1271 microversion: 2.1 time: 0.396324 Oct 04 18:15:00.108152 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1083/4330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1271 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.161965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.172050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-019c0f5c-096a-42ef-b1d7-1ea4dba1391a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1366 microversion: 2.1 time: 0.892393 Oct 04 18:15:00.192800 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3248/4331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1366 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.298131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.301353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.318436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.328765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.330547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.331872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.332377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.332845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.720576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.721572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.739134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.746480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.747062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.748180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.748743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.752119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.844382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.854320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:00.865344 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4826d7bd-16c6-4643-8373-08ad4c3ab137 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.583700 Oct 04 18:15:00.868968 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1084/4332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.943889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.954685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d1219c6-82a8-496c-b40a-2e44ca7285f5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1275 microversion: 2.1 time: 0.240163 Oct 04 18:15:00.963119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3249/4333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.140973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.141901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.185810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.187423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.192998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.195775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.196279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.198197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.199070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.199826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.214012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.215351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.218868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.221784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.222461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.223151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.476664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.490998 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-33c7512d-1ef1-4b17-8811-ccbcdb4f90c8 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1277 microversion: 2.1 time: 0.358136 Oct 04 18:15:01.492863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1085/4334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.630860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.645533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd08c24a-c807-468f-9bc7-ac90ada2ff62 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1556 microversion: 2.1 time: 0.450703 Oct 04 18:15:01.648276 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3250/4335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1556 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.679427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.680785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.694245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.695651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.713410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.715546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.717022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.717626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.898836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.900481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.910693 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-549952d6-abfa-4d7d-a0c9-b5bb5461a224 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.241868 Oct 04 18:15:01.920139 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1086/4336] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:01.924723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.925222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.925660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.926386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.926839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.927291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.992852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.993704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.011832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.013425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.015536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.019313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.020158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.020771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.646554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.654664 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2f04155f-68b1-4a55-9ad5-c36b2a2a0466 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.672343 Oct 04 18:15:02.660677 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1087/4337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.665524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95345312-6bce-4ce9-827f-01c28809a7b5", "name": "network-vif-plugged", "status": "completed", "tag": "1617263b-7f74-426c-9069-e8640635a084"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.690848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:02.693573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.704731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.708052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.709043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.717580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ad3fe9e-9afb-4247-bef4-d75752de0912 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.823084 Oct 04 18:15:02.719260 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3251/4338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.736304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.737600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.746831 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] Creating event network-vif-plugged:1617263b-7f74-426c-9069-e8640635a084 for instance 95345312-6bce-4ce9-827f-01c28809a7b5 on n-h2-831193-17 Oct 04 18:15:02.750717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.751579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.752034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.755022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.757182 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c6c26212-bf12-4926-9356-7674fae1bc99 req-fd2b3870-367d-47ce-b78e-168f37881e36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095162 Oct 04 18:15:02.757675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.758011 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1088/4339] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:02.758624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.588570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.618765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca91f0b3-b211-4450-b63f-b6bd2a969df9 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.893914 Oct 04 18:15:03.629585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3252/4340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.693104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.698761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.719602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.720410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.721037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.721952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.722602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.723267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.746627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.747958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.758380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.760778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.761804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.765466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.766399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.767884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.144344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.153108 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-35df2b2f-e944-4ab8-a402-4c5ad71f26cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.479741 Oct 04 18:15:04.157857 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1089/4341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.224171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.252318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5680c534-5b59-4929-aee5-2680e4ad3dac tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1318 microversion: 2.1 time: 0.510236 Oct 04 18:15:04.253484 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3253/4342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.651644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.652329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.662602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.664526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.666679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.668716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.669206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.672714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.893211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f940f1-1345-4356-94f8-4578d1ea8581", "tag": "ddf62a7c-3a4b-4d07-9449-122cbecbaf07"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:04.907609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.908106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.908550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.924720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.934491 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-385c3929-dc4b-4b0e-8411-4edf6a8e85da tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.287846 Oct 04 18:15:04.936309 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1090/4343] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.938732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] Creating event network-changed:ddf62a7c-3a4b-4d07-9449-122cbecbaf07 for instance e5f940f1-1345-4356-94f8-4578d1ea8581 on n-h2-831193-17 Oct 04 18:15:04.954642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3c3de6c0-0a76-478b-ba4e-6580a6aed577 req-74306ba4-bba2-4131-8033-868ed8ac42d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065117 Oct 04 18:15:04.955790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3254/4344] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:05.182661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.184213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.194740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:05.218946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.219303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.220689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.221946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.222983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.223528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.225204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.225684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.226121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.259202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] Creating event network-changed:e6cd1033-d09a-40ed-bfa1-83813f407b3c for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e on n-h1-831193-17 Oct 04 18:15:05.275850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-19b3fda6-1bcb-4008-bd69-90d36681c648 req-3f028cce-3953-44b4-b595-fd7b791d911f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083610 Oct 04 18:15:05.279524 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3255/4345] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:05.293231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.296269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.314017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.318039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.321629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.323957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.327569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.329030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.613895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.622375 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8c017ae-7812-431c-aded-d8f3f8f4413b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.445709 Oct 04 18:15:05.624295 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1091/4346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.737414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.747311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ccc842ae-c63a-41a4-a2f3-98c598cdc4c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1508 microversion: 2.1 time: 0.465386 Oct 04 18:15:05.761822 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3256/4347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.775279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.776006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.785201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.785904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.786432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.799700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.800345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.800823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.962373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.965611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.985530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.988121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.988717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.989840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.991746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.992438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.209793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.235711 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eb7e8500-b260-4905-bb7b-0ea425031455 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1508 microversion: 2.1 time: 0.461135 Oct 04 18:15:06.237301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1092/4348] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:06.259795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:06.262385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.276524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.277032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.277476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.281348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.282903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.284090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.366130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.374054 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-47b895a6-4428-41a1-bfc8-999fce9e725b tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.418472 Oct 04 18:15:06.374657 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3257/4349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:06.415920 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7e58a3d7-c573-4b6c-97f6-3e4575df1167 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "PUT /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1080 microversion: 2.1 time: 0.160346 Oct 04 18:15:06.427058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1093/4350] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:15:06 2022] PUT /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1080 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:06.438013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.439220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.450295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.451815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.452636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.454001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.456076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.456824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.649670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.650624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.669079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.674884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.676079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.677854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.678859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.680008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.691190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.714088 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a11a270-99eb-4ee2-b095-b437e99f15d3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1506 microversion: 2.1 time: 0.280901 Oct 04 18:15:06.749398 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3258/4351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:06.778841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.782773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.813096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.813617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.814079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.823510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.823982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.827002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.149944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.150623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.160137 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55de5aef-90a3-481c-9d49-cd27b0f289fc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1506 microversion: 2.1 time: 0.405622 Oct 04 18:15:07.160815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3259/4352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.176228 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08544536-17c0-4e6b-a32a-1ddedafc959d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.530422 Oct 04 18:15:07.183174 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1094/4353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:07.185407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:07.188518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.194597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.195495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.196122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.196833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.197286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.197900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.301464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:07.301937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:07.302510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:07.303287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:07.304069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:07.338938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d671c0e6-f589-45cb-a9b9-7987a293c54e", "tag": "b47aefa8-7711-4b31-b144-c6d538bd0a93"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:07.360217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:07.364272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.365095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.366168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.382640 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] Creating event network-changed:b47aefa8-7711-4b31-b144-c6d538bd0a93 for instance d671c0e6-f589-45cb-a9b9-7987a293c54e on n-h1-831193-17 Oct 04 18:15:07.392907 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-06053fc2-ab26-4875-a187-dc97d236b7a3 req-7e062c47-a39f-43a4-ae60-728e52448281 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057954 Oct 04 18:15:07.393545 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1095/4354] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:07.402840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.404680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.411001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.411952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.412457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.412905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.413627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.414284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.414730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.422784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.423603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.424285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.425419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.426088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.426727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.460930 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1229429a-6610-4dfc-b9a9-c9cf9ee9485e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "POST /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5/action" status: 202 len: 1112 microversion: 2.1 time: 0.279725 Oct 04 18:15:07.462336 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3260/4355] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:07 2022] POST /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5/action => generated 1112 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:15:07.484693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.488050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.498630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.499490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.500122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.501044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.501675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.502266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.769667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.779626 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd1230d1-ee57-4035-9c01-3c8c6c3176e5 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.380549 Oct 04 18:15:07.780818 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1096/4356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.837853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:07.951486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.960851 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfc055f4-a6a6-414a-a73e-18682a9fb1a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.478837 Oct 04 18:15:07.961980 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3261/4357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.204138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.205195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.212324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.213027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.213639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.214541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.215316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.215925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.398416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.403369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:08.404581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:08.413629 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55afc33d-4884-43ce-9c84-d854bb9a234d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.213294 Oct 04 18:15:08.414503 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1097/4358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:08.637965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1514768299", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "6f31aa2d-b457-4e17-b6db-cfa8a18280ba"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:08.721614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] validate_networks() for [('6f31aa2d-b457-4e17-b6db-cfa8a18280ba', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:08.807640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.808314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.819347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.822498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.823111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.824825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.828050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.828558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.186377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.202473 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bed5b537-6f32-474b-89d0-fd4385888804 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.396890 Oct 04 18:15:09.204477 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1098/4359] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:09.215391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.221795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.241188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.243783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.244248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.244987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.249113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.250279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.491583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:09.492382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:09.492490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:09.492965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:09.493913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:09.514306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.514850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.515542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.516901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.517371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.518058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.560111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Getting quotas for project 4b8ab81375ae47f69b2f098e6965cbfb. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:09.576322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Getting quotas for user b2efab1a3ca64576ab8f8501d5274458 and project 4b8ab81375ae47f69b2f098e6965cbfb. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:09.609184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:09.613789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:09.622904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.631429 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1418c15e-1178-46ce-aa0c-04c4e0909a87 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.425029 Oct 04 18:15:09.635217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1099/4360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.651733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.652738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.661355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.662247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.663176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.664348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.665197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.665949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.727986 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c97c6ff5-3455-493c-86df-b399398a0d84 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329979 Oct 04 18:15:09.731821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3262/4361] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:15:09.743665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4cf8571-1709-49a1-b2e5-cf0893469f99 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.746799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4cf8571-1709-49a1-b2e5-cf0893469f99 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.901011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4cf8571-1709-49a1-b2e5-cf0893469f99 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.909963 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4cf8571-1709-49a1-b2e5-cf0893469f99 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1214 microversion: 2.1 time: 0.170497 Oct 04 18:15:09.910856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3263/4362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.026541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.038170 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dc246a6d-9a20-466d-93b9-2aa29edd56d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.401419 Oct 04 18:15:10.039246 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1100/4363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.225923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.226618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.237330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.238062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.238270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.239088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.239526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.240495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.429559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.444592 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e3cc590d-2439-409e-9e9d-7b693473d5cc tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.222493 Oct 04 18:15:10.459945 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3264/4364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.663246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.664600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.674119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.674857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.675545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.676562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.677105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.677548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.867374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.877280 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0b07906-f9ef-470e-8846-0482762e5071 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.221989 Oct 04 18:15:10.879410 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1101/4365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.932932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.933557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.939958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.940457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.941093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.942061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.942621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.943083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.947506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:11.022837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.032536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-98a84cd1-8899-4a3b-a20f-1230364ede3d tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1266 microversion: 2.1 time: 0.103390 Oct 04 18:15:11.033299 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3265/4366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.063781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.064397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.070632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.071149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.071591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.072437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.072897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.073328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.096789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:11.251119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.259994 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88d7c09e-6748-4104-8b6d-918890fdb1a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.200031 Oct 04 18:15:11.261207 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1102/4367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.470751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.473807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.487486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.488338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.489085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.490122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.492523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.496497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.810596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.822055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "name": "network-vif-plugged", "status": "completed", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:11.828397 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b0454aff-eb23-47ab-91e0-d139cf3bac11 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.361986 Oct 04 18:15:11.829834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3266/4368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.854121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.857899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.860402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.889950 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] Creating event network-vif-plugged:e6cd1033-d09a-40ed-bfa1-83813f407b3c for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e on n-h1-831193-17 Oct 04 18:15:11.903025 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-60c1db52-faef-44de-90df-29d42a54b1a4 req-5ce1acb8-f449-4a66-a392-ccdada6c4aa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086201 Oct 04 18:15:11.904973 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1103/4369] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:11.905653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.907105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.924683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.925502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.926840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.928062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.929837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.930289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.068998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.070237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.079684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.081622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.083608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.085089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.085726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.086496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.230799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.242082 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b70d43c-1c06-4429-a007-8e0dbaf2132a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1272 microversion: 2.1 time: 0.187600 Oct 04 18:15:12.244541 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1104/4370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.286263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.287214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.298544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.299389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.302837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.303870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.304526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.306429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.623252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.634657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27c55116-ccf2-4ca1-9a4a-92bb7e7a916b tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.734526 Oct 04 18:15:12.636319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3267/4371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:12.792877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.803343 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-67437701-5d33-4555-bfeb-92076162229b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1317 microversion: 2.1 time: 0.522102 Oct 04 18:15:12.815088 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1105/4372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:12.854519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.855463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.866060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.866688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.867461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.868211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.869340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.869864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.100039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.123610 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11a72417-7dd2-4d38-87b6-8b008c15479e tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.273076 Oct 04 18:15:13.126739 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3268/4373] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:13.270617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.271977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.281686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.283611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.284487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.285225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.286249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.287016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.581298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.592675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-77db159f-d925-4ba7-806c-abf7470e25b4 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.326445 Oct 04 18:15:13.593669 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1106/4374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:13.658846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.660536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.670073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.670793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.671465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.672354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.673032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.673660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.830150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.830776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.840914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.841981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.842497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.843372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.844124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.844806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.006340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.022295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0cc8775a-fa1e-47a1-8bb1-ea69a192c18a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.365793 Oct 04 18:15:14.025700 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3269/4375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.047513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d671c0e6-f589-45cb-a9b9-7987a293c54e", "name": "network-vif-plugged", "status": "completed", "tag": "b47aefa8-7711-4b31-b144-c6d538bd0a93"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:14.085596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.092230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.093007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.126194 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] Creating event network-vif-plugged:b47aefa8-7711-4b31-b144-c6d538bd0a93 for instance d671c0e6-f589-45cb-a9b9-7987a293c54e on n-h1-831193-17 Oct 04 18:15:14.131599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3f5c5363-f2a9-4761-bc3a-585359190feb req-3712996b-33d7-4625-8c68-f09d5c203283 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104294 Oct 04 18:15:14.135666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3270/4376] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:14.159358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.173664 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c70ae1bc-c720-4c9f-be94-8233d0523aa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.345002 Oct 04 18:15:14.174278 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1107/4377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.176161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.177322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.200213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.202109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.202808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.204283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.204985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.206295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.395334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1973361577", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:14.478856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] validate_networks() for [('c840ae96-230e-4b77-adf7-e2780d10b5d7', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:14.507719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.519802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-402ede48-6017-4c41-ba40-f509b557d068 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1319 microversion: 2.1 time: 0.362836 Oct 04 18:15:14.520495 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3271/4378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.533895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b1d7a4-d618-4f75-9963-ec2f994a05e8", "tag": "efff702f-3377-4e68-a3b1-3b1239bde471"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:14.539079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:14.544965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.545448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.545878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.567634 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] Creating event network-changed:efff702f-3377-4e68-a3b1-3b1239bde471 for instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 on n-h2-831193-17 Oct 04 18:15:14.572721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4bc8890c-fff6-4ee0-8e8d-7579425fc70d req-e4b0ebd9-d205-4e75-8743-313422008b19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050411 Oct 04 18:15:14.573719 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3272/4379] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:14.619726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.620462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.627571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.628420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.629043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.629923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.630542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.631155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.991171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.999616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a852393e-0239-4f8b-9a31-60dcd57dece2 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.387284 Oct 04 18:15:15.000429 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3273/4380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:15.052159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.053544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.069431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.069934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.070613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.071541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.072005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.072439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.434827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.445991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b7101a7-4867-41fd-b660-24425d76b7a2 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.398011 Oct 04 18:15:15.446748 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3274/4381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:15.465254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:15.467392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:15.467392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:15.467921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:15.468296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:15.478162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.478654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.479129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.479859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.480317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.480739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.504602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Getting quotas for project b40e31e7143c4569ab5cb1c37989b048. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:15.510191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Getting quotas for user 8af2155917fb4782857c0a1a218813cd and project b40e31e7143c4569ab5cb1c37989b048. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:15.523323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:15.525645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:15.543752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.544956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.553316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.554599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.555166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.556051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.556553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.557029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.573911 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0bca11f-dac5-4b19-806c-b75391b7dda3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185784 Oct 04 18:15:15.581914 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1108/4382] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:15:15.587723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d97af6de-8813-40e7-9c25-955365c96868 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.588494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d97af6de-8813-40e7-9c25-955365c96868 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.671400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d97af6de-8813-40e7-9c25-955365c96868 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.687614 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d97af6de-8813-40e7-9c25-955365c96868 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1217 microversion: 2.1 time: 0.103704 Oct 04 18:15:15.688214 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1109/4383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:15.751837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.760668 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-656f5d5b-8308-4ac0-83f6-2dbf8593ade7 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1507 microversion: 2.1 time: 0.220888 Oct 04 18:15:15.767082 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3275/4384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:15.790492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba6ef152-cb20-44e6-8b49-dcc7b5e538af", "device": "/dev/sdb"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:15.792553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.801183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.801749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.802256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.803117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.803644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.804160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.023480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.024861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.037584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.038102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.039116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.039842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.040738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.041379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.130423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4fb11ac5-9b17-4984-a30a-cfa34af6a336 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "POST /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346361 Oct 04 18:15:16.132873 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1110/4385] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:15:15 2022] POST /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:16.207132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.219021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-82cc82ab-a38c-4e33-8399-60328049bbed tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.200777 Oct 04 18:15:16.235775 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3276/4386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.474161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.475483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.484906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.490626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.491435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.492558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.494905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.496688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.710256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.710658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.719485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.719981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.720697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.721423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.721904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.722388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.770236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.781916 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae1f36a0-cc37-4837-a568-6f5d3318352a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.312686 Oct 04 18:15:16.782566 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1111/4387] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.867962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.880630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f61d22e9-74f4-4ae4-8e53-0f232375d98f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1269 microversion: 2.1 time: 0.174321 Oct 04 18:15:16.891137 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3277/4388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:17.241512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.242324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.252455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.253302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.256829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.257812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.258502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.259193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.510834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.525630 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4927f7e-dca2-4930-beaa-b4db77360006 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.285043 Oct 04 18:15:17.526742 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1112/4389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:17.806324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.806953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.837893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.838810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.839492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.840634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.841327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.842044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.910947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.911659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.922673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.924114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.926937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.928083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.929195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.929812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.329406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:18.341689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce1f0f23-4efc-4c51-ac4f-9ddc498f23ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.434688 Oct 04 18:15:18.342516 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1113/4390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:18.422146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:18.460344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-caed9cbf-ccc0-4544-be84-34ceaabc5801 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.658165 Oct 04 18:15:18.462950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3278/4391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:18.550897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.551715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.569484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.570397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.572432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.573827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.576493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.579674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.836793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:18.850301 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-243c493f-cd77-46ae-9475-76c78044cebc tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.300095 Oct 04 18:15:18.851279 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1114/4392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:19.334101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92", "tag": "294d6c49-37d4-446a-96d2-87d04be2a1da"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:19.362501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.363356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.364155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.366058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.366865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.383765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] Creating event network-changed:294d6c49-37d4-446a-96d2-87d04be2a1da for instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 on n-h1-831193-17 Oct 04 18:15:19.385782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.386467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.387096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.388234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.389410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.390750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.390907 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-222f23ca-4274-4787-8dcd-d623656139f8 req-13f2324b-28e7-4180-8569-cd78db9cb28c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068463 Oct 04 18:15:19.392053 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3279/4393] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:19.491184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.493745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.503824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.505701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.506773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.508986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.511894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.513831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.558159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:19.599901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.608825 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7547ccf1-9fe3-4144-a1c8-cbd547c86036 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.247583 Oct 04 18:15:19.616843 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1115/4394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:19.795688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.807136 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38ce13d1-73e6-43ad-85c5-2d0857b38404 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.319896 Oct 04 18:15:19.809106 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3280/4395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:19.875834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.876836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.887023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.890937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.892370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.894606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.895903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.900033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.140162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.151392 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ef4ca39c-d096-403a-a090-23f041f3fcdf tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.280086 Oct 04 18:15:20.151981 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1116/4396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:20.174058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b1d7a4-d618-4f75-9963-ec2f994a05e8", "name": "network-vif-plugged", "status": "completed", "tag": "efff702f-3377-4e68-a3b1-3b1239bde471"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:20.179584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:20.194117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.194676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.195244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.207214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] Creating event network-vif-plugged:efff702f-3377-4e68-a3b1-3b1239bde471 for instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 on n-h2-831193-17 Oct 04 18:15:20.212558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-635e7805-8ce8-4dca-bd20-9d5940f85acd req-76dfb969-a5b4-4cfa-814c-4a744adff94f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041980 Oct 04 18:15:20.213770 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3281/4397] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:20.634415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.635780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.650443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.652221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.654767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.655744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.656563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.657763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.833822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.835134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.837405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.846108 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-180a1ee7-fb7f-4b40-a6e0-d938d578c7dd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.218312 Oct 04 18:15:20.853315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1117/4398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:20.854828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.855409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.855802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.856552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.857607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.865070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.148679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.161082 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8abf81a-d4cc-4c7e-9c43-73edba4e8ea6 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.332535 Oct 04 18:15:21.162250 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3282/4399] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.183315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.184028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.194344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.196621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.197141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.201321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.202199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.202714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.482736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.501825 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55a548f9-bd38-4cfa-8708-0b4970900320 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1314 microversion: 2.1 time: 0.322767 Oct 04 18:15:21.502711 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1118/4400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.871990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.873685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.884059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.885018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.885968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.886917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.887655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.888564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.168308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.178657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-667e5c6b-6227-4cb6-a1c6-b1475c6ef264 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.310936 Oct 04 18:15:22.183181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3283/4401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.198031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:22.198685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:22.206110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.206768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.207727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.208289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.208760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.209462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.432324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.458393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e21e50b3-ffb6-480c-afc1-05503882f2a5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.265095 Oct 04 18:15:22.461967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1119/4402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:22 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.526176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:22.526894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:22.534010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.534394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.534841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.535591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.536054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.536649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.560725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:22.706009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.719624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec82ea5c-2afd-4ae3-9ebc-3aa6c152769a tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1497 microversion: 2.1 time: 0.197287 Oct 04 18:15:22.720740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3284/4403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:22 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:23.200198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.200892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:23.211214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.211716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.212161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.212881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.213340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.213772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.235573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:23.485999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.488445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:23.497947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.498967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.499709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.501429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.502470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.503192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.834064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:23.843124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:23.844616 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-17fdf412-1ede-466d-84b0-4d92d4fe2763 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.648315 Oct 04 18:15:23.860330 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1120/4404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:23.870961 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f990ab8-ad88-4ea5-9de8-cbd12d3fe074 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.387557 Oct 04 18:15:23.872805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3285/4405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.871057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.873140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.880135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.880680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.881134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.881844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.882519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.882963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.900875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.902029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.910821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.912282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.912861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.913581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.914281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.914724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.089017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.100201 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9badd53b-3df8-44ec-a6b8-8ad616a7d432 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.233113 Oct 04 18:15:25.104865 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1121/4406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.120533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.130404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f38bdd99-fcb3-45c5-95f0-236824e807cf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.233972 Oct 04 18:15:25.131308 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3286/4407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.645399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92", "name": "network-vif-plugged", "status": "completed", "tag": "294d6c49-37d4-446a-96d2-87d04be2a1da"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:25.653973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:25.659880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.660370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.661479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.674800 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] Creating event network-vif-plugged:294d6c49-37d4-446a-96d2-87d04be2a1da for instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 on n-h1-831193-17 Oct 04 18:15:25.678597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:25.680827 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-97c3513f-1cb5-4357-a2bb-1d3c72845c52 req-0fd5aab3-6807-48b7-a3a3-ce5a38fe7425 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Oct 04 18:15:25.681900 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1122/4408] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:26.125623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.126108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.134765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.135257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.135708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.136427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.136891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.137576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.160522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.161240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.169855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.174572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.175002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.175997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.176642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.177265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.464146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:26.468006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:26.472674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c83a76b3-0744-4219-9148-efb0cd3343bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1317 microversion: 2.1 time: 0.351732 Oct 04 18:15:26.475197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3287/4409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:26.478739 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eb45d50b-f6b5-4c5a-be42-151825fa14c8 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.323833 Oct 04 18:15:26.480078 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1123/4410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:26.522183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.522703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.529433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.529933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.530376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.531165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.531894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.532329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.561886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:26.650710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-530b8e99-6733-4ced-b68b-58efddce3664 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 204 len: 0 microversion: 2.1 time: 0.134039 Oct 04 18:15:26.652046 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3288/4411] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:26 2022] DELETE /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:26.661063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.661637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.672320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.673130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.673787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.674900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.675577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.676520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.834120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:26.845464 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c58cc0d1-45ba-4747-a090-d6df27f8b435 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1503 microversion: 2.1 time: 0.188334 Oct 04 18:15:26.846048 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1124/4412] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:27.510850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.511598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.516162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.516779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.520277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.521042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.521653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.523589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.524463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.525087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.525372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.526039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.526660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.527566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.528200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.528911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.764338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.771730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.775405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1dcb5d4a-a904-4e98-a0e9-950b9958a0bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1507 microversion: 2.1 time: 0.269379 Oct 04 18:15:27.776861 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3289/4413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:27.781789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8f1eaaa9-cf41-4f6b-b87f-33cbd206af5d tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.270020 Oct 04 18:15:27.782338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1125/4414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:27.799989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.800783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.806840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.807626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.808078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.808805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.809272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.810326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.837465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:27.869963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.870594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.877671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.878458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.879227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.880157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.880807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.881472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.962084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40aceaa1-329e-40b7-b375-497d6e3d1310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 204 len: 0 microversion: 2.1 time: 0.166307 Oct 04 18:15:27.962695 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3290/4415] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:27 2022] DELETE /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:27.975494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.976400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.984388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.984952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.985417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.986967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.987611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.988063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.204038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.213198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fc0a1e24-9718-426b-a4f7-b715d8de16b9 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1503 microversion: 2.1 time: 0.347234 Oct 04 18:15:28.213895 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1126/4416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:28.241194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.269021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b185e2c-fc94-4dfc-a83d-c84cb9726ddb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1513 microversion: 2.1 time: 0.301557 Oct 04 18:15:28.270093 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3291/4417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:28.745235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b1d7a4-d618-4f75-9963-ec2f994a05e8", "name": "network-vif-deleted", "tag": "efff702f-3377-4e68-a3b1-3b1239bde471"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:28.769558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.770262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.771350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.790799 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] Creating event network-vif-deleted:efff702f-3377-4e68-a3b1-3b1239bde471 for instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 on n-h2-831193-17 Oct 04 18:15:28.795689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2a542731-16ca-4e2b-9af8-e4c3c639e48d req-57123f7d-1df5-4520-bdc6-57f4142d728f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054162 Oct 04 18:15:28.796503 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1127/4418] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:28.814351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.814974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.823091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.823851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.824487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.826237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.826889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.827509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.011839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.023612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6754d6a-e6d2-49bc-8e90-2f4d9bc7febd tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.213581 Oct 04 18:15:29.024725 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3292/4419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.246669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.248380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.258606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.259442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.260098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.261042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.262152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.262704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.298354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.298987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.306531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.307052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.307497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.308211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.308683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.309113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.321426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.322166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.322833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.323542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lazy-loading 'fault' on Instance uuid 54b1d7a4-d618-4f75-9963-ec2f994a05e8 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:29.377259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2efab1a3ca64576ab8f8501d5274458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8ab81375ae47f69b2f098e6965cbfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.390024 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6e9248c-d70e-4886-81bb-f5340921fb51 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 200 len: 1304 microversion: 2.1 time: 0.147718 Oct 04 18:15:29.396227 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1128/4420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.519758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.529235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45737811-b793-43ad-8f80-175e2169ec5b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1513 microversion: 2.1 time: 0.239049 Oct 04 18:15:29.529986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3293/4421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:30.049149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.050382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.054614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:30.061662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.062214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.063321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.064070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.064539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.064975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.244823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.255363 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31779fc5-876c-41e7-834e-c69513e40eeb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.210535 Oct 04 18:15:30.257119 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1129/4422] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:30.330365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92", "name": "network-vif-deleted", "tag": "294d6c49-37d4-446a-96d2-87d04be2a1da"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:30.363421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.364042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.364528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.377387 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] Creating event network-vif-deleted:294d6c49-37d4-446a-96d2-87d04be2a1da for instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 on n-h1-831193-17 Oct 04 18:15:30.410223 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f3ed8a9c-3c0c-4972-982c-f7f8045103db req-bcf8d00e-f8d6-42d7-aa2b-0dffc9c2a76b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083461 Oct 04 18:15:30.415024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.415897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] [instance: 54b1d7a4-d618-4f75-9963-ec2f994a05e8] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.421382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3294/4423] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:30.447647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.448440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.449174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.450099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.451356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.451984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.471942 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] HTTP exception thrown: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Request method failure captured: Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 HTTP/1.1 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgo0qD4fkhxHL4CKFqKnCxwcOsrIokOVYktBipqju56e0dm1sULCzyzs-kOehQ4DoskZHynIj9xFMkF2LCo7en2vNSMIDAGMyJiY9ME5UZFjhOh23XmblmlYpfstiFrRGKrVPARAxyoa1y4crh71sbfHW2YYMmtCFUwUqpMzmQLR1I Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 4b8ab81375ae47f69b2f098e6965cbfb Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesActionsTest-471330959 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b8ab81375ae47f69b2f098e6965cbfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4b8ab81375ae47f69b2f098e6965cbfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b8ab81375ae47f69b2f098e6965cbfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4b8ab81375ae47f69b2f098e6965cbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesActionsTest-471330959 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 4b8ab81375ae47f69b2f098e6965cbfb Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesActionsTest-471330959 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesActionsTest-471330959-project Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b2efab1a3ca64576ab8f8501d5274458 Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesActionsTest-471330959-project Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '54b1d7a4-d618-4f75-9963-ec2f994a05e8'} Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:30.474019 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. Oct 04 18:15:30.479786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:30.481543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] Returning 404 to user: Instance 54b1d7a4-d618-4f75-9963-ec2f994a05e8 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:30.483492 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a64ed539-5fdd-48a1-aea2-c9dd444c1e75 tempest-VolumesActionsTest-471330959 tempest-VolumesActionsTest-471330959-project] 10.222.0.33 "GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8" status: 404 len: 111 microversion: 2.1 time: 0.073259 Oct 04 18:15:30.484643 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1130/4424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/54b1d7a4-d618-4f75-9963-ec2f994a05e8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:30.554623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.555783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.565906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.568113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.570254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.572836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.574404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.574855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.649538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.650035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.650668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.651332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'fault' on Instance uuid 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:30.698845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.707593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc40e995-c66b-42a3-8fad-24afb6879901 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 200 len: 1307 microversion: 2.1 time: 0.157502 Oct 04 18:15:30.708620 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3295/4425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.281975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.283435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.292268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.294501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.295223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.296236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.296920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.297922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.559143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:31.572218 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da3483f6-5ef5-42d1-ba5e-e12e0fcff7fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.294170 Oct 04 18:15:31.572834 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1131/4426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.731204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.732459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.739743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.740485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.741111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.742178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.742808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.743430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.758652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 HTTP/1.1 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92'} Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:31.760614 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:15:31.766535 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:31.768337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:31.769415 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4df6fd9e-6dac-4347-a260-b36d8b27657d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 404 len: 111 microversion: 2.1 time: 0.042217 Oct 04 18:15:31.770503 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3296/4427] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:31.779969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.780603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.795263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.795773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.796217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.796946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.797411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.797863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.057775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.070120 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63275061-8391-4027-882c-4348360bcd1b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.294572 Oct 04 18:15:32.076333 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1132/4428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:32.301322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f077875e-9152-4675-878c-9d0803172433 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f077875e-9152-4675-878c-9d0803172433 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 163 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": 12345, "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:32.305496 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:32.310748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f077875e-9152-4675-878c-9d0803172433 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:32.312707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f077875e-9152-4675-878c-9d0803172433 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.012345 Oct 04 18:15:32.313448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3297/4429] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:32 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:32.322031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:32.323128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:32.334575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.339158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.339668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.340414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.354959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.355568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.600563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:32.601836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:32.611501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.612282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.612944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.613922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.614543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.615173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.067318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:33.077634 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91be96bc-f28a-4952-8efc-9f546ef7c294 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.481444 Oct 04 18:15:33.079272 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3298/4430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:32 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.259343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:33.277486 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce0f55b5-2aee-4618-bb09-e7e40645484c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.959543 Oct 04 18:15:33.285192 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1133/4431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:32 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.301762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.302381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.310438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.310980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.311401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.312130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.312602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.313053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.506341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:33.509555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:33.522182 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d13e186e-667b-41b9-abbb-0040d79cde6d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.223706 Oct 04 18:15:33.523240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3299/4432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:34.105099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:34.106227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:34.114809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.137322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.137322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.137758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.138239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.138713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.427970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.444302 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16957f8c-75a4-4e4f-a1b2-03efbedb52ce tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1517 microversion: 2.1 time: 0.344054 Oct 04 18:15:34.447773 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1134/4433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:34 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.202953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.214767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.229138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.232336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.233081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.234523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.235352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.236018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.344178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-645151d2-f537-4116-bb5a-d2cfa63d26b4 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/ips" status: 200 len: 150 microversion: 2.1 time: 0.146274 Oct 04 18:15:35.351397 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3300/4434] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/ips => generated 150 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:35.478859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.483655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.504109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.507573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.508254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.509361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.510962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.513632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.860317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:35.898148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6c0ce929-0aa8-4566-b0ed-511044e7a277 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1523 microversion: 2.1 time: 0.428374 Oct 04 18:15:35.903792 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1135/4435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:36.685610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f82a4de-48ae-46ff-8aca-68363aca60ba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-445590120", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "73f6196b-d3cf-4bab-9b33-0a6755b5b430", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:36.828445 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1f82a4de-48ae-46ff-8aca-68363aca60ba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f82a4de-48ae-46ff-8aca-68363aca60ba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 357 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-445590120", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "73f6196b-d3cf-4bab-9b33-0a6755b5b430", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: exception: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-445590120', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '73f6196b-d3cf-4bab-9b33-0a6755b5b430'}], 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:36.835979 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. Oct 04 18:15:36.842927 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:36.846721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f82a4de-48ae-46ff-8aca-68363aca60ba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Block Device 73f6196b-d3cf-4bab-9b33-0a6755b5b430 is not bootable. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:36.847951 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f82a4de-48ae-46ff-8aca-68363aca60ba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.200768 Oct 04 18:15:36.852150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3301/4436] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:36.858539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:36.859401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:36.869539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.870300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.871436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.873642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.874721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.875430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.934020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:36.935408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:36.946273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.948388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.951780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.952887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.953523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.954126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.176040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:37.193516 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a810b981-60af-4d7b-a67d-82e731d36627 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.338893 Oct 04 18:15:37.207735 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1136/4437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:37.224264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.225974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:37.232947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.233777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.234454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.236319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.237026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.237680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.330832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:37.343074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c56a07ba-fe44-4579-8331-ba964a8b4e89 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1523 microversion: 2.1 time: 0.412544 Oct 04 18:15:37.344848 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3302/4438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:37.418132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:37.431219 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-56bcae1e-76c7-4a9a-965f-800d625216ca tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.210671 Oct 04 18:15:37.432297 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1137/4439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:38.237890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b43e9b6-1518-464b-8402-d387c7c3bf75"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:38.240644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95345312-6bce-4ce9-827f-01c28809a7b5", "name": "network-vif-unplugged", "status": "completed", "tag": "1617263b-7f74-426c-9069-e8640635a084"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:38.241203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.272445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.277683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.279380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.280948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.285139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.285350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.285611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.286293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.289124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.339925 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] Creating event network-vif-unplugged:1617263b-7f74-426c-9069-e8640635a084 for instance 95345312-6bce-4ce9-827f-01c28809a7b5 on n-h2-831193-17 Oct 04 18:15:38.352818 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-71e3e143-3533-4eb8-aadc-ed070285404d req-2a4d68bb-7796-4bdc-9cd8-8a3ff5d1fba0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116263 Oct 04 18:15:38.357945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1138/4440] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:38.370908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.373282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.396664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.401020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.404322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.408471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.409882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.410895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.429216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:38.858373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.869568 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e50e1ffc-3356-40be-b6ee-c1410d037fd3 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1523 microversion: 2.1 time: 0.504433 Oct 04 18:15:38.873894 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1139/4441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:38.897530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f4bb211-a034-4811-8ff4-bb0633a60d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665848 Oct 04 18:15:38.908357 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3303/4442] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:15:38 2022] POST /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:39.901010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.901616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.920077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.920635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.928771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.932765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.934357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.936378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.700795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.717397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c366af9-7ad7-4fc4-9007-678712318993 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1523 microversion: 2.1 time: 0.816949 Oct 04 18:15:40.719527 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1140/4443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1523 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.754404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95345312-6bce-4ce9-827f-01c28809a7b5", "name": "network-vif-plugged", "status": "completed", "tag": "1617263b-7f74-426c-9069-e8640635a084"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:40.791736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.797750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.803673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.860295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] Creating event network-vif-plugged:1617263b-7f74-426c-9069-e8640635a084 for instance 95345312-6bce-4ce9-827f-01c28809a7b5 on n-h2-831193-17 Oct 04 18:15:40.885086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a1331938-a778-478e-bda5-394f1a5ab651 req-05b9f3de-5320-40d6-8a15-282b879e7d7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134498 Oct 04 18:15:40.900973 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3304/4444] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:41.005407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4394c07e-3dff-4918-9f0c-d458ddc623a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1826555438", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "destination_type": "local"}, {"source_type": "volume", "uuid": "6c9376a2-8f9c-419d-bc93-410c875bea72", "destination_type": "invalid"}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4394c07e-3dff-4918-9f0c-d458ddc623a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 495 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1826555438", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "destination_type": "local"}, {"source_type": "volume", "uuid": "6c9376a2-8f9c-419d-bc93-410c875bea72", "destination_type": "invalid"}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1826555438', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6c9376a2-8f9c-419d-bc93-410c875bea72', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:41.016934 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:41.021768 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:41.029548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4394c07e-3dff-4918-9f0c-d458ddc623a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:41.030696 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4394c07e-3dff-4918-9f0c-d458ddc623a7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034711 Oct 04 18:15:41.031520 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1141/4445] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:40 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:41.047350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.048105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.059025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.065401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.065955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.071386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.071989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.072339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.490195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.498985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c82fefc-6d0d-4790-bd03-453bc8b85a14 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.462550 Oct 04 18:15:41.499655 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3305/4446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.527312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.527939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.537194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.537756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.538207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.539026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.539710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.540152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.742516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.743446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.755209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.758166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.759798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.760768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.763853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.764159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.764806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.774759 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2cdd8fe9-4ab3-4ff0-81cb-0bc76cf49585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.253452 Oct 04 18:15:41.776684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1142/4447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.004946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8554727-b56f-4b6b-b50f-7108c3feef81 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097157407", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8554727-b56f-4b6b-b50f-7108c3feef81 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 492 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097157407", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1097157407', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.009010 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b8554727-b56f-4b6b-b50f-7108c3feef81 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b8554727-b56f-4b6b-b50f-7108c3feef81 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009533 Oct 04 18:15:42.014387 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1143/4448] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:41 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:15:42.027139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.027768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.054108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.064845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33523892-0b70-4a17-b696-84eb33236f2c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1523 microversion: 2.1 time: 0.326435 Oct 04 18:15:42.065892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3306/4449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.087955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.088962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.092603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.095244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.098724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.099691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.522157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.536600 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be27b453-ee44-49bf-9c80-0e7143f2a5df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.513727 Oct 04 18:15:42.537002 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1144/4450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.586368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.588275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.616067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.617286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.618841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.620658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.623061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.624460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.868739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.884381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd1257d2-3adb-4647-99cf-6c161681ef22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.306761 Oct 04 18:15:42.891451 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3307/4451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.980775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c94d572-5518-4400-afa0-6798f1d99946 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c94d572-5518-4400-afa0-6798f1d99946 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 416 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.985245 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c94d572-5518-4400-afa0-6798f1d99946 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:42.989619 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c94d572-5518-4400-afa0-6798f1d99946 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010329 Oct 04 18:15:42.994497 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1145/4452] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:42 2022] POST /compute/v2.1/servers => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:43.003655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.004323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.017577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.020439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.021196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.021940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.022407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.028915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.093715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.096158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.113410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.114367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.115077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.118119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.118865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.121680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.410281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.423212 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0450ca7-3057-4743-b01d-11f4184e9206 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.422568 Oct 04 18:15:43.441123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3308/4453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.454852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.457180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.468944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.469691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.471083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.472036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.472785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.473424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.482627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.495910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-527af877-5d39-48b2-b45b-19d11bab994e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1508 microversion: 2.1 time: 0.407861 Oct 04 18:15:43.498746 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1146/4454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.529679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.530629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.542129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.543182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.545391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.547562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.548467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.549917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.831542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.842334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2471d65e-493d-4801-b264-c24d652ffe82 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.392427 Oct 04 18:15:43.842947 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3309/4455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.928717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.943306 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30cd1193-4979-4f07-a0b2-fcea36ff080c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 200 len: 1508 microversion: 2.1 time: 0.419083 Oct 04 18:15:43.944203 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1147/4456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.972942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.974150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.005467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.006099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.006764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.008030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.008666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.009282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.057841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:44.132210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16da464f-5848-4045-975b-ec95594997f2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122741893", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": -1, "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:44.158221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-16da464f-5848-4045-975b-ec95594997f2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16da464f-5848-4045-975b-ec95594997f2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 206 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122741893", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": -1, "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor -1 could not be found. Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2122741893', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': -1, 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:44.166554 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:15:44.178997 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:44.183991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16da464f-5848-4045-975b-ec95594997f2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:44.189560 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16da464f-5848-4045-975b-ec95594997f2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.061299 Oct 04 18:15:44.192164 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1148/4457] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:44 2022] POST /compute/v2.1/servers => generated 73 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:15:44.205688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.214174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.235261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.236078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.236635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.237628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.238179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.238891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.280122 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6fba691-d16d-4371-936b-719c1e15092f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 204 len: 0 microversion: 2.1 time: 0.313987 Oct 04 18:15:44.281473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3310/4458] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:43 2022] DELETE /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:44.508862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.526158 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-02e8f50c-6526-4aac-a17a-c2c39c3b927f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.329410 Oct 04 18:15:44.527101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1149/4459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:44.540070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1505920654", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2072034b-6e21-4b7a-9493-4d035d819d48"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:44.567277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.571519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.599429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.603677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.608038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.612799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.614995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.619419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.631579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:44.759330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] validate_networks() for [('2072034b-6e21-4b7a-9493-4d035d819d48', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:45.040055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.070357 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04074d64-57c5-46ba-b95e-ce0ea9bde1d3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.519751 Oct 04 18:15:45.071689 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1150/4460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:45.303908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c5abc02-3d6e-47a1-bc75-8ea16e45065e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888047700", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c5abc02-3d6e-47a1-bc75-8ea16e45065e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 173 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888047700", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1888047700', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:45.332084 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c5abc02-3d6e-47a1-bc75-8ea16e45065e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2c5abc02-3d6e-47a1-bc75-8ea16e45065e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.036273 Oct 04 18:15:45.337565 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1151/4461] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:45 2022] POST /compute/v2.1/servers => generated 145 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:45.354078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.354711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.375319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.375831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.376831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.379575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.381606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.382077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.007216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.010997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:46.011556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:46.011926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:46.012871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:46.013302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:46.024311 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c853912-0c97-42ba-bd53-0b1bda86f6d4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.682046 Oct 04 18:15:46.025193 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1152/4462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.057338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.058637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.071078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.071872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.074840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.076441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.076898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.078592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.078592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.078592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.079849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.081104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.096365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.097695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.181686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:46.203861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Getting quotas for user e495f9ba7f7f4ec6ba19d7a3cf10f2d1 and project 800a1bd5b6284e6ca5fc554742cd9de3. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:46.241940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:46.245851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:46.339138 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5798c0b8-36b7-48d0-b222-c1b38fb73024 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.810681 Oct 04 18:15:46.341996 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3311/4463] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:15:46.358006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2cc7a94b-73d3-4aa2-a9f3-d68e900938d9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.358951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2cc7a94b-73d3-4aa2-a9f3-d68e900938d9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.960779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2cc7a94b-73d3-4aa2-a9f3-d68e900938d9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.976352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2cc7a94b-73d3-4aa2-a9f3-d68e900938d9 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1218 microversion: 2.1 time: 0.627449 Oct 04 18:15:46.985195 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3312/4464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1218 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.990311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:47.006675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fb9dfe51-ffed-4006-a694-a65aa8b78144 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.952216 Oct 04 18:15:47.007924 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1153/4465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:47.122869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95345312-6bce-4ce9-827f-01c28809a7b5", "name": "network-vif-deleted", "tag": "1617263b-7f74-426c-9069-e8640635a084"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:47.147184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.147629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.148067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.219547 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] Creating event network-vif-deleted:1617263b-7f74-426c-9069-e8640635a084 for instance 95345312-6bce-4ce9-827f-01c28809a7b5 on n-h2-831193-17 Oct 04 18:15:47.237092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e66ad7d7-5269-4f2f-8748-30a067ee07da req-d02e79ce-11ac-4ac2-bbd5-b365939adf4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118923 Oct 04 18:15:47.237739 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3313/4466] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:47.406406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b78f60e-db1c-4ce9-b737-0b8c403c57f0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1316004548", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:47.417956 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6b78f60e-db1c-4ce9-b737-0b8c403c57f0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b78f60e-db1c-4ce9-b737-0b8c403c57f0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 216 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1316004548", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1316004548', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.421353 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.427072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b78f60e-db1c-4ce9-b737-0b8c403c57f0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:47.429128 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b78f60e-db1c-4ce9-b737-0b8c403c57f0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023168 Oct 04 18:15:47.442398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.449659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.451599 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1154/4467] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:47.472800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.475747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.479314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.480126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.480609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.490096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.823057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:47.833939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e072bac5-94d2-44d3-94cf-207a179412cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.398909 Oct 04 18:15:47.835282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3314/4468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:47.875555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.875555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.888522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.889060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.889841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.891686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.894811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.895332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.012240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.012907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.029448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.030053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.035334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.038943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.042422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.044095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.381030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.399586 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-215f22ff-5814-4d22-abe3-60ccab58cebb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1214 microversion: 2.1 time: 0.383190 Oct 04 18:15:48.400299 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3315/4469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:48.448816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.457715 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6cfd6289-20bc-4e23-93db-09bddd8608ed tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.599923 Oct 04 18:15:48.458302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1155/4470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:48.663998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-501600063", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-key-75169756", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:48.769211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] validate_networks() for [('c840ae96-230e-4b77-adf7-e2780d10b5d7', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:49.311417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 244 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-501600063", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-key-75169756", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid key_name provided. Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-501600063', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'key_name': 'tempest-key-75169756', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-75169756 not found for user 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.314678 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:15:49.321792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.329815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid key_name provided. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:49.332334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbf61915-c53e-4ca8-8eb6-315a6a538aba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.678422 Oct 04 18:15:49.332948 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3316/4471] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 680 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:15:49.341169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.341761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.349346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.350752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.350752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.365416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.366538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.367016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.441376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.443618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.456411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.457224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.460944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.461999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.462822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.463682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.694747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.731011 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75ea6802-c34e-45f6-9848-f419530d7170 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1276 microversion: 2.1 time: 0.294083 Oct 04 18:15:49.737633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3317/4472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.851797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.861768 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-79bf190e-2960-41de-8f6b-fb8787522dd2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.524401 Oct 04 18:15:49.867006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1156/4473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:49.896110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.896972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.907682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.908539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.912526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.914227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.915071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.915757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.049752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.050552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.058471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.059890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.060539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.061464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.061923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.062365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.170659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lazy-loading 'services' on Instance uuid d671c0e6-f589-45cb-a9b9-7987a293c54e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:50.282058 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9086ea18-53e0-48a1-9a40-871f8d636230 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e/os-volume_attachments/ba6ef152-cb20-44e6-8b49-dcc7b5e538af" status: 202 len: 0 microversion: 2.1 time: 0.238184 Oct 04 18:15:50.282740 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1157/4474] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:15:50 2022] DELETE /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e/os-volume_attachments/ba6ef152-cb20-44e6-8b49-dcc7b5e538af => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:50.766539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.767307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.774345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.775090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.775804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.776694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.777711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.778685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.779359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.781705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:50.790157 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a04bbf39-61c9-4a5b-9395-0874389c215a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.899023 Oct 04 18:15:50.790761 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3318/4475] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:50.922903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.931812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366571964", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:50.939689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ed06a05-9b54-40af-b500-d30ef5d1ea93 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1276 microversion: 2.1 time: 0.174728 Oct 04 18:15:50.942552 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1158/4476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:51.135022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.security_group_api [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Neutron security group does_not_exist not found {{(pid=128770) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:15:51.137095 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 257 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-366571964", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-366571964', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:15:51.151986 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:15:51.156759 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.165790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:51.165790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f76ed93d-b332-413e-b0b9-39e17ecd7a7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.234020 Oct 04 18:15:51.165790 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3319/4477] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:51.171352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.171976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.178532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.179025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.179492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.180211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.180673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.181106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.517046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.537401 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b97ce9b-7c0d-4904-b43d-ddca1973964c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.370429 Oct 04 18:15:51.538304 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1159/4478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:51.567586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.576130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.589746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.591302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.604986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.607708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.608290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.609028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.962948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.963596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.979922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.982148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.982773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.986891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.987598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.988211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.252752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.264573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c7fe9fc-f402-4287-95cc-4ccbf9579009 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.701857 Oct 04 18:15:52.265396 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3320/4479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.287591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.288666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 243186ca-b566-481c-b9c0-19277deb90d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.295936 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/243186ca-b566-481c-b9c0-19277deb90d9 HTTP/1.1 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '243186ca-b566-481c-b9c0-19277deb90d9'} Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:52.297147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 243186ca-b566-481c-b9c0-19277deb90d9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6308ab4c-8701-4fab-9c05-1b52a35c979f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/243186ca-b566-481c-b9c0-19277deb90d9" status: 404 len: 111 microversion: 2.1 time: 0.015518 Oct 04 18:15:52.306355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3321/4480] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:52 2022] DELETE /compute/v2.1/servers/243186ca-b566-481c-b9c0-19277deb90d9 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:52.307771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.310127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.317355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.318704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.319481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.320472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.321430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.322035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.350233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.359201 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea0823c6-ee60-450e-884e-0cad3ec0a26e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.401172 Oct 04 18:15:52.368089 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1160/4481] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:52.677823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.693399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58bbecb0-b8d4-41f8-b9d5-1552ff17df8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.389185 Oct 04 18:15:52.709812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3322/4482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.722873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.724142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.734104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.735124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.736409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.737005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.737731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.738324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.768403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:53.100131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.119957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3f681bde-1c7b-43d1-ac94-00d173226aff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.402773 Oct 04 18:15:53.120486 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1161/4483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.143783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.144593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:15:53.145733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '9223372036854775808'} Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:53.157267 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:53.163526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:53.168546 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-acbefdb1-df3e-42a6-b2dc-5e5e3794d45c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.029078 Oct 04 18:15:53.170025 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3323/4484] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Oct 4 18:15:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:53.179512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.180139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.193423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.194653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.194653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.201283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.201881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.203207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.390835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.392100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.403724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.410690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.411417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.412346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.412986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.413624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.532436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.550808 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ac30ab2-7ba6-4f91-975f-bd8fc3a318df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.375966 Oct 04 18:15:53.556954 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1162/4485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.573850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2fcb01-c6a3-4231-8239-1da37409b3d9", "tag": "5fb3f29e-ad8d-4584-b681-1abae8b2b534"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:53.604962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.605451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.605891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.638125 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] Creating event network-changed:5fb3f29e-ad8d-4584-b681-1abae8b2b534 for instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 on n-h2-831193-17 Oct 04 18:15:53.644342 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-1f300e69-9455-473b-a9fd-1c8a7d75a5ab req-7907d411-442f-4ec0-854f-87d22b784e97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085621 Oct 04 18:15:53.645156 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1163/4486] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:53.651052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.656419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.667066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.671590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.672370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.678130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.678939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.679716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.911001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.920080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cae3664b-f3db-4a67-b36c-a06bf08f890f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.533555 Oct 04 18:15:53.932163 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3324/4487] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.112968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.121122 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5cb76b4d-19c0-4986-b98d-e0fcc7e8863b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.474524 Oct 04 18:15:54.127395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1164/4488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.147121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.147612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Failed to fetch instance by id -1 {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:15:54.148149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance -1 could not be found. Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '-1'} Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.149640 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:54.160705 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e337f3e8-22e8-4613-a997-b87adb63715a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008127 Oct 04 18:15:54.161578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.161578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.172177 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3325/4489] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:15:54 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:54.175699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.176197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.176811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.178765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.179281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.179717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.491864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.504161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04579b10-f184-43d6-ae98-f121a7256043 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.344142 Oct 04 18:15:54.506506 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1165/4490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.531570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.533195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.544866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.545797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.546514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.547626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.548280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.548920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.848534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.861955 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dc0b5846-e6e2-4ed8-956b-9f00fd484bc9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.333567 Oct 04 18:15:54.865433 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3326/4491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.888872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:54.890792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 53192408-c729-4bff-b0c6-24aee6a21f3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.897703 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/53192408-c729-4bff-b0c6-24aee6a21f3b/action HTTP/1.1 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 19 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: {"forceDelete": {}} Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '53192408-c729-4bff-b0c6-24aee6a21f3b', 'body': {'forceDelete': {}}} Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.911782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.917597 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:54.917597 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:54.917597 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. Oct 04 18:15:54.917597 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.919943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 53192408-c729-4bff-b0c6-24aee6a21f3b could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:54.921768 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c76b2f1-d70a-48f1-b337-b12b342541c4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/53192408-c729-4bff-b0c6-24aee6a21f3b/action" status: 404 len: 111 microversion: 2.1 time: 0.038018 Oct 04 18:15:54.925863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1166/4492] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:54 2022] POST /compute/v2.1/servers/53192408-c729-4bff-b0c6-24aee6a21f3b/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:54.930832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.931713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.939082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.940038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.940684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.941741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.942416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.943070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.958201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.958943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.970507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.971387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.971847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.972609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.981564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.982030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.211803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.223783 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b655142-44e7-4e71-81b5-82753d28aaba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.296729 Oct 04 18:15:55.225837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3327/4493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:55.250632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.251409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.261209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.263629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.264188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.265022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.269117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.269705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.273344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.284366 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8dabf770-aac2-4747-aaca-cf19522b3d01 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.330346 Oct 04 18:15:55.285283 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1167/4494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:55.447423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.455766 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a84cc06-df4c-498d-add7-d0694f908b1f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.210293 Oct 04 18:15:55.460282 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3328/4495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.483970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:55.486778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.493718 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16/action HTTP/1.1 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 39 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.506650 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:55.512400 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff945889-4e7c-4752-84f3-32151708df56 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16/action" status: 404 len: 111 microversion: 2.1 time: 0.030233 Oct 04 18:15:55.515080 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1168/4496] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:55 2022] POST /compute/v2.1/servers/43d7aec3-b4af-4df4-bbc8-0c3b80ffaa16/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:55.520335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.521238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.532934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.539788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.540477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.541423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.542051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.542646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.820186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.830251 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a491845-2a58-4630-ad78-dec8a507010c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.313600 Oct 04 18:15:55.834809 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3329/4497] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.857412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.858076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.866773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.867376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.868086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.869103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.869650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.871763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.175975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.188259 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-369312e0-1536-4fd2-b3ef-388bf5bc5932 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.336149 Oct 04 18:15:56.188852 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1169/4498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.213010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:56.221437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.222468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 38203e2b-ef09-49ec-8057-d87aa982d1bb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.231712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/38203e2b-ef09-49ec-8057-d87aa982d1bb HTTP/1.1 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '38203e2b-ef09-49ec-8057-d87aa982d1bb'} Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.237920 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.243374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 38203e2b-ef09-49ec-8057-d87aa982d1bb could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:56.249310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e44a66ed-503f-4f34-99b1-49f8b718b0cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/38203e2b-ef09-49ec-8057-d87aa982d1bb" status: 404 len: 111 microversion: 2.1 time: 0.027122 Oct 04 18:15:56.249310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3330/4499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/38203e2b-ef09-49ec-8057-d87aa982d1bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:56.255171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.255796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.272453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.272957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.273411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.274212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.274568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.274994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.310256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.319554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.330363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.331280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.332110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.336350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.337232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.337902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.625655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.641345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2692b6e3-10bc-489f-8a22-5f957f3316ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.335969 Oct 04 18:15:56.642301 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3331/4500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:56.648059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b43e9b6-1518-464b-8402-d387c7c3bf75"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:56.651151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.665460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.666790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.667571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.669417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.687272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.688097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.689711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.699277 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ec46af9-0f16-4de7-9508-48636179169e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.449463 Oct 04 18:15:56.702651 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1170/4501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.733304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.734205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.741274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.742137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.743685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.744902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.745578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.746230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.809457 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments HTTP/1.1 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 74 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: {"volumeAttachment": {"volumeId": "5b43e9b6-1518-464b-8402-d387c7c3bf75"}} Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': 'e5f940f1-1345-4356-94f8-4578d1ea8581', 'body': {'volumeAttachment': {'volumeId': '5b43e9b6-1518-464b-8402-d387c7c3bf75'}}} Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:56.813790 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 Oct 04 18:15:56.819257 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.822008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 400 to user: Invalid volume: volume 5b43e9b6-1518-464b-8402-d387c7c3bf75 is already attached to instances: e5f940f1-1345-4356-94f8-4578d1ea8581 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:56.823133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0577018a-5343-4342-a07f-a2fb11a98314 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178952 Oct 04 18:15:56.823928 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3332/4502] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:15:56 2022] POST /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 174 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:56.973448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.975748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.985419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:56.989553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.990370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.991108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.992567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.993526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.994189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.003197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.023828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a888094a-3aea-4220-802a-265af2c22609 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.296001 Oct 04 18:15:57.024707 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1171/4503] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.109895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da5218fc-df8a-4d49-a71b-a140a7f07bbb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622350099", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da5218fc-df8a-4d49-a71b-a140a7f07bbb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 237 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622350099", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-622350099', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.130786 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:15:57.136422 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.141469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da5218fc-df8a-4d49-a71b-a140a7f07bbb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:57.141469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da5218fc-df8a-4d49-a71b-a140a7f07bbb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035076 Oct 04 18:15:57.143445 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1172/4504] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:15:57.157846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.158662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.173924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.181011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.181684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.182613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.183363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.183992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.209543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lazy-loading 'services' on Instance uuid e5f940f1-1345-4356-94f8-4578d1ea8581 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:57.341084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99f39aac-da6e-4f54-932f-52e2e5ae44f1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments/5b43e9b6-1518-464b-8402-d387c7c3bf75" status: 202 len: 0 microversion: 2.1 time: 0.373348 Oct 04 18:15:57.345217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3333/4505] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:15:56 2022] DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments/5b43e9b6-1518-464b-8402-d387c7c3bf75 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:57.371191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.388385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.403915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.404853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.405483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.408078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.408738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.409176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.422767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.438641 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7b0b58d4-6087-400a-bca5-1705786c7e70 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.286149 Oct 04 18:15:57.439602 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1173/4506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:57.465993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.466993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.482553 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-96685ec8-bb07-4235-94ba-0783e0835b66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128678 Oct 04 18:15:57.483257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3334/4507] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:57.488790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.491222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.491954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.494206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.494732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.501284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.668941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.670172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.677112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.677605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.678300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.679967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.680671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.681344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.915764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.933934 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aa9fc28b-b0fe-489c-b24f-33fd62752fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.468314 Oct 04 18:15:57.935691 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1174/4508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.996250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.008543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ad1e50c-971e-4f3e-a65c-14a0a980dcc4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.343837 Oct 04 18:15:58.015488 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3335/4509] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:58.034379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c182a67-1121-4b86-9b08-751f01ebeea5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1192826210", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c182a67-1121-4b86-9b08-751f01ebeea5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 235 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1192826210", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1192826210', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.038739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:15:58.043642 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:15:58.047412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c182a67-1121-4b86-9b08-751f01ebeea5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:58.048524 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1c182a67-1121-4b86-9b08-751f01ebeea5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018075 Oct 04 18:15:58.058684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.060201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.065424 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1175/4510] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/servers => generated 133 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:58.067913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.068619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.069282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.070216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.070895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.071550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.495855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.499934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.519251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.522208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.522764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.523864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.524336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.524769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.604374 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07bf4770-2e34-4107-9ab5-6f30d8301f7b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112817 Oct 04 18:15:58.606813 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1176/4511] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:58.636376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.650345 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85733226-619f-4d51-a7d3-3442fe4f8fba tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.596390 Oct 04 18:15:58.667590 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3336/4512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.683853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.685067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.693934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.699698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.700413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.701400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.702042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.702681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.958372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.972487 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eaba3830-10e5-47a0-b262-e2f968159556 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.292526 Oct 04 18:15:58.986109 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1177/4513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.994908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.995494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: bd6e4b66-ed6c-4de2-a236-9be37859c6cf] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.005261 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/bd6e4b66-ed6c-4de2-a236-9be37859c6cf/action HTTP/1.1 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 13 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: {"pause": {}} Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'bd6e4b66-ed6c-4de2-a236-9be37859c6cf', 'body': {'pause': {}}} Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:59.012185 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance bd6e4b66-ed6c-4de2-a236-9be37859c6cf could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e206a505-62ff-40b0-88f0-97281a859e4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/bd6e4b66-ed6c-4de2-a236-9be37859c6cf/action" status: 404 len: 111 microversion: 2.1 time: 0.023032 Oct 04 18:15:59.017098 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3337/4514] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/servers/bd6e4b66-ed6c-4de2-a236-9be37859c6cf/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:59.023383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.024266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.033909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.034521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.037810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.038574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.039291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.040276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.040980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.041641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.047563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.048066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.048508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.049494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.049957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.050385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.276424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.290059 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a37f5af-94f8-4ce6-9498-e498c7a1fff3 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.270389 Oct 04 18:15:59.294200 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1178/4515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:59.317325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.318669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.327738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.330432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.331419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.332390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.333365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.335729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.336965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-56f5088e-9622-41fb-a800-cfe1fb1f6d4a tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.306780 Oct 04 18:15:59.337684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.338697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3338/4516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:59.516387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.526861 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-030b129b-4cc2-4596-8302-0fead562d6db tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.213409 Oct 04 18:15:59.528938 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1179/4517] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:59.551826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:59.552437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.560106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.560604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.561051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.561767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.562237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.567584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.620041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.622855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.633709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.635733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.636205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.637226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.638211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.638651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.664751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:59.677801 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5097b6b2-4979-44e7-b785-ae6d615a25aa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063731 Oct 04 18:15:59.678652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cefba2a-c3f1-4982-90a7-95a9a5c3b9b6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.131125 Oct 04 18:15:59.684653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3339/4518] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:59 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:59.685961 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1180/4519] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:59.691017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.692036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.701448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.707880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.708705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.709853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.711536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.713251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.893118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.902096 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a951c4f-b4a3-4dcc-a61e-3f40b459e5e9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1511 microversion: 2.1 time: 0.216552 Oct 04 18:15:59.917638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3340/4520] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:00.010041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.010559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.036875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.039762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.040217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.041572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.042046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.042479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.101311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:00.175242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:00.252049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=92 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:00.283359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04042dec-c1ea-43ba-be3d-23eea21a6e37 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 204 len: 0 microversion: 2.1 time: 0.277900 Oct 04 18:16:00.289548 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1181/4521] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:00 2022] DELETE /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:00.293551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.294181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.306494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.307380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.308157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.309856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.310528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.311185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.362800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.363817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.378416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.379169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.379697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.380610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.382063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.383487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.738145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:00.747781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b3df03f-91a3-462b-a4d7-007ae08d41ca tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1513 microversion: 2.1 time: 0.458341 Oct 04 18:16:00.748775 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3341/4522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1513 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:00.753758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fcb01-c6a3-4231-8239-1da37409b3d9", "name": "network-vif-plugged", "status": "completed", "tag": "5fb3f29e-ad8d-4584-b681-1abae8b2b534"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:00.770726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.771657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.772352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.787663 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] Creating event network-vif-plugged:5fb3f29e-ad8d-4584-b681-1abae8b2b534 for instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 on n-h2-831193-17 Oct 04 18:16:00.790937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:00.794228 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d7aa5c78-5e69-4411-8c87-23b7c02e1b72 req-d96c6cf0-f95e-4432-a586-9946d5ab6a62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043922 Oct 04 18:16:00.795133 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3342/4523] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:00.802151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.802459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dcf50642-78f6-44f6-b7b8-ea931d86f30e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.442325 Oct 04 18:16:00.804702 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1182/4524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:00.815621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.824302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.826317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.826770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.827535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.828650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.829112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.898064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2389241d-76e4-45c5-ae76-2c1434287d77 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101070 Oct 04 18:16:00.898656 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3343/4525] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:00.926577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.927583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.936434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.937578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.939321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.940988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.941630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.942997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.303439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.322710 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-453a8316-9685-42f8-94e9-6265cc4e3310 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1491 microversion: 2.1 time: 0.396651 Oct 04 18:16:01.335063 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1183/4526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1491 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.352181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:01.353628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.363527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.364319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.364929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.365881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.366680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.367783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.419576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'pause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state paused Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 13 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: {"pause": {}} Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'pause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state paused Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'pause': {}}} Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state paused Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.423232 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state paused Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'pause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state paused {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0acc21b3-df0c-4abd-9540-80c6a1b35e24 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 143 microversion: 2.1 time: 0.077611 Oct 04 18:16:01.433702 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3344/4527] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:01 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 143 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:01.435196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:01.435742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.455265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.455872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.456555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.457579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.458215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.459948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.646903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-56a4f8fd-7dff-4136-a398-f128a456c44f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.215453 Oct 04 18:16:01.652338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1184/4528] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:01 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:16:01.660892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.662032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.676613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.680481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.681405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.682293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.682875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.685382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.775781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.777263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.784436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.785331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.785839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.786565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.787022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.787475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.055002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.070914 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9fbc9117-0485-4334-b7be-a8a860bb9651 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1498 microversion: 2.1 time: 0.416832 Oct 04 18:16:02.072828 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3345/4529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1498 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:02.086080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.086798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.099695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.102228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.104214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.106881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.107468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.107979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.388036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.398623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9817fb5d-9f53-49be-9931-828127fa0b8f tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1318 microversion: 2.1 time: 0.323217 Oct 04 18:16:02.400297 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3346/4530] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.410302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.415728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.429786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.432364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.433051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.434525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.439218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.439951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.469165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab24f5754daf4459b3ffabc071d436bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae765ee8d840a183c31042c04a77e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.478913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d5a4b8a4-d265-4944-921c-4f8fd7cb5384 tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 200 len: 1513 microversion: 2.1 time: 0.708512 Oct 04 18:16:02.496152 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1185/4531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.506361 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1224c5ae-d0f0-46ff-994a-aafb5eceed8a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102050 Oct 04 18:16:02.509351 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3347/4532] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:02.740766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d671c0e6-f589-45cb-a9b9-7987a293c54e", "name": "network-vif-deleted", "tag": "b47aefa8-7711-4b31-b144-c6d538bd0a93"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:02.773000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.773494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.773925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.797065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] Creating event network-vif-deleted:b47aefa8-7711-4b31-b144-c6d538bd0a93 for instance d671c0e6-f589-45cb-a9b9-7987a293c54e on n-h1-831193-17 Oct 04 18:16:02.806777 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c3a7c937-be09-4d26-ad95-46e0a30f5bfa req-18e5dda4-d408-460d-8ef0-8b4de7408ed4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071674 Oct 04 18:16:02.807857 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1186/4533] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:03.098374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.099014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.105713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.106226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.106670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.108157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.108711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.109098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.401921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.414992 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa718723-801e-42ab-80a1-85a58dcd8dd1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.320811 Oct 04 18:16:03.426318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.427025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.434903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.435436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.435881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.436596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.437050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.437485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.438473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3348/4534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.443972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.444858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.453528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.454337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.455060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.456014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.456725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.457386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.771367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.787580 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e992d5c0-6b18-4599-acba-bab98ae147fb tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1509 microversion: 2.1 time: 0.365538 Oct 04 18:16:03.788568 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1187/4535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:03.834646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.844652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32e0effc-ba78-427e-a2eb-7261d0643807 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.404797 Oct 04 18:16:03.845950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3349/4536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.851566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.854225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.862213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.863242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.864102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.865473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.866642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.867389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.923542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-605d399a-e92d-4ee1-a073-eaf06c34c6a0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076226 Oct 04 18:16:03.924514 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3350/4537] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:03.930415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.932251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.944246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.944897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.945359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.947145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.947145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.947145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.132731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.133849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] [instance: d671c0e6-f589-45cb-a9b9-7987a293c54e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.144031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.145215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.145903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.146925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.147638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.148574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.168247 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] HTTP exception thrown: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Request method failure captured: Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e HTTP/1.1 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHc1GNHiBQ7n_is9pcP83PWAEtT7P4ND4H20lJ60rGC7O5rtGvNR4NYy4ZPtufEK3hVAVB_reoeZuwx6v_DnkkyuzkBBZHT_Znl_xQDP-p4Gp0Cw2OsL2HqET0L8x4HB5XMpKC8vq9JkFTkL7ezb901eEeylSv-Q6xO2alJJ9NuB1ws Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 54ae765ee8d840a183c31042c04a77e7 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54ae765ee8d840a183c31042c04a77e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 54ae765ee8d840a183c31042c04a77e7 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-381460991 Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesSnapshotTestJSON-381460991-project Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: ab24f5754daf4459b3ffabc071d436bf Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesSnapshotTestJSON-381460991-project Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'd671c0e6-f589-45cb-a9b9-7987a293c54e'} Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.170634 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. Oct 04 18:16:04.176444 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.179226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] Returning 404 to user: Instance d671c0e6-f589-45cb-a9b9-7987a293c54e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:04.181285 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-81aff588-ea5c-4abd-8573-3142ff5c34fe tempest-VolumesSnapshotTestJSON-381460991 tempest-VolumesSnapshotTestJSON-381460991-project] 10.222.0.33 "GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e" status: 404 len: 111 microversion: 2.1 time: 0.391761 Oct 04 18:16:04.182301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1188/4538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/d671c0e6-f589-45cb-a9b9-7987a293c54e => generated 111 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:04.188593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:04.189212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.191296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.198788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.198991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66c55b6f-204d-4713-9e44-d2f77cd1e0bf tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1509 microversion: 2.1 time: 0.272898 Oct 04 18:16:04.200289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.201163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.202097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.202784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.203466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.205114 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3351/4539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.222062 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action HTTP/1.1 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 28 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: {"reboot": {"type": "SOFT"}} Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:04.224446 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:04.229967 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.231673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:04.231673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.232861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:04.234484 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f75e3ff8-181a-4d83-8322-799825f85c11 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action" status: 404 len: 111 microversion: 2.1 time: 0.051092 Oct 04 18:16:04.235876 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1189/4540] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:04 2022] POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:04.245061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.246051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.247115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.247698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.248212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.249000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.249529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.249962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.253045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.253717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.254168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.254883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.255439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.255873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.337269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-172f639f-ce4e-4b9f-a340-8a277116d944 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "PUT /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1081 microversion: 2.1 time: 0.114324 Oct 04 18:16:04.342948 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3352/4541] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:16:04 2022] PUT /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1081 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:04.363551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.364745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.374112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.374756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.375798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.376926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.377986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.378763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.630759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.640742 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61258ac9-6839-460b-888f-13c85a549ba8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.400207 Oct 04 18:16:04.644897 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1190/4542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.664415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.665317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.671979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.673575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.674463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.675139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.676862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.677485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.678079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.685725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c76f4aa-d5f9-45a5-b190-73cbe9359fad tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1507 microversion: 2.1 time: 0.326358 Oct 04 18:16:04.688090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3353/4543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:04.715229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.716320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.748808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:04.755739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.756487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.757447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.759015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.765119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.765906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.028200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.033358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.049721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8784fc3-1d9f-4cd7-a8a5-d7b4d75bda72 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1507 microversion: 2.1 time: 0.338926 Oct 04 18:16:05.059065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db296901-cf4b-4778-8c10-c4d927d841e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.390780 Oct 04 18:16:05.068345 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1191/4544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:05.075518 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3354/4545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:05.080471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:05.082918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.085618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.093208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.107379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.109097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.109757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.111426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.112123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.112826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.120245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.120943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.121834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.122807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.123722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.124435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.197812 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a7134009-4200-4323-adf9-edabc92df7c7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128260 Oct 04 18:16:05.198828 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1192/4546] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:05.205029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:05.208340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 0e2120bf-50ac-480a-96af-5bbb648f37ca] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.216663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/0e2120bf-50ac-480a-96af-5bbb648f37ca/action HTTP/1.1 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 28 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: {"reboot": {"type": "SOFT"}} Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '0e2120bf-50ac-480a-96af-5bbb648f37ca', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. Oct 04 18:16:05.218089 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 0e2120bf-50ac-480a-96af-5bbb648f37ca could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:05.222960 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-caccad7d-b650-468d-b8f1-ea74605d5585 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/0e2120bf-50ac-480a-96af-5bbb648f37ca/action" status: 404 len: 111 microversion: 2.1 time: 0.019881 Oct 04 18:16:05.224454 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1193/4547] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:05 2022] POST /compute/v2.1/servers/0e2120bf-50ac-480a-96af-5bbb648f37ca/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:05.235093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.236279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.250528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.251363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.252007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.253099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.253808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.254402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.289388 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58e76fb5-abfd-4884-9951-917222cfc4ea tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "PUT /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1083 microversion: 2.1 time: 0.211164 Oct 04 18:16:05.306529 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3355/4548] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:16:05 2022] PUT /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1083 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.320601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.325830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.346432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.355888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.356437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.357655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.358217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.358857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.361965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:06.101202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.112324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f8963e1-3746-422f-b91b-8b29e19934b4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1509 microversion: 2.1 time: 0.801388 Oct 04 18:16:06.113654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3356/4549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1509 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.145045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.145277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.151129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.152156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.152807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.153366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.154148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.154678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.155220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.161023 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40f900c5-1b18-40d4-9418-8ca8e9bd6919 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.935838 Oct 04 18:16:06.171464 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1194/4550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.193768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.194945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.202062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.202835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.204187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.205491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.206219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.206940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.726948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.735513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-143f3630-fcfb-433e-9cee-8606cbf1cbe5 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1509 microversion: 2.1 time: 0.603071 Oct 04 18:16:06.746634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3357/4551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1509 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.753313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.763868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.767087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.777511 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c0127436-46b4-45db-810e-1b060600186c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.588300 Oct 04 18:16:06.795151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.795422 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1195/4552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.796103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.796726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.797634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.798266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.798871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.813527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.814042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.841913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.842420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.843276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.843614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.844079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.844513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.858459 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1333b2b2-abb0-4dc4-97ed-50b8bc15129c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103174 Oct 04 18:16:06.859727 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3358/4553] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:06.897500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:06.904619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:06.912331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.939172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.939691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.940134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.948697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.950146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.950778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.992740 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action HTTP/1.1 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 65 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92', 'body': {'rebuild': {'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857'}}} Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:16:06.994984 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:16:07.000562 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:07.002797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:07.007763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b123bfd2-a67f-4971-9952-7fc677a0337d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action" status: 404 len: 111 microversion: 2.1 time: 0.126934 Oct 04 18:16:07.027119 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3359/4554] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:06 2022] POST /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92/action => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:07.040543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.042251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.048196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff54ecde-27e2-4bb6-9033-a53278356201 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 204 len: 0 microversion: 2.1 time: 0.251457 Oct 04 18:16:07.050287 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1196/4555] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:06 2022] DELETE /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:07.055513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.056023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.056520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.057252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.057719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.058156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.066770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.067884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.078644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.079450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.080709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.081680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.082318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.082927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.120052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:07.303794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b32be95-204e-44f3-8c28-7a373539f4ef tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 204 len: 0 microversion: 2.1 time: 0.273695 Oct 04 18:16:07.305247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3360/4556] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:07 2022] DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:07.322708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.323364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.340801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.341328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.342980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.343940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.347147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.348460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.377527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.382023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:07.419461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd4a70d1-c8bc-4340-9430-c85b18ef133e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.367437 Oct 04 18:16:07.427452 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1197/4557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.441002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.443301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.451555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.452605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:07.453368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.460437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.461552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.462208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.462874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.560958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Instance is already in deleting state, ignoring this request Oct 04 18:16:07.562041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-543492a8-2404-4929-a2aa-d19ffa330e4c tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 204 len: 0 microversion: 2.1 time: 0.253003 Oct 04 18:16:07.567069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3361/4558] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:07 2022] DELETE /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:07.573010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.573758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.583439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.583980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.584524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.585262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.586170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.586619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.765079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.781400 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd8bb4fd-dda4-4b04-b43d-efa4bd2e9bab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1681 microversion: 2.1 time: 0.352408 Oct 04 18:16:07.783349 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1198/4559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.815089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.822262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.833312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.833812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.834257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.834979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.835467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.835896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.155156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.172929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ff306df-19a2-472a-9062-85764dd931d0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.604555 Oct 04 18:16:08.173869 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3362/4560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.202243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:08.210603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 73e77e34-879b-4d20-becd-619ec5051ef2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.219868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/73e77e34-879b-4d20-becd-619ec5051ef2/action HTTP/1.1 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 65 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '73e77e34-879b-4d20-becd-619ec5051ef2', 'body': {'rebuild': {'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857'}}} Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:08.224407 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 73e77e34-879b-4d20-becd-619ec5051ef2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aaeaea14-2c0c-4d50-a689-f7dda1f5620f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/73e77e34-879b-4d20-becd-619ec5051ef2/action" status: 404 len: 111 microversion: 2.1 time: 0.029351 Oct 04 18:16:08.234064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3363/4561] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:08 2022] POST /compute/v2.1/servers/73e77e34-879b-4d20-becd-619ec5051ef2/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:08.238608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.241992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.261822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.262962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.263641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.264542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.265020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.265461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.350446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.380805 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ad59b55-94d3-45ec-aff6-536e8ca17d0e tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1515 microversion: 2.1 time: 0.576503 Oct 04 18:16:08.397118 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1199/4562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1515 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.677599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.689683 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08e0beda-1b87-42d4-95ab-2895af6266cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.454774 Oct 04 18:16:08.690515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3364/4563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.718367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.721207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.733336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.734890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.736580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.737432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.738719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.739957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.810803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.812200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.827883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.828651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.829253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.831907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.832687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.840654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.221726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.225067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.235286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-677e24e5-2a65-4a2a-8e7a-15e1c0312249 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1681 microversion: 2.1 time: 0.429607 Oct 04 18:16:09.251370 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3365/4564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1681 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:09.256396 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d4b93a1-64f0-4cbc-8993-4c229fc2e95b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.542387 Oct 04 18:16:09.257248 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1200/4565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.289807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:09.290630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 37af7f0e-02d2-4569-b27d-0631e559fe88] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.306184 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/37af7f0e-02d2-4569-b27d-0631e559fe88/action HTTP/1.1 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: {"restore": {}} Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '37af7f0e-02d2-4569-b27d-0631e559fe88', 'body': {'restore': {}}} Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:09.308251 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:09.313798 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:09.313798 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:09.313798 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. Oct 04 18:16:09.313798 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:09.315426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 37af7f0e-02d2-4569-b27d-0631e559fe88 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:09.316470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72575974-5397-47ee-bd5f-ff260219be4d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/37af7f0e-02d2-4569-b27d-0631e559fe88/action" status: 404 len: 111 microversion: 2.1 time: 0.031533 Oct 04 18:16:09.317581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3366/4566] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:09 2022] POST /compute/v2.1/servers/37af7f0e-02d2-4569-b27d-0631e559fe88/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:09.327633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.328249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.337983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.338485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.341804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.342559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.343810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.344262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.410440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.410440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.417049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.417668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.418121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.423366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.424002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.424410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.302276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.333965 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-67b12f81-dcf2-40f6-aa8c-7b63f4d40da2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 1.010646 Oct 04 18:16:10.336301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1201/4567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.359555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.361686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.394712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.396231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.400621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.402374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.405796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.406397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.507326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.515974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-176c496b-ce12-42f5-a934-2b5232db30f1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1515 microversion: 2.1 time: 1.115671 Oct 04 18:16:10.516567 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3367/4568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1515 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.535257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.536056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.554660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.555574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.556158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.557014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.558122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.558699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.850500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.865712 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cde56b48-ac0e-4d05-b649-2d676deeb0e1 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1681 microversion: 2.1 time: 2.527949 Oct 04 18:16:12.879341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1202/4569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1681 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.927077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.941894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.977009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.977517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.977963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.978682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.007420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.008218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.015838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.035189 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3a62b3e-ca4a-4928-bb76-b85585690abb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 2.517391 Oct 04 18:16:13.038365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3368/4570] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.070204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fcb01-c6a3-4231-8239-1da37409b3d9", "name": "network-vif-deleted", "tag": "5fb3f29e-ad8d-4584-b681-1abae8b2b534"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.109191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.109709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.110155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.163046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] Creating event network-vif-deleted:5fb3f29e-ad8d-4584-b681-1abae8b2b534 for instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 on n-h2-831193-17 Oct 04 18:16:13.172218 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6f3cabbb-d1fe-45d4-bfd9-154a64b148a5 req-24b4ef33-5527-4175-abde-8be8acd97dd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130268 Oct 04 18:16:13.172852 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3369/4571] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:13.181837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.195117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.258694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.259268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.259724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.260454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.260920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.261355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.358629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'restore' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: {"restore": {}} Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: exception: Cannot 'restore' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'restore': {}}} Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.365297 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.368925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'restore' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:13.369364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8582cf6f-6d34-4278-aecc-7ee703070718 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 145 microversion: 2.1 time: 0.189440 Oct 04 18:16:13.369911 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3370/4572] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 145 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:13.383158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.385229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.400466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.401199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.401780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.403910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.404530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.410431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.593082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e495f9ba7f7f4ec6ba19d7a3cf10f2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800a1bd5b6284e6ca5fc554742cd9de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.625066 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4b7da68-2699-42b2-bdec-a607f634deb4 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 200 len: 1473 microversion: 2.1 time: 0.742443 Oct 04 18:16:13.625902 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1203/4573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 1473 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.908910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.910299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.938055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.938546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.945564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.946353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.946839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.955828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.087888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.102127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2bf583d-f815-48ea-a702-ee9faf60aef5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.725700 Oct 04 18:16:14.102746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3371/4574] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:14.133609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.134513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.166366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.167055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.169245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.172611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.174541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.176633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.253917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.284590 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de2d9234-ca3a-4c70-a67a-4c05e5cbc881 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 200 len: 1326 microversion: 2.1 time: 0.379884 Oct 04 18:16:14.291506 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1204/4575] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 1326 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.649137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.658349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.658972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 1a2fcb01-c6a3-4231-8239-1da37409b3d9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.686103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f2413bb-363d-4a9f-a66b-afc5b361b656 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.554647 Oct 04 18:16:14.699117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.700192 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3372/4576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:14.700272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.700272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.700272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.700272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.700272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.713976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:14.714582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 96539fd4-1d9f-46b5-9530-c1b52ce8d862] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.746073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/96539fd4-1d9f-46b5-9530-c1b52ce8d862/action HTTP/1.1 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 14 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: {"resume": {}} Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '96539fd4-1d9f-46b5-9530-c1b52ce8d862', 'body': {'resume': {}}} Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.766134 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 96539fd4-1d9f-46b5-9530-c1b52ce8d862 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-976f935c-4358-404e-b98d-4a8d04f83dee tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/96539fd4-1d9f-46b5-9530-c1b52ce8d862/action" status: 404 len: 111 microversion: 2.1 time: 0.058114 Oct 04 18:16:14.773348 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3373/4577] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:14 2022] POST /compute/v2.1/servers/96539fd4-1d9f-46b5-9530-c1b52ce8d862/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:14.773783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] HTTP exception thrown: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Request method failure captured: Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 HTTP/1.1 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfPlUoosrQlu3vWeqh3b_Ve3nSLAto_fqZwGEq2xOV29cCFswaWGvKF4MFulp2_-UztwUhyNWIcD7MI88Dhl4JR1yoKLKgd5kQl9Nt8JjBfnL5LFb2qp43e68L461XRxDrcxOyj6gxd6a8Os5nNO3InDULMBFrXwJTgLepcH1TVD9k Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: e495f9ba7f7f4ec6ba19d7a3cf10f2d1 Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1a2fcb01-c6a3-4231-8239-1da37409b3d9'} Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.774314 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Returning 404 to user: Instance 1a2fcb01-c6a3-4231-8239-1da37409b3d9 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:14.777765 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-621f8f35-3443-4bca-a76a-e034340b64c0 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9" status: 404 len: 111 microversion: 2.1 time: 0.122320 Oct 04 18:16:14.781634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.782172 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1205/4578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/1a2fcb01-c6a3-4231-8239-1da37409b3d9 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:14.782279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.795655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.797333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.812949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.821726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.821726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.821980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.822063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.822684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.822779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.822779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.829827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.832063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.832527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.835984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.868343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:14.894614 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] HTTP exception thrown: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Request method failure captured: Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 HTTP/1.1 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfPlUoosrQlu3vWeqh3b_Ve3nSLAto_fqZwGEq2xOV29cCFswaWGvKF4MFulp2_-UztwUhyNWIcD7MI88Dhl4JR1yoKLKgd5kQl9Nt8JjBfnL5LFb2qp43e68L461XRxDrcxOyj6gxd6a8Os5nNO3InDULMBFrXwJTgLepcH1TVD9k Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: e495f9ba7f7f4ec6ba19d7a3cf10f2d1 Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '95345312-6bce-4ce9-827f-01c28809a7b5'} Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:14.896256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:14.899915 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:14.916175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Returning 404 to user: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:14.917254 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e6bd7b80-547c-4ca1-b952-71c5992110cc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 404 len: 111 microversion: 2.1 time: 0.133925 Oct 04 18:16:14.922907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1206/4579] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:14 2022] DELETE /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:14.935929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.940129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: 95345312-6bce-4ce9-827f-01c28809a7b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.958648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.959614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.960468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.964038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.964793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.965455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.002615 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] HTTP exception thrown: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Request method failure captured: Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 HTTP/1.1 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfPlUoosrQlu3vWeqh3b_Ve3nSLAto_fqZwGEq2xOV29cCFswaWGvKF4MFulp2_-UztwUhyNWIcD7MI88Dhl4JR1yoKLKgd5kQl9Nt8JjBfnL5LFb2qp43e68L461XRxDrcxOyj6gxd6a8Os5nNO3InDULMBFrXwJTgLepcH1TVD9k Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: e495f9ba7f7f4ec6ba19d7a3cf10f2d1 Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '95345312-6bce-4ce9-827f-01c28809a7b5'} Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.004606 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. Oct 04 18:16:15.007626 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.009561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Returning 404 to user: Instance 95345312-6bce-4ce9-827f-01c28809a7b5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:15.010665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-281bdb9e-e93f-42fc-a577-cea5107211dc tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5" status: 404 len: 111 microversion: 2.1 time: 0.086313 Oct 04 18:16:15.011651 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1207/4580] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/95345312-6bce-4ce9-827f-01c28809a7b5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:15.023097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.028642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.044273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.048432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.049247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.050228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.052431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.053144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.107873 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] HTTP exception thrown: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Request method failure captured: Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 HTTP/1.1 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfPlUoosrQlu3vWeqh3b_Ve3nSLAto_fqZwGEq2xOV29cCFswaWGvKF4MFulp2_-UztwUhyNWIcD7MI88Dhl4JR1yoKLKgd5kQl9Nt8JjBfnL5LFb2qp43e68L461XRxDrcxOyj6gxd6a8Os5nNO3InDULMBFrXwJTgLepcH1TVD9k Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: e495f9ba7f7f4ec6ba19d7a3cf10f2d1 Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ee6a93df-ffa7-4532-857e-ea3354746160'} Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:15.110358 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.113899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.115234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Returning 404 to user: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:15.117114 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e115577-614e-439a-a6df-abb764f92193 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 404 len: 111 microversion: 2.1 time: 0.101037 Oct 04 18:16:15.118146 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1208/4581] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:15 2022] DELETE /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:15.132761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.133381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] [instance: ee6a93df-ffa7-4532-857e-ea3354746160] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.141111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.141602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.142047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.142761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.145823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.146269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.173625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] HTTP exception thrown: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Request method failure captured: Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 HTTP/1.1 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHfPlUoosrQlu3vWeqh3b_Ve3nSLAto_fqZwGEq2xOV29cCFswaWGvKF4MFulp2_-UztwUhyNWIcD7MI88Dhl4JR1yoKLKgd5kQl9Nt8JjBfnL5LFb2qp43e68L461XRxDrcxOyj6gxd6a8Os5nNO3InDULMBFrXwJTgLepcH1TVD9k Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/800a1bd5b6284e6ca5fc554742cd9de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 800a1bd5b6284e6ca5fc554742cd9de3 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1932935863 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: e495f9ba7f7f4ec6ba19d7a3cf10f2d1 Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1932935863-project Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ee6a93df-ffa7-4532-857e-ea3354746160'} Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.175514 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. Oct 04 18:16:15.179321 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.181204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] Returning 404 to user: Instance ee6a93df-ffa7-4532-857e-ea3354746160 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:15.182228 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8575cebf-3376-4eba-8c99-9d90069923c1 tempest-ServerDiskConfigTestJSON-1932935863 tempest-ServerDiskConfigTestJSON-1932935863-project] 10.222.0.33 "GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160" status: 404 len: 111 microversion: 2.1 time: 0.053566 Oct 04 18:16:15.186907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1209/4582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/ee6a93df-ffa7-4532-857e-ea3354746160 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:15.315387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.316233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.326102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.333080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.333847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.342800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.347808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.348622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.356742 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57e0419d-d68f-4e83-878f-8a9e73a6897c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.582480 Oct 04 18:16:15.357299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.361933 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3374/4583] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.398579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.399253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.410280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.410780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.411297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.412015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.413565 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 HTTP/1.1 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e5f940f1-1345-4356-94f8-4578d1ea8581'} Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.416557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.420131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:15.420558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.421089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.421868 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b7b68cc-5bdc-4a2e-836e-b676da701576 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 404 len: 111 microversion: 2.1 time: 0.107882 Oct 04 18:16:15.425017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1210/4584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:15.454139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da62e9ec-0aef-404e-ad94-94a2de7b97d0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '.version_select at 0x7f6341a27790>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.564424 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da62e9ec-0aef-404e-ad94-94a2de7b97d0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743899917" status: 202 len: 0 microversion: 2.1 time: 0.134773 Oct 04 18:16:15.565331 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1211/4585] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743899917 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:15.686779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f940f1-1345-4356-94f8-4578d1ea8581", "name": "network-vif-deleted", "tag": "ddf62a7c-3a4b-4d07-9449-122cbecbaf07"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:15.714112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.714601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.715097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.732553 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] Creating event network-vif-deleted:ddf62a7c-3a4b-4d07-9449-122cbecbaf07 for instance e5f940f1-1345-4356-94f8-4578d1ea8581 on n-h2-831193-17 Oct 04 18:16:15.748896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-fc6367e8-fb68-4c02-be6b-9bcc63abbdb5 req-975503c5-4de9-481e-864e-39064590f338 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066977 Oct 04 18:16:15.749537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1212/4586] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:16.213487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.241684 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-487ed9a2-abc5-4889-9e0b-492c32eaff16 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.854476 Oct 04 18:16:16.244866 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3375/4587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.267389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:16.268169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.287206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.287754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.288149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.288869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.289325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.289761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.338884 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'resume' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 14 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: {"resume": {}} Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'resume' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'resume': {}}} Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:16.348256 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:16:16.351782 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:16.352815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'resume' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:16.353827 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-217c6456-d332-4d24-a2f3-13aa89f5216f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 144 microversion: 2.1 time: 0.093371 Oct 04 18:16:16.354869 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1213/4588] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:16 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 144 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:16.365546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.366364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.385003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.385520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.385963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.391000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.392088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.400197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.325212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.355403 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-77bbce8c-6c71-476b-8be6-9244c22ac768 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.995517 Oct 04 18:16:17.370786 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3376/4589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.390898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.395287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.425192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.426187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.426187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.426833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.427321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.427751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.653697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.662193 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-264a4974-ab69-43f0-8bad-06509e11ea7e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 1.276964 Oct 04 18:16:18.675505 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1214/4590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.981755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-957b524f-2f56-4c04-98d4-0072601a9a3e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-957b524f-2f56-4c04-98d4-0072601a9a3e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 160 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: {"server": {"name": "", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "c840ae96-230e-4b77-adf7-e2780d10b5d7"}]}} Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'server': {'name': '', 'imageRef': 'fde43323-6d3d-41e0-8fc0-c7db4539b857', 'flavorRef': '452', 'networks': [{'uuid': 'c840ae96-230e-4b77-adf7-e2780d10b5d7'}]}}} Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:18.985765 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-957b524f-2f56-4c04-98d4-0072601a9a3e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:18.992500 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-957b524f-2f56-4c04-98d4-0072601a9a3e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.012273 Oct 04 18:16:18.994581 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3377/4591] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:18 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:19.017511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.018204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.050462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.056999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.057824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.068099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.074207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.082710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.402613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9753449-01dd-4356-8d8d-d66af0b88668 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: .version_select at 0x7f6340167280>, body: {"keypair": {"name": "tempest-keypair-1144763365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh8L9kBKjML19TA9szJsWLLmaiQRwnPqwf+l9HTYpmroJISGa8JEboe+ONjTQ5uYtUxMIsvjD4BtplnijV4hBc/6GDNaHqNo8/qtMBix3e+GV9LCDXTs1DV1F4XPe28Ug=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:19.445598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e9753449-01dd-4356-8d8d-d66af0b88668 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:19.457691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-e9753449-01dd-4356-8d8d-d66af0b88668 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:19.504508 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9753449-01dd-4356-8d8d-d66af0b88668 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107882 Oct 04 18:16:19.507314 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3378/4592] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:16:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:19.545409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.555956 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-97f9a408-748c-48e3-90cd-c484a0b48a66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.559222 Oct 04 18:16:19.560224 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1215/4593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.585474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.586296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.595518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.596241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.596831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.597902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.599947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.600609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.046069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.091773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbac480d-55e0-404a-8af9-964060108fdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.505331 Oct 04 18:16:20.093065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3379/4594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.143934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:20.144624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 701c58fc-664e-4128-97b5-2d13b5ea0dd7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.164009 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/701c58fc-664e-4128-97b5-2d13b5ea0dd7/action HTTP/1.1 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 14 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: {"shelve": {}} Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '701c58fc-664e-4128-97b5-2d13b5ea0dd7', 'body': {'shelve': {}}} Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:20.170878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 701c58fc-664e-4128-97b5-2d13b5ea0dd7 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:20.174675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe20f200-a765-4950-96c6-aa4e5def3785 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/701c58fc-664e-4128-97b5-2d13b5ea0dd7/action" status: 404 len: 111 microversion: 2.1 time: 0.039274 Oct 04 18:16:20.203826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.205087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.209370 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1216/4595] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:20 2022] POST /compute/v2.1/servers/701c58fc-664e-4128-97b5-2d13b5ea0dd7/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:20.238592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.239323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.242242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.250535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.251052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.251507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.750926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.760162 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e2646d4e-7085-4a2e-aacc-b3d93df7d8de tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.564208 Oct 04 18:16:20.763140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3380/4596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.798808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.800154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.834095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.838386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.839169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.841198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.845771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.846425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.203297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.215931 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3bddc51b-42a5-4e1a-bfdc-4aa4375ba0f4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.420874 Oct 04 18:16:21.221024 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1217/4597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.276361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:21.282287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.297567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.305349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.306117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.307085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.307686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.308435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.336715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'flavor' on Instance uuid 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:21.858904 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-03d4d913-6e18-4094-9f46-2876afaf5453 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.613472 Oct 04 18:16:21.865657 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3381/4598] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:21 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:21.873049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.874266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.883290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.884896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.890219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.892224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.895616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.897124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.284855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.312715 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9fb69748-46f0-49b6-80c0-93664e30fb10 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.444739 Oct 04 18:16:22.314026 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1218/4599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.338266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.340289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.354427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.357745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.360511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.362004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.362688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.368054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.937221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.954585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-17d813d4-fff2-4983-990e-dac7d9440e66 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.621988 Oct 04 18:16:23.961172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3382/4600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.943937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321766877", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "026cefdc-3a81-4fee-9860-a3ebae88796b"}], "security_groups": [{"name": "tempest-securitygroup--1750538116"}], "key_name": "tempest-keypair-1144763365", "user_data": "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.994186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.994824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.016027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.016557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.016997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.027862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.027862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.027862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.389475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] validate_networks() for [('026cefdc-3a81-4fee-9860-a3ebae88796b', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:26.174422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.199748 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-409e5d08-ef4c-4bef-b588-fff8a9060e44 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 1.210724 Oct 04 18:16:26.201986 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3383/4601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.250142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.251865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.298435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:27.299339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.299858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:27.300315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.300420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:27.300970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:27.301268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.301455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:27.302786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.303641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.304720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.327404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.331203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.333141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.334864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.338842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.355516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.440940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:27.446820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Getting quotas for user 56342562970646fba44f4e59cd355761 and project d537f30be51b4aa682baf624b4b558c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:27.474628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:27.493650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:27.496045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:27.606175 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea7d7e37-eaca-4f4a-8281-31b2c8a133a9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.666052 Oct 04 18:16:27.612748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.615404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1219/4602] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:27.620326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-742b2f62-9711-4d9a-8551-a1583ffbe619 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.620950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-742b2f62-9711-4d9a-8551-a1583ffbe619 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.639674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-609635c0-0832-4929-bb7c-4c7d810b8d95 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.395821 Oct 04 18:16:27.646433 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3384/4603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.735468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-742b2f62-9711-4d9a-8551-a1583ffbe619 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.744216 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-742b2f62-9711-4d9a-8551-a1583ffbe619 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1241 microversion: 2.1 time: 0.126983 Oct 04 18:16:27.746741 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1220/4604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.667223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.669279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.679762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.681716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.682431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.684923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.685654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.686576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.771395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.772363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.788631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.792308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.793444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.794876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.797461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.798708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.029980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.047559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ccb3cbab-cc6f-4fce-856b-55c861cba2d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1237 microversion: 2.1 time: 0.282400 Oct 04 18:16:29.056270 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1221/4605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1237 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.274659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.288619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4ed257f-8324-4724-9263-23255f1cb2a5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.624635 Oct 04 18:16:29.292156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3385/4606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.085202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.085924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.098219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.104435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.107989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.109915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.112466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.113967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.322140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.322929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.332591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:30.341144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.345051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.345682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.346561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.347665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.348250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.391788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.406693 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0de39059-f3e0-4e0b-b23e-8b04ff55863b tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1299 microversion: 2.1 time: 0.326376 Oct 04 18:16:30.433835 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1222/4607] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1299 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.997834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.008613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cddca92e-1e55-4e06-a124-d48ec9da10af tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.697329 Oct 04 18:16:31.009856 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3386/4608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:31.445617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.446986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.456502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.460052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.460771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.463621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.465816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.479417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.501767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:31.754684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.770730 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a37d70b1-66b2-4e55-ba9f-79b04418ff49 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1299 microversion: 2.1 time: 0.330645 Oct 04 18:16:31.792083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1223/4609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:32.033996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.034716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.055502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.057190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.059127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.062039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.065392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.066542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.807965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.809630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.823114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.825709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.826359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.831500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.832699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.836604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.585253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.596811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-196fba65-3de6-40e7-bc1a-c22e210ac187 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 1.565332 Oct 04 18:16:33.601162 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3387/4610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.907643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.945277 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b34b51f5-ef45-40ad-9f8f-82c280cd960f tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 1.145915 Oct 04 18:16:33.946648 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1224/4611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.625444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.626123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.664668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.665062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.670312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.687676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.691433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.692384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.971818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.972430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.004542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.009457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.009912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.010655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.011202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.016125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.680724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.691352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.700690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-233730b5-7e32-44ad-98bf-5a48a6b4c441 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 1.082714 Oct 04 18:16:35.701352 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3fe4011-1b81-4946-b9d6-9300bbb042ad tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 0.734492 Oct 04 18:16:35.705037 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1225/4612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.705462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3388/4613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:36.192046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb", "tag": "ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.226156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.226664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.229302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.272833 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] Creating event network-changed:ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4 for instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb on n-h2-831193-17 Oct 04 18:16:36.289536 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-40ce18a4-5c65-44b9-8ec3-29944953f561 req-16e12f88-e25b-4743-acab-5ae157f436f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104454 Oct 04 18:16:36.328516 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1226/4614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:36.733250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.735312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.742989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.744005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.756199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.758337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.759280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.759441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:36.761036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.762405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.762844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.763344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.763995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.765641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.766385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.767290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.767501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.170162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.186946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-704b7af3-5236-43ad-ae6b-fa326bd38b04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.460878 Oct 04 18:16:37.191222 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3389/4615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:37.207669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.219456 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f191f49d-026c-4297-80e7-68c8dd4431ff tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 0.481132 Oct 04 18:16:37.226575 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1227/4616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.213083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.213709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.227115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.230126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.231306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.233396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.238413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.239173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.248474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.249844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.268575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:38.276498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:38.279655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.283856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.290813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.291737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.301261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.301894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.922433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.937691 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59acb7cb-5489-47d6-ac2b-26ac5038f93d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.726621 Oct 04 18:16:38.939712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3390/4617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.112406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.129339 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6a07107-291d-486d-9489-529472dd8782 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 0.885146 Oct 04 18:16:39.131830 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1228/4618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.966470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.967271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.984020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.985524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.987558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.992426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.993866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.995217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.062725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:40.158696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.160141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.176925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.181875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.182540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.184032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.191203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.192306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.560972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.572325 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-37bb31d7-21f1-447c-9c67-488a279d6ab8 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 1.417659 Oct 04 18:16:41.572931 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1229/4619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:41.752080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.772353 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b93a2aa-e9d1-4b4f-a9c9-243b9dd744ff tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 1.809561 Oct 04 18:16:41.779405 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3391/4620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.607747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.608449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.633943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.634392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.642306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.643344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.645784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.648444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.800500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.801319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.808220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.820076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.823150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.824923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.838626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.841703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.452390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.463653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66344895-77cd-493e-a591-1e250c66c077 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1533 microversion: 2.1 time: 0.666828 Oct 04 18:16:43.466535 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3392/4621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1533 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:43.475050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb", "name": "network-vif-plugged", "status": "completed", "tag": "ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:43.506380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.510241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.510884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.548244 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] Creating event network-vif-plugged:ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4 for instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb on n-h2-831193-17 Oct 04 18:16:43.592667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-528a2b3c-f0e0-45ec-b654-28ec76240623 req-f849dcc1-e2e1-4d19-b39f-1633c762635c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124647 Oct 04 18:16:43.603205 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3393/4622] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:43.611088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.636402 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dbee4565-af5f-471b-a340-373c88c7a582 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 1.035494 Oct 04 18:16:43.637603 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1230/4623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:44.496909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.499064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.530293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.532835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.533457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.534384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.536735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.537961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.667438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.668169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.692707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.693219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.699715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.700650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.701145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.701597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.200402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.211570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c50a8220-e605-4e75-98ae-1d1d8c247c7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.718198 Oct 04 18:16:45.214671 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3394/4624] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.232316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.264361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61f4e442-5221-476e-b0d2-65cd81b1ce66 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1367 microversion: 2.1 time: 0.604117 Oct 04 18:16:45.265211 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1231/4625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.821958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1417144000", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "3d850608-9d1a-43a6-909d-b09c3915f1ee"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:46.238412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.239662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.262944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.264771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.265364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.269869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.273338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.273994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.631789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.644298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5957a67c-d2e0-48c6-900a-32183a49d05f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.410393 Oct 04 18:16:46.644838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1232/4626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:46.666370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.667389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.688088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.695005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.695746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.696632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.701315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.701956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.263671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.274524 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9ef4cee-52dc-42b8-8d3b-928a2af5dad0 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1557 microversion: 2.1 time: 0.620580 Oct 04 18:16:47.303656 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1233/4627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1557 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:47.329069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.329576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.361502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.378070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.379337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.380263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.381033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.381485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.787854 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd926087-11be-43fb-aefd-ae6d0f539437 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.472915 Oct 04 18:16:47.788986 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1234/4628] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-interface => generated 284 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:47.795147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.796197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.817863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.828061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.832470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.836778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.840988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.841712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.664794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.684426 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-75feab50-bfc1-4b57-8a1a-7a70359bf8a4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.890370 Oct 04 18:16:48.688393 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1235/4629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:49.393706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "name": "network-vif-plugged", "status": "completed", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:49.431073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.431732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.433092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.493187 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] Creating event network-vif-plugged:e6cd1033-d09a-40ed-bfa1-83813f407b3c for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e on n-h1-831193-17 Oct 04 18:16:49.507277 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-36c466d3-2ace-425b-8bf1-85962285e32a req-8e42dcf0-7403-474e-9e3e-42d99357d5ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124619 Oct 04 18:16:49.508606 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1236/4630] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:49.727529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.728307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.754847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.755546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.756504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.757444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.758111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.759217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.353067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.363698 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f5ff5a05-cbae-4aba-8143-b80eac317598 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.647228 Oct 04 18:16:50.387411 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1237/4631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:50.496765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] validate_networks() for [('3d850608-9d1a-43a6-909d-b09c3915f1ee', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:51.403559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.404368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.416917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.417431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.418446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.419196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.419661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.420092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.181799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.222715 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b74c72a3-220e-4c08-ad0f-0d25e9b52771 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.816213 Oct 04 18:16:52.225588 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1238/4632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.241878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb", "tag": "ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:52.270295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.270920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.271472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.299701 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] Creating event network-changed:ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4 for instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb on n-h2-831193-17 Oct 04 18:16:52.320759 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-378231f6-49ba-478d-b075-90d4dbda7845 req-547bccd8-c917-4833-afaf-3a2ff7859820 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093555 Oct 04 18:16:52.329501 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1239/4633] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:52.694577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:52.695805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:52.699565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:52.700365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:52.701158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:52.716219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.717060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.718022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.718994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.719814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.720474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.740258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Getting quotas for project 76888402caf845348f79f3dd942133de. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:52.747509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Getting quotas for user 9484909fa13041ca8bb50805c1fc769b and project 76888402caf845348f79f3dd942133de. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:52.762233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:52.766200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:52.845291 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aae6007a-1f77-45ef-8df1-3c15a8fad49f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.298571 Oct 04 18:16:52.848534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3395/4634] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 7302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:52.861252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd333bb1-e68b-4446-9a6b-0d1ef6160022 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.863534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd333bb1-e68b-4446-9a6b-0d1ef6160022 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.109423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd333bb1-e68b-4446-9a6b-0d1ef6160022 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.118679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd333bb1-e68b-4446-9a6b-0d1ef6160022 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1225 microversion: 2.1 time: 0.262769 Oct 04 18:16:53.124038 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1240/4635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1225 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.252564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.263174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.332291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.342978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.349834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.351594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.352920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.356115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.151546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.152656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.154359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.165412 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b5e6234-c556-425c-ba9f-a781c4c0a228 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.915729 Oct 04 18:16:54.167559 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3396/4636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:54.194592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.195161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.195630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.196388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.196857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.197294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.449562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.464022 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c998fc48-55c2-4d1f-a1a3-53881184e88f tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1229 microversion: 2.1 time: 0.317024 Oct 04 18:16:54.464653 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1241/4637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1229 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.192303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.194003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.201341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.208829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.209498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.214146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.216500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.220302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.491985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.493446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.508610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.509116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.509566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.516849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.518923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.521547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.701373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.706607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.712437 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d8e56bc8-137b-4f01-ab82-36b6bd10cdd3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1295 microversion: 2.1 time: 0.223799 Oct 04 18:16:55.718973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7efc1ebe-c4c7-4482-a240-1ffaf02adc39 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.528636 Oct 04 18:16:55.727176 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3397/4638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.740707 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1242/4639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1295 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.753631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.754271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.768756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.770188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.786078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.787229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.790142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.792452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.792972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.796543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.797299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.798919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.804919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.812439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.815519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.821340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.867592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:57.083791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.103247 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55bcbe49-2e29-458a-aac2-b7615fc2dad5 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1283 microversion: 2.1 time: 0.328223 Oct 04 18:16:57.123459 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1243/4640] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1283 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.131024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.143865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0fe176ba-edec-446c-9f57-b29a319a5a9c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.399663 Oct 04 18:16:57.144962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3398/4641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.131945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.133389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.148341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:58.155860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.157554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.159243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.162664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.165556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.172694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.173956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.179074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.197050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.206647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.209361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.215409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.228104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.230916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.830960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.846040 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c97c8094-e49a-4af1-89ef-044622b1c0c9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.718528 Oct 04 18:16:58.850238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.851041 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1244/4642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.860342 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de1b2d70-d688-44a8-ade6-b807beea09cc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.692657 Oct 04 18:16:58.867891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3399/4643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.880701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.882966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.900331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.902898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.925987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.928067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.931437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.935052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.936472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.941328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.943450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.946618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.947822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.949738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.950637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.952768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.602471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.625594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.628651 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3806fc25-abd7-4d2f-9fd4-2a7237a70b38 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.754812 Oct 04 18:17:00.629637 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1245/4644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:00.659937 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d2d925bb-25e8-4b9e-9d9d-2403c9fb6f25 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.768687 Oct 04 18:17:00.663653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3400/4645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:01.662047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.663226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.689440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.690128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.703553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.704072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.704504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.705244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.705708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.706235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.713233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.717130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.721349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.728700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.731766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.734316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.022273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.051804 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-793e3b49-7b70-49e4-82c5-f96003010e26 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.366247 Oct 04 18:17:02.053411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3401/4646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:02.102866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.113744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bfe46096-a09e-4fb3-a11f-da6b12abf375 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.460217 Oct 04 18:17:02.114909 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1246/4647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.199844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e986e-0e79-4603-993c-01a74b4fc3a4", "tag": "fab2e22a-3c33-45f0-8611-fa1ffa72a401"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:02.221279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.222029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.222625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.242169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] Creating event network-changed:fab2e22a-3c33-45f0-8611-fa1ffa72a401 for instance 562e986e-0e79-4603-993c-01a74b4fc3a4 on n-h1-831193-17 Oct 04 18:17:02.262559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-984392ac-f8d0-458b-963b-fee7cd9eef90 req-8ac2ed0e-d80c-43a5-be5f-bc7acf021f3a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067103 Oct 04 18:17:02.263639 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3402/4648] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:03.077758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.078980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.098113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.111865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.112586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.113486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.114087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.119817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.121126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:03.137512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:03.138910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:03.143326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.144521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.164109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.164611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.165046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.165761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.166214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.166646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.990692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.999519 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9410e655-c9c3-4bcd-8221-e03859f1a109 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.926171 Oct 04 18:17:04.009331 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1247/4649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.143947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.156499 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c380a4b3-1d4d-408d-9a35-e950046c8270 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 1.017552 Oct 04 18:17:04.159641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3403/4650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:05.031703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.032412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.057072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.061159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.066856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.067678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.068327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.068683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.182240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.184113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.200810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.201571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.205732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.206661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.207484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.210163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.509729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.533733 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44239eb4-2c3b-4cb1-9faa-089b301ac7df tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.506444 Oct 04 18:17:05.577740 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1248/4651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.687434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.709929 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e777f778-f8b3-425b-8675-2bb8b2a80881 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.533689 Oct 04 18:17:05.711565 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3404/4652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:06.584420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.585063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.600758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.602421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.604669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.608416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.609517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.610127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.733846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.735139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.756197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.758979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.759705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.760661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.762025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.763607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.182057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.193605 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c613e83-f897-4d8f-979e-e5288a2b618d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.613714 Oct 04 18:17:07.199479 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1249/4653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.270477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.285336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21261410-08aa-4336-aad9-652bc4b1bd3b tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.552732 Oct 04 18:17:07.286529 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3405/4654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:08.221599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.221599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.237396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.244747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.246057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.249471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.263093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.266271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.313834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.314613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.327333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:08.348358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.350002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.356228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.360397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.361165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.361839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.841703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.863163 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0ace776-2fe4-4429-b5f7-fd1b50697a3f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.648562 Oct 04 18:17:08.864006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1250/4655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.881450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e986e-0e79-4603-993c-01a74b4fc3a4", "name": "network-vif-plugged", "status": "completed", "tag": "fab2e22a-3c33-45f0-8611-fa1ffa72a401"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:08.900122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.902637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.903296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.933440 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] Creating event network-vif-plugged:fab2e22a-3c33-45f0-8611-fa1ffa72a401 for instance 562e986e-0e79-4603-993c-01a74b4fc3a4 on n-h1-831193-17 Oct 04 18:17:08.946195 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ece0d2f6-723b-4b89-8174-8fd69d34ea90 req-29f67dad-b5a7-4858-9d3d-d73e07d2a75f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080791 Oct 04 18:17:08.949710 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1251/4656] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:08.992921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.007159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6edaf6d9-af52-4821-9f3e-6b3c886473a9 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.693420 Oct 04 18:17:09.007820 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3406/4657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:09.892325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.893758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.912080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.913180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.913841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.914777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.915610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.916250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.036751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.037390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.050039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.050539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.050983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.051745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.052205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.052633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.121810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=85 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:10.303747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.316961 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-190c43de-48ce-4c4f-afca-cd313673efdf tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.431343 Oct 04 18:17:10.318722 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1252/4658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:10.512834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.528155 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0915c5a-7abd-4fe8-b14d-8955c29dc8a4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1325 microversion: 2.1 time: 0.494101 Oct 04 18:17:10.531731 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3407/4659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1325 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.342456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.343118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.358757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.358757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.367435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.372725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.376297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.376852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.557591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.558246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.574748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.580920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.581692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.582676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.583477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.584711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.800732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.814623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-27a2bd85-e8dc-48ed-bded-72c0e8dd336e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.476587 Oct 04 18:17:11.815547 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1253/4660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.884778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.897204 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6a73159-1d2f-4b46-be9b-dc1a75e634f1 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1521 microversion: 2.1 time: 0.343480 Oct 04 18:17:11.900042 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3408/4661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.926118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.926892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.934428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.935156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.935749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.936617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.940296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.940947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.045622 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Request method failure captured: Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4/ips/invalid HTTP/1.1 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHiNXJngnD-vplXVHjebyDVoNF1mx5n6-fd8NWUCDLELXJqF9Zufa0ktpZo9BH7Fqs7zbtCtjvmNeQwAj6_3Hbv2Hkp9zEMpwnDHNkMoHV0UF2UbcvQ010i-YkTynWXYDTANa29gtncWLkXNdNrEXKYNjSfRNnHU5ia9NW6Kxkj9ptA Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76888402caf845348f79f3dd942133de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76888402caf845348f79f3dd942133de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9484909fa13041ca8bb50805c1fc769b Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance is not a member of specified network Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '562e986e-0e79-4603-993c-01a74b4fc3a4', 'id': 'invalid'} Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 18:17:12.055323 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.061067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:12.062481 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60ae8161-280e-49c7-a5ce-749df7793bef tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.140042 Oct 04 18:17:12.064021 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1254/4662] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4/ips/invalid => generated 91 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:12.075843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.076413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Failed to fetch instance by id 999 {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:17:12.079689 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Request method failure captured: Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHiNXJngnD-vplXVHjebyDVoNF1mx5n6-fd8NWUCDLELXJqF9Zufa0ktpZo9BH7Fqs7zbtCtjvmNeQwAj6_3Hbv2Hkp9zEMpwnDHNkMoHV0UF2UbcvQ010i-YkTynWXYDTANa29gtncWLkXNdNrEXKYNjSfRNnHU5ia9NW6Kxkj9ptA Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76888402caf845348f79f3dd942133de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76888402caf845348f79f3dd942133de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 9484909fa13041ca8bb50805c1fc769b Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 999 could not be found. Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '999'} Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:17:12.084875 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:17:12.090517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:12.096074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e2f1fbff-0358-4be6-8985-d9b762b75468 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.025394 Oct 04 18:17:12.097267 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3409/4663] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:12.108647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.109154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.122636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.123183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.123636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.127617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.132423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.133623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.209295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:12.366625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db20d323-03f6-47ed-bde2-6e56521e10ac tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 204 len: 0 microversion: 2.1 time: 0.262949 Oct 04 18:17:12.370884 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1255/4664] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:12 2022] DELETE /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:12.381237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.381933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.411631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.413137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.413957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.414933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.415638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.416677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.683475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.697831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae9c651a-d227-4f4b-84f2-71e299583078 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1527 microversion: 2.1 time: 0.322068 Oct 04 18:17:12.700166 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3410/4665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1527 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.840390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.841106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.873401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.873401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.873401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.874538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.875306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.876167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.308754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.317488 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40971892-232e-459f-9edd-11697ac237c6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.481167 Oct 04 18:17:13.317890 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1256/4666] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.725534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.726158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.762288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.762818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.763306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.772650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.773142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.780802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.214059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.222910 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bfac82fc-5198-4278-a1d9-46b170633ffb tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1527 microversion: 2.1 time: 0.504148 Oct 04 18:17:14.223571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3411/4667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1527 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.341500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.342279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.352252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.355694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.356271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.357232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.359164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.359826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.913274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.924867 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ec2ae3a-92b3-412b-a42c-14b7c8664462 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1528 microversion: 2.1 time: 0.587271 Oct 04 18:17:14.939268 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1257/4668] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:15.247537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.248514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.258340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.262108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.265222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.266270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.266982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.267699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.432465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.443956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f4b5b70b-fc56-488d-95bb-3c0b8ef212c4 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1485 microversion: 2.1 time: 0.201471 Oct 04 18:17:15.450326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3412/4669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1485 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:15.641343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e986e-0e79-4603-993c-01a74b4fc3a4", "name": "network-vif-deleted", "tag": "fab2e22a-3c33-45f0-8611-fa1ffa72a401"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:15.666218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.668239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.673664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.707551 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] Creating event network-vif-deleted:fab2e22a-3c33-45f0-8611-fa1ffa72a401 for instance 562e986e-0e79-4603-993c-01a74b4fc3a4 on n-h1-831193-17 Oct 04 18:17:15.730210 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-09a3cbcf-4d5f-4176-9ef9-ee2a6f6a85dc req-9cc32a6b-9406-4581-8d7d-bdca83ca13a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093223 Oct 04 18:17:15.742990 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1258/4670] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:15.950049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.950828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.960120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.963347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.963916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.975940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.976587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.977141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.476029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.476726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.487083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.499775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.500401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.501497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.502159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.502740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.551625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.552776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.553502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.554244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lazy-loading 'fault' on Instance uuid 562e986e-0e79-4603-993c-01a74b4fc3a4 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:16.561367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:16.729568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9484909fa13041ca8bb50805c1fc769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76888402caf845348f79f3dd942133de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.747727 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a45b5bca-b2fc-4c5b-a08a-34f16cef24d3 tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 200 len: 1315 microversion: 2.1 time: 0.272489 Oct 04 18:17:16.749591 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1259/4671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:16.866791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.906750 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05f0fe4b-4bba-4b09-be04-c32903aa52a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1510 microversion: 2.1 time: 0.960655 Oct 04 18:17:16.910524 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3413/4672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1510 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.777509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.780018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] [instance: 562e986e-0e79-4603-993c-01a74b4fc3a4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.800930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.829427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.831989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.843795 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] HTTP exception thrown: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. Oct 04 18:17:17.846899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.847544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.847968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.848877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.849448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Request method failure captured: Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 HTTP/1.1 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHiNXJngnD-vplXVHjebyDVoNF1mx5n6-fd8NWUCDLELXJqF9Zufa0ktpZo9BH7Fqs7zbtCtjvmNeQwAj6_3Hbv2Hkp9zEMpwnDHNkMoHV0UF2UbcvQ010i-YkTynWXYDTANa29gtncWLkXNdNrEXKYNjSfRNnHU5ia9NW6Kxkj9ptA Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76888402caf845348f79f3dd942133de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76888402caf845348f79f3dd942133de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76888402caf845348f79f3dd942133de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 76888402caf845348f79f3dd942133de Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1808810460 Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 9484909fa13041ca8bb50805c1fc769b Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1808810460-project Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '562e986e-0e79-4603-993c-01a74b4fc3a4'} Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:17.850047 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. Oct 04 18:17:17.855627 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:17.856159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.856243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] Returning 404 to user: Instance 562e986e-0e79-4603-993c-01a74b4fc3a4 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:17.856243 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0013bcfc-cc30-462d-bd44-004c72a2770a tempest-ServerAddressesNegativeTestJSON-1808810460 tempest-ServerAddressesNegativeTestJSON-1808810460-project] 10.222.0.33 "GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4" status: 404 len: 111 microversion: 2.1 time: 0.082738 Oct 04 18:17:17.860435 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1260/4673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/562e986e-0e79-4603-993c-01a74b4fc3a4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:17.925894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c451952-cdc7-4569-ae16-21d898f559cb tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/ips" status: 200 len: 150 microversion: 2.1 time: 0.101914 Oct 04 18:17:17.926808 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3414/4674] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/ips => generated 150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:17.938458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.940313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.958521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.959099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.959514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.960227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.960987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.961733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.477172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.500251 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7d6abfc-bec7-47ea-93d8-7d69c564681e tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1510 microversion: 2.1 time: 0.565621 Oct 04 18:17:18.501059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1261/4675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.531383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.532134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.551516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.555291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.555933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.556774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.557347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.559214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.173533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "name": "network-vif-unplugged", "status": "completed", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:20.197435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.199397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.200065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.229066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.compute.server_external_events [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] Unable to find a host for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e. Dropping event network-vif-unplugged {{(pid=128771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:17:20.233030 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-693dd233-9501-4998-9913-8ce133b6efd5 req-2d35767e-4636-452f-8616-6cc531f9ef5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070106 Oct 04 18:17:20.234137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1262/4676] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:17:20.393905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.406613 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d895999-2c64-4816-b8fc-c2c1971581aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1513 microversion: 2.1 time: 0.884546 Oct 04 18:17:20.428394 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3415/4677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1513 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:20.433543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.434157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.446439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.446921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.447464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.448179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.449270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.449696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.692596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5147565e-ae88-408d-8b3b-cac60001bf45"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:20.700524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.727831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.728347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.728801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.731112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.734985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.736164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.123191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.146518 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5853ab8e-9b11-4864-a0db-611d2ed996ad tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1453 microversion: 2.1 time: 0.701760 Oct 04 18:17:21.161072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1263/4678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1453 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.222648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.223504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.242967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.243793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.245682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.246560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.248761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.251493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.341950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'flavor' on Instance uuid 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:21.360798 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-08ad3884-0535-4e6f-9265-6a7d98ed272d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "POST /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674890 Oct 04 18:17:21.361782 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3416/4679] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:17:20 2022] POST /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:21.416423 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'shelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state shelved_offloaded Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 14 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: {"shelve": {}} Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'shelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state shelved_offloaded Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'shelve': {}}} Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:17:21.418127 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state shelved_offloaded Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state shelved_offloaded Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.421502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'shelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state shelved_offloaded {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:21.423119 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a62f9789-fa30-4b15-a72d-7711f82e075d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 155 microversion: 2.1 time: 0.206289 Oct 04 18:17:21.428473 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1264/4680] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 155 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:17:21.434287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.435698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.455623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.456324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.458364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.460477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.464980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.465772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.677001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:17:21.881975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15a61848-1dd6-40a6-a551-58ca7942f158 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.453401 Oct 04 18:17:21.884000 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3417/4681] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:21.893791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.895270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.916553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.916864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.917873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.918583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.919176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.925246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.205590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.218238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36fa2ab8-1f2b-4b72-aaa0-42cd859972e2 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1461 microversion: 2.1 time: 1.330894 Oct 04 18:17:23.234147 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1265/4682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1461 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:24.246058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.252781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.277016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.277986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.281513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.289110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.293560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.293985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.904494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.935819 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57a853a0-5cd6-40e9-aa96-6c7be17b7d7f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1461 microversion: 2.1 time: 0.694840 Oct 04 18:17:24.936480 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3418/4683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1461 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.971735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.973186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.982895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.983757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.984354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.985227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.988377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.989323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.591014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.607796 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dfef00a9-529f-4f36-b91d-7c5d7606a9d7 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.648104 Oct 04 18:17:26.608389 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1266/4684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:27.640773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.642106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.656904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.658893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.660282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.661232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.664646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.667636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.512213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.554975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb2c6a85-d36e-437d-9642-42805f4b04b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.920888 Oct 04 18:17:28.577133 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3419/4685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:29.586286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.586969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.608402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:29.611331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.612010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.614021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.630515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.631304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.631901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.064931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1364188399", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": "none"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:30.069037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.090322 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1d76701-36bf-4000-ae63-745214c34c8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.498820 Oct 04 18:17:30.093101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1267/4686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.225450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:30.225840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:30.226346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:30.231099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:30.231561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:30.263653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.264154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.264600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.292790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.294729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.295945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.352812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Getting quotas for project fa8b992460654e25b38bf7f3025d6741. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:30.382154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Getting quotas for user 062b5ec9e8574638a8a16713e52b4ecb and project fa8b992460654e25b38bf7f3025d6741. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:30.414006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:30.440884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:30.554067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-53ccf6be-9448-48ef-8ece-bc263182d971 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.790510 Oct 04 18:17:30.556360 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3420/4687] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:17:30.568291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.569225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.892723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.918457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.920056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.921264 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-58979b3a-7e6f-444c-86f4-3b19920e2660 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1278 microversion: 2.57 time: 0.357021 Oct 04 18:17:30.921848 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1268/4688] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:31.121097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.122634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.136492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.139521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.141140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.144921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.145662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.146300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.621705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.639713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a95037d-96ed-4752-92d4-09f64877f8a6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.525738 Oct 04 18:17:31.642745 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3421/4689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:31.952243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.952867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.968826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.970059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.971544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.972451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.973061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.973644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.191416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.209567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.211396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.212547 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-627ad6a1-1825-44ed-b20b-d017fb14d008 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1282 microversion: 2.57 time: 0.265257 Oct 04 18:17:32.222567 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1269/4690] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1282 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:32.663370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.664470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.677170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.686445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.686941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.690053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.690576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.691006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.109513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.124208 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46572e2d-40ff-47c7-a630-35c299c8e1a1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.460076 Oct 04 18:17:33.125488 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3422/4691] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:33.243171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.244586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.264515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.265012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.265454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.273538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.275533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.277664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.409027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.426737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.428825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.430481 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b7a0268-f620-4774-8154-2ac2be6bbc9e tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1338 microversion: 2.57 time: 0.192592 Oct 04 18:17:33.432186 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1270/4692] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:34.150553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.151489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.165145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.169984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.170564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.171480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.176326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.176910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.216134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:34.463602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.464793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.478044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.478821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.480020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.480936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.484958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.485649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.528601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.543823 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4a15c2b-e84f-45e0-87e4-520fd54f5c93 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.397437 Oct 04 18:17:34.552236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3423/4693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:34.788367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.806370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.812268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.829777 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7ae9fdd8-8790-4806-a5f4-c653e1f59f08 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1336 microversion: 2.57 time: 0.370293 Oct 04 18:17:34.860653 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1271/4694] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1336 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:35.571850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.573406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.588212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.594134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.600583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.601476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.602061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.602592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.865761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.866958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.881926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.882883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.884117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.885547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.886871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.888193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.052147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.067164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.072003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.074502 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df483c76-e6d0-4846-b42d-6a6f258119d3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1336 microversion: 2.57 time: 0.212608 Oct 04 18:17:36.080380 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1272/4695] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1336 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:36.189735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.209172 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1feeb63-1084-41f8-885d-32e6d7442425 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.635005 Oct 04 18:17:36.213618 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3424/4696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:37.126384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.127218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.153352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.155588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.159126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.160127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.165750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.168371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.243150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.243978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.260795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.264856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.265597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.267965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.268667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.272610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.437757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.482127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.499784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.502617 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d57d705-52e0-4cfe-97c4-9d9986f675ed tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1357 microversion: 2.57 time: 0.389021 Oct 04 18:17:37.531665 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1273/4697] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:37.578212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:37.587915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.610493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.612396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.614023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.620692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.621176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.624551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.858128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.874737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-456fc454-ecb2-4684-a4ea-b83ed16520c1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.634607 Oct 04 18:17:37.877316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3425/4698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:37.892216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:37.893381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:37.894018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:37.895025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:37.895636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:38.009470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.028765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.031555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.032146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.034185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.038796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.039980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.192902 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf25c8df-64d2-486e-8a53-5f267eca245b tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "POST /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb/action" status: 202 len: 1138 microversion: 2.57 time: 0.653584 Oct 04 18:17:38.198592 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1274/4699] 10.222.0.33 () {62 vars in 1320 bytes} [Tue Oct 4 18:17:37 2022] POST /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb/action => generated 1138 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:17:38.222995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.224077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.235857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.238567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.241060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.245923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.248467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.254240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.598084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.612747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.614822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.616460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69813aad-b757-491a-978c-fa7507f60bf3 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.397613 Oct 04 18:17:38.620618 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3426/4700] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:38.908999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.915618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.933743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.938799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.940917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.944485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.945160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.945763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.321188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.331906 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad372135-d59a-4164-bf3b-ad0b65e835aa tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.426907 Oct 04 18:17:39.334816 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1275/4701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:39.649994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.651923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.662686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:39.664267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.664822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.664822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.664822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.664822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.685535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.944449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.959224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.969590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.971247 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b42a130-b1dd-4f72-88a5-3e19981a47ff tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.325644 Oct 04 18:17:39.972038 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3427/4702] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:40.358834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.360225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.373979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.381952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.383465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.386487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.390254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.390905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.467148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:40.807828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.837541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-acb77c1b-0ba8-4899-84d7-f13379d6c659 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.483365 Oct 04 18:17:40.838135 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1276/4703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:41.002287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.002955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.006260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:41.008638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:41.038057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.038565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.039010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.039759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.040222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.040654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.324831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.346663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.356235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.363450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-81317c0b-3d08-4ab5-8bab-2a692238ea46 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.362911 Oct 04 18:17:41.365968 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3428/4704] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:41.865591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.866343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.877446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:41.884728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.886481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.891089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.891089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.891089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.892489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.398038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.399437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.402641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.415310 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a4dde3c-f6ca-4c47-8c11-ad5afbe0441d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.557268 Oct 04 18:17:42.419336 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1277/4705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:42.433963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.435539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.439385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.442593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.443216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.445687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.665158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.682104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.686825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.691331 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-74c38e5f-5f37-4b20-b3c9-f24784854387 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.298147 Oct 04 18:17:42.692938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3429/4706] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:43.454995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.456143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.482431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.484585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.486280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.489394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.491870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.492688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.732551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.732551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.748654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.751507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.752894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.759014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.759753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.763582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.911254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.922936 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-173010ff-a2d7-4f0b-ba7b-5441c92b55cd tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.477609 Oct 04 18:17:43.930237 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1278/4707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:44.021606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.043928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.053842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.055381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d080c91-465e-47e6-8fa0-e07f8c21cd80 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.335308 Oct 04 18:17:44.061061 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3430/4708] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:44.954488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.955124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.965983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.976229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.977048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.978088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.978869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.979581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.096520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.097735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.107203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.117658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.120449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.123330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.131719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.135284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.325054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.336610 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3869296a-294b-44e4-8a7d-ade555abf034 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.386169 Oct 04 18:17:45.353787 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1279/4709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:45.362251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.388268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.395399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.399939 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54f0f7fc-08fd-49b2-8243-24dd8a9d26ef tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.306494 Oct 04 18:17:45.401379 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3431/4710] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:45.588173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.591719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.600315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.600916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.601423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.602427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.602967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.603531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.771148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lazy-loading 'services' on Instance uuid 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:45.889957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-309e550b-d909-4f2a-a638-a01316e95d3c tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments/5147565e-ae88-408d-8b3b-cac60001bf45" status: 202 len: 0 microversion: 2.1 time: 0.310084 Oct 04 18:17:45.891190 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1280/4711] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:17:45 2022] DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments/5147565e-ae88-408d-8b3b-cac60001bf45 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:45.908128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.915099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.935812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.936926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.937831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.938881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.939947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.940938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.992656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8488b8c-b3f0-4290-8b76-fc94e9363999 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096630 Oct 04 18:17:45.994404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3432/4712] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:46.367707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.372325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.379461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.380883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.381824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.382644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.383197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.383810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.428522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.429209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.442975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.443445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.443904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.444597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.447544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.448041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.652553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.665522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.670866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.672386 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5e64c2c-4ddf-4a16-a944-cebd86a290fb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.248104 Oct 04 18:17:46.683088 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3433/4713] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:46.685629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-620223961", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:46.763889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.774666 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b4aed71-f7cf-4302-8a00-21291a5da830 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.415385 Oct 04 18:17:46.775508 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1281/4714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:46.832844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] validate_networks() for None {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:47.009471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.011898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.033531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.034042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.034482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.035235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.041310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.042534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.114772 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1b7a9115-b7ab-4322-8a38-31826b83f676 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110825 Oct 04 18:17:47.121814 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1282/4715] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:47.344304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:47.344777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:47.345262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:47.345676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:47.346145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:47.360640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.361707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.362165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.363006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.363687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.364162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.388500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Getting quotas for project 66d877e4f9d44ef8ac05a47b3620c831. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:47.395799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Getting quotas for user 009378bc5e6a4c88bd59d8290cc3c68c and project 66d877e4f9d44ef8ac05a47b3620c831. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:47.413430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:47.415986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:47.495774 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e2aa1c2-2fc9-41d5-985a-3d5fbf46032e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811022 Oct 04 18:17:47.499078 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3434/4716] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:47.515430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6682098-e903-434f-81f7-835cfeb1900f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.517896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b6682098-e903-434f-81f7-835cfeb1900f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.653275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6682098-e903-434f-81f7-835cfeb1900f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.663304 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6682098-e903-434f-81f7-835cfeb1900f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1213 microversion: 2.1 time: 0.155744 Oct 04 18:17:47.666189 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1283/4717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:47.709804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.716116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.745600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.748956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.752149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.753253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.754700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.756112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.801314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.802863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.839865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.842156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.843291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.845824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.846797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.847928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.102859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.124630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.128356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.131884 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4df2850d-bc82-4092-983b-047bd77eaf9f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.427834 Oct 04 18:17:48.132496 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3435/4718] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:48.161964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.165512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.197873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.200513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.202824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.206750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.208988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.211168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.316100 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b802ad2-a303-4f51-8430-58578994083e tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159143 Oct 04 18:17:48.320079 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3436/4719] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:48.423768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.439789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9492e5da-38da-4ed4-9a8b-adf2da1b449b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.642905 Oct 04 18:17:48.442897 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1284/4720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:48.690501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.691197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.707190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.708079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.708985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.710176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.710860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.711680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.162002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.162625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.178856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.179662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.180261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.181134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.183654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.184354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.375024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.387357 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f70d788c-bd5a-4298-b0f8-85441df8e62c tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1265 microversion: 2.1 time: 0.701299 Oct 04 18:17:49.395224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3437/4721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1265 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:49.399237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.405357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.419949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.420560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.421020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.421748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.422380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.422814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.513202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06d33c51-720c-4fff-9421-38c2dfd6c292 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123815 Oct 04 18:17:49.524035 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3438/4722] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:49.534361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.536841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.563346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.563961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.564413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.565776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.566312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.567603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.585159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.605558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.609991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.613997 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-81c24378-54f8-406d-bc94-de2f3eb698a6 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.456814 Oct 04 18:17:49.627009 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1285/4723] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:50.090189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.105086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df573843-8f2f-4be1-a1a6-bf1761774be1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.576377 Oct 04 18:17:50.107640 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3439/4724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:50.411992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.413347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.425773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.426822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.427521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.434486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.435264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.435920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.527583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.529826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.547182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.547732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.548187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.548934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.552696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.553195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.556627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.569267 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d366500-fc04-4206-a815-52abdc5515f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1271 microversion: 2.1 time: 0.161241 Oct 04 18:17:50.572046 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1286/4725] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:50.578703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "name": "network-vif-plugged", "status": "completed", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:50.605181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.606734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.608841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.640001 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] Creating event network-vif-plugged:e6cd1033-d09a-40ed-bfa1-83813f407b3c for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e on n-h1-831193-17 Oct 04 18:17:50.649350 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ab5f83cb-e316-48b4-a1fb-ba5bd9923371 req-7df32eb5-b191-40bd-99a0-639dfadba518 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075820 Oct 04 18:17:50.650443 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1287/4726] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:50.666985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:50.670439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.674188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.691568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.692465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.694096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.697087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.698359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.699008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.710952 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-468cb0b1-18bd-4e5f-bb70-fecece377c0a tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188473 Oct 04 18:17:50.711601 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3440/4727] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:50.900789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.914528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.920419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.928341 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eea21d89-db5b-4e21-b4c2-b17264128547 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.272922 Oct 04 18:17:50.932858 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1288/4728] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:51.130335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.130856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.139776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.143343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.143981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.147294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.147958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.148614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.601253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.606993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.614810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.615423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.615952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.616724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.617284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.620187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.770532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.784350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15369337-161d-416d-a6da-5c51205da058 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 0.657045 Oct 04 18:17:51.799076 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3441/4729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.799076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.801167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.819867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.820405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.820865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.821621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.822097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.826127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.867977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.878708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a9f32a44-cfeb-44a2-a0b0-ff4eea37b3fd tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1271 microversion: 2.1 time: 0.281415 Oct 04 18:17:51.882952 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1289/4730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.918520 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f53ab29e-a7c2-476d-9689-54464977f293 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131985 Oct 04 18:17:51.921423 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3442/4731] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:51.967899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.969987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.985709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.988814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.990116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.991982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.993185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.996258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.112632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.128731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.132893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.134957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec4166f7-0e82-4d1c-b4aa-c9a0a106ea8d tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.173697 Oct 04 18:17:52.136151 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1290/4732] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:52.808996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.809631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.833885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.834651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.835699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.841457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.850129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.850129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.912972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.913606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.948784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.955299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.957064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.959923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.968692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.969334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.286028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.308481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e0511d5-6f6c-47b0-bb81-0dbbfad98c58 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1519 microversion: 2.1 time: 1.503870 Oct 04 18:17:54.314023 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3443/4733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1519 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.352528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.359703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.383358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.383942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.384448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.387703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.388935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.390987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.470651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2b6cbd8-67b5-4f42-a9ae-a1657a06ec25 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138266 Oct 04 18:17:54.471200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3444/4734] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:17:54.486064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.486696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.498135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.500308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.500764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.501490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.507782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.508876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.652925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.663654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae869081-e97f-4733-bc96-b88de4898a10 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 1.751948 Oct 04 18:17:54.678532 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1291/4735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.689909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.694032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.711808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.712588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.713189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.714129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.718371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.719085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.748468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.771755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.773159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.774399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-318daf4f-9e17-41c6-ab2a-d8ec3e9fb1e4 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.302249 Oct 04 18:17:54.775332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:54.776065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3445/4736] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:54.879443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:54.950101 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-15dc28c4-7477-4f4b-84c1-ff004e30f9e3 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 204 len: 0 microversion: 2.1 time: 0.270022 Oct 04 18:17:54.954913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1292/4737] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:54 2022] DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:54.959734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.960366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.973197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.973804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.974265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.975133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.975615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.976054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.349649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.351126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.375430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.376133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.376707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.377570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.378179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.378752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.522120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.550801 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8d7fda8-1ce0-4df4-bdf8-42c43b56e894 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1682 microversion: 2.1 time: 0.594908 Oct 04 18:17:55.561283 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3446/4738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1682 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:55.679555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875d66e5-1d55-4932-a479-03d41799c7a2", "tag": "e3141eef-d134-4650-b70e-14e6eb2213a1"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:55.698256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.701299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.701928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.726253 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] Creating event network-changed:e3141eef-d134-4650-b70e-14e6eb2213a1 for instance 875d66e5-1d55-4932-a479-03d41799c7a2 on n-h2-831193-17 Oct 04 18:17:55.746832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-11908607-e952-449a-9150-ea3da4713047 req-65d5d25c-ec0e-4171-9ae8-513501f94f7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071259 Oct 04 18:17:55.752435 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3447/4739] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:55.765227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.771555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.783608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.800581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.812588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.813548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.839115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.839580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.192088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.203970 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-168854dc-81a9-417e-b3b5-bc142bbd203b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.858818 Oct 04 18:17:56.217345 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1293/4740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:56.222476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.238105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.259757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.260527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.261156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.264244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.264877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.268054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.453918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.477422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.479651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.480905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b77ab9d8-07ea-4671-9063-120c5eb5a9d9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.262476 Oct 04 18:17:56.491060 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1294/4741] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:56.507063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.507063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.507063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.507802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.508450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.509427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.511545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.512155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.763754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.774941 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-912b3907-abd8-4cee-8e89-d937e96ce7f2 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 1.021046 Oct 04 18:17:56.779665 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3448/4742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:56.785771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.793172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.802081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.804111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.804786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.808150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.808860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.809398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.377652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.407484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.661335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.785860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.804251 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b4b365a-1b39-4205-aeb5-bc141a842f22 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 1.318012 Oct 04 18:17:57.809138 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1295/4743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:57.849162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.849807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.860243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.860753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.861198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.861914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.862507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.863125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.420670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.433415 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b55bf4e-7643-4677-82cc-42a808b3b5d7 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1682 microversion: 2.1 time: 1.652479 Oct 04 18:17:58.434028 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3449/4744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1682 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:58.443460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.444089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.485138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.485338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.485796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.486785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.487287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.487727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.491140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.502676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.509332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.515745 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5be46684-0182-40b8-9576-efc13d70eeb1 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.705214 Oct 04 18:17:58.516644 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1296/4745] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:58.526875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.531108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.544503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.545144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.545791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.552812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.553539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.554052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.226682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.259257 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b68f5a16-dd6e-4885-9830-913698aebab1 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.736786 Oct 04 18:17:59.262192 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1297/4746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.286583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.292151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aa16d04f-b8f3-48e5-abd7-205a41d352c9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:59.302194 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc4ebb03-f171-4a05-95d9-c8ee2a071b8a tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 0.867022 Oct 04 18:17:59.304504 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3450/4747] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.316624 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-aa16d04f-b8f3-48e5-abd7-205a41d352c9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aa16d04f-b8f3-48e5-abd7-205a41d352c9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/ec5d6041-e185-4a6d-8f55-a703bfabe040/action HTTP/1.1 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 15 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: {"os-stop": {}} Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ec5d6041-e185-4a6d-8f55-a703bfabe040', 'body': {'os-stop': {}}} Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:59.345595 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aa16d04f-b8f3-48e5-abd7-205a41d352c9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance ec5d6041-e185-4a6d-8f55-a703bfabe040 has no mapping to a cell. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aa16d04f-b8f3-48e5-abd7-205a41d352c9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/ec5d6041-e185-4a6d-8f55-a703bfabe040/action" status: 404 len: 117 microversion: 2.1 time: 0.062551 Oct 04 18:17:59.349611 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1298/4748] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:59 2022] POST /compute/v2.1/servers/ec5d6041-e185-4a6d-8f55-a703bfabe040/action => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:17:59.357560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.358413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.366951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.367688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.368317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.369052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.370089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.370727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.466917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.467726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.475156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.476001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.476549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.477388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.478084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.478725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.810955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.860833 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78f99430-bf1b-4a0c-b69e-794b09013474 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.507161 Oct 04 18:17:59.861026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3451/4749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.889476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.890088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.899213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.899949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.900552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.901492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.902113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.902702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.977954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.988450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f7b7a4f1-8adc-4301-b08e-b93710b1e558 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1682 microversion: 2.1 time: 0.525393 Oct 04 18:17:59.989374 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1299/4750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1682 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.995729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.996333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.998244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:00.004376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.005119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.005952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.007247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.008039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.008613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.044407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.053115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.055140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.056612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a3f1fc8-abf6-4cc5-9b57-4e5502ee3fa9 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.172351 Oct 04 18:18:00.057769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3452/4751] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:00.328602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.329239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.346755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.347313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.347760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.348497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.350354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.350354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.746917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.755361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-48773a27-5515-4673-95ab-a3f18aa56e8d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.764063 Oct 04 18:18:00.772157 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1300/4752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:00.783682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:00.784878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 12d8d0b0-81d7-40bb-9af5-4710d860da8e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.800359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/12d8d0b0-81d7-40bb-9af5-4710d860da8e/action HTTP/1.1 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 15 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: {"suspend": {}} Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '12d8d0b0-81d7-40bb-9af5-4710d860da8e', 'body': {'suspend': {}}} Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:00.801904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 12d8d0b0-81d7-40bb-9af5-4710d860da8e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-06b08398-9d93-4331-a6b3-d2abd3bb5383 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/12d8d0b0-81d7-40bb-9af5-4710d860da8e/action" status: 404 len: 111 microversion: 2.1 time: 0.026019 Oct 04 18:18:00.805516 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1301/4753] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:00 2022] POST /compute/v2.1/servers/12d8d0b0-81d7-40bb-9af5-4710d860da8e/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:00.815977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.816589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.832757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.156132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.184975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-863675a4-b728-419b-8fdf-e5e1267a36d8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 0.860193 Oct 04 18:18:01.195066 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3453/4754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.195066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.195066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.216291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.216291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.216291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.216703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.217279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.217601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.479221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56342562970646fba44f4e59cd355761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd537f30be51b4aa682baf624b4b558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.497697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.501926 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63cb3169-6fa1-4629-abea-44a9c92ed9f9 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 200 len: 1614 microversion: 2.1 time: 0.314846 Oct 04 18:18:01.506815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3454/4755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 1614 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.518187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.518950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.522285 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3471a2a7-b8c8-4f17-8cde-b891e1dc48e4 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.710131 Oct 04 18:18:01.523097 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1302/4756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.529110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb", "name": "network-vif-deleted", "tag": "ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:01.552521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.557134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.557915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.560803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.563917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.566511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.567388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.570503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.571515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.585428 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] Creating event network-vif-deleted:ef9d7b3a-4bc6-4626-9ccc-abcaaa001fb4 for instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb on n-h2-831193-17 Oct 04 18:18:01.599916 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-242d29d3-f2d1-45c7-b0a9-82210920546b req-16259959-851d-436d-a871-cd08a033fc48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074896 Oct 04 18:18:01.601106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1303/4757] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:01.610674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.611660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.625304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.626005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.626601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.627499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.628036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.628539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.672699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.682566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.686309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.695329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d8c36cd-43e2-4163-9ee3-144a487ebbdb tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.187113 Oct 04 18:18:01.696234 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3455/4758] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:02.212504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.213160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.233026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.236381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.239371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.241447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.242358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.245601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.913412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.928456 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-649d0c3a-2ffe-4e16-98d2-1791ae5910ea tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 1.324070 Oct 04 18:18:02.931146 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1304/4759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:02.941976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.942854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.967340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.968090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.968778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.969671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.972998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.973807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.974450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.988416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67fb299d-d603-45f0-bb08-411809bdae1f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 0.779461 Oct 04 18:18:02.989223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3456/4760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:03.005480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.006371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.012834 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb HTTP/1.1 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb'} Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:03.016387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:03.020884 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:03.024429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:03.027976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.028596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.029165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.030241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.030932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.031106 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a494b9f-ea85-4834-832b-8d2188b140ab tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 404 len: 111 microversion: 2.1 time: 0.094745 Oct 04 18:18:03.031725 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1305/4761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:03.031966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.047801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0287fe97-3840-464e-86c6-bb54c4e25898 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: .version_select at 0x7f63432c5430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-95440069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpDGp0fH8hq7dEAN1zpv3W72y2W5hReCcDcayTt4js0XajFS/CfVBgL2YNQcx55emTa7XTMqamNMds9CPHKyRBpiQcqU6jui09kaGebCRYguRwvJzsP428MXIsFO4hf6Q=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:03.126643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0287fe97-3840-464e-86c6-bb54c4e25898 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:03.160474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.176093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0287fe97-3840-464e-86c6-bb54c4e25898 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:03.176646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.178154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.189142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f31df487-4e33-4668-918a-e28636cdabbd tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.183878 Oct 04 18:18:03.195071 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3457/4762] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:03.208224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:03.216288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.228625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.231952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.232523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.236525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.241958 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0287fe97-3840-464e-86c6-bb54c4e25898 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.203708 Oct 04 18:18:03.243160 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1306/4763] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:18:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:03.245941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.252659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.270546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-336b53ee-e4c5-4ee7-b62b-5ae7428bfe97 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '.version_select at 0x7f6341e66e50>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.376064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:03.389708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-336b53ee-e4c5-4ee7-b62b-5ae7428bfe97 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144763365" status: 202 len: 0 microversion: 2.1 time: 0.145285 Oct 04 18:18:03.397936 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1307/4764] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144763365 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:03.418947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'flavor' on Instance uuid 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:03.673103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c33a9d7-191c-4971-ad38-27b92f38def5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.476546 Oct 04 18:18:03.673693 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3458/4765] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:03 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:03.683646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.685236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.696488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.700474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.701198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.702326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.702991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.706529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.020695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.021561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.036500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.038399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.039902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.043026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.043771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.044326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.548847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.560790 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e1df54e-c3dd-4893-89d8-7160012ead8c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1514 microversion: 2.1 time: 0.882579 Oct 04 18:18:04.561377 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1308/4766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1514 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:04.570447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.571100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.596204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.599326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.600006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.602174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.603813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.604498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.955256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.977985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.980627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.988821 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e04af40-2dee-4695-93cb-78a7fe9ca736 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1366 microversion: 2.57 time: 0.426381 Oct 04 18:18:04.995426 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1309/4767] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:05.011966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.046595 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0656cf37-8a4a-4ae3-b53d-f71f1bbc6de7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 1.030751 Oct 04 18:18:05.048273 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3459/4768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:05.585343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.585343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.595523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.596036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.596455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.597163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.615870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.616370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.033305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.034603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.052308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.053048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.053517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.054273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.058747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.063418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.322061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.341917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.348511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.351931 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23dc092d-23dd-44b0-b8e5-f7eb020c7211 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1372 microversion: 2.57 time: 0.323783 Oct 04 18:18:06.355204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3460/4769] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:06.368138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.370632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.388484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.390904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.393395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.394389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.401483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.410670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.411718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.418958 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-085ed581-b930-4e6c-887f-0f4b35c0d4fc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1497 microversion: 2.1 time: 0.836858 Oct 04 18:18:06.420618 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1310/4770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1497 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.447316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:06.447903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.458489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.471899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.472369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.473481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.474066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.474513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.597359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'flavor' on Instance uuid 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:06.638060 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'suspend' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state suspended Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 15 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: {"suspend": {}} Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'suspend' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state suspended Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'suspend': {}}} Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:18:06.642387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state suspended Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state suspended Oct 04 18:18:06.646550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:06.652496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'suspend' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state suspended {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:06.653673 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-69f93833-104b-43fd-a9f5-68c792838062 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 148 microversion: 2.1 time: 0.215599 Oct 04 18:18:06.656754 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1311/4771] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:06 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 148 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:06.670245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:06.672566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.684339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.687267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.692251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.693309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.695285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.698665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.854496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.865500 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57ac91d6-ec53-4de3-a5af-39e147df8aa7 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 0.508906 Oct 04 18:18:06.866743 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3461/4772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.875497 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-faf39403-57b1-43d5-9014-86d57304ffa0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 202 len: 0 microversion: 2.1 time: 0.214796 Oct 04 18:18:06.879689 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1312/4773] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:06 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:06.893049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.894271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.904248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.905004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.905768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.906875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.907558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.908209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.351573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875d66e5-1d55-4932-a479-03d41799c7a2", "name": "network-vif-plugged", "status": "completed", "tag": "e3141eef-d134-4650-b70e-14e6eb2213a1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:07.374271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.376939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.378230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.415389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.427228 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45ac0b18-664f-4512-9410-e695b9f111e0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1503 microversion: 2.1 time: 0.545833 Oct 04 18:18:07.443060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3462/4774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:07.444361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] Creating event network-vif-plugged:e3141eef-d134-4650-b70e-14e6eb2213a1 for instance 875d66e5-1d55-4932-a479-03d41799c7a2 on n-h2-831193-17 Oct 04 18:18:07.458166 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c47afadf-cdcd-4506-906e-0f124c26f061 req-60729fd5-0bbc-43e4-be95-4a03a048290d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112595 Oct 04 18:18:07.460368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1313/4775] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:07.465750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.467252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.475340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.493240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.494151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.495719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.499768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.501276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.704293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.714819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.721236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.722867 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f7048089-d2ac-4b42-b321-a950c9c2a97c tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1357 microversion: 2.57 time: 0.289542 Oct 04 18:18:07.735913 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3463/4776] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:07.759164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.759745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.767227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.767926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.768507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.770397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.770397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.770887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.800550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:07.806731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:07.894778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.896402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.918654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.921103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.922837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.924452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.926272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.929012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.013462 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6aabeab-7434-4159-a555-776a7613fa26 tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "DELETE /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 204 len: 0 microversion: 2.57 time: 0.258299 Oct 04 18:18:08.015097 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1314/4777] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:07 2022] DELETE /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:18:08.024665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.025377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.059770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.060411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.060745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.064740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.065988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.066432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.792119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.816076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.820590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.825611 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a737d9a4-6f6e-4600-a0e9-8cb8164b1e5f tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1363 microversion: 2.57 time: 0.806525 Oct 04 18:18:08.849975 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1315/4778] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:08 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1363 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:08.871599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.872241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.913069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.913580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.914025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.914750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.915315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.917996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.257701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.265790 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61c312a4-6a78-4d8f-ae49-a73860702ce0 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1503 microversion: 2.1 time: 0.413467 Oct 04 18:18:09.266548 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1316/4779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:08 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:09.318936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2007929781", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "87af896a-8208-4484-bf1a-f17af17826ee"}], "key_name": "tempest-TestNetworkBasicOps-95440069", "security_groups": [{"name": "tempest-secgroup-smoke-2044528415"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:09.342052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.352404 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2976eb2a-e84f-414b-acbc-6bc9cd5846b6 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1313 microversion: 2.1 time: 1.464553 Oct 04 18:18:09.371296 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3464/4780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1313 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:09.477380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] validate_networks() for [('87af896a-8208-4484-bf1a-f17af17826ee', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:09.855714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.856627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.866420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:09.876458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.878085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.878709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.881834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.882658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.883985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.094477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.105790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.109452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '062b5ec9e8574638a8a16713e52b4ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8b992460654e25b38bf7f3025d6741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.114658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7d1d2e9f-409d-4aba-822f-081fb7c93fba tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 200 len: 1363 microversion: 2.57 time: 0.263966 Oct 04 18:18:10.132242 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3465/4781] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:10.292989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.294076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.302586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.304083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.306484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.308220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.309975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.310637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.393356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:10.394738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:10.395704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:10.396452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:10.397013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:10.419093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.419893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.420518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.421431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.422237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.425747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.472249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:10.486566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:10.526225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:10.528923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:10.652287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.664236 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee547f5e-72cc-46c6-a518-a972cd668f2f tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.374964 Oct 04 18:18:10.678231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3466/4782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:10.681450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2bd6a5b-9588-4e15-abf3-53bbc0a5c38f tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.366259 Oct 04 18:18:10.688287 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1317/4783] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:10.704225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-42434ae4-0c36-4c00-9f67-4db8dc3ff80d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.704853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-42434ae4-0c36-4c00-9f67-4db8dc3ff80d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.739323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.740383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.773614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.774526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.778363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.783532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.785618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.787303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.829217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-42434ae4-0c36-4c00-9f67-4db8dc3ff80d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.846529 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-42434ae4-0c36-4c00-9f67-4db8dc3ff80d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1247 microversion: 2.1 time: 0.142822 Oct 04 18:18:10.849814 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1318/4784] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1247 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:10.858139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.860837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.866984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.871489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.875288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.879864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.880620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.884747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.165323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.179371 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bcd9020f-7999-40d1-95c8-c90027963659 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1463 microversion: 2.1 time: 0.497158 Oct 04 18:18:11.181153 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3467/4785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1463 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.207875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.209139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] [instance: 323a8830-f362-465a-b511-921699e23ffb] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.220365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.221249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.221934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.222669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.223360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.224738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.229132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.248348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] HTTP exception thrown: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. Oct 04 18:18:11.249147 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2de83909-6886-4f76-97fe-65ac1005e2ce tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.397984 Oct 04 18:18:11.250899 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1319/4786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Request method failure captured: Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb HTTP/1.1 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHi5v7vyhf7X-Zx-m9r0UDK6W9TbxoKjKmWdTHPwj4CX1hVL8vkjIkI1dGg-oPbc7B5TzkI-wFXZbCp662T1huoGokj1A7SI8rDBMy6iQzCH1U8HTNp8a9G42dwTr3KjO6IHIEL7OmMup-6OOsNmECfDyoHHwhbn9KGqTKteIjo_eNw Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fa8b992460654e25b38bf7f3025d6741 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerShowV257Test-2073693530 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa8b992460654e25b38bf7f3025d6741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa8b992460654e25b38bf7f3025d6741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa8b992460654e25b38bf7f3025d6741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa8b992460654e25b38bf7f3025d6741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerShowV257Test-2073693530 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fa8b992460654e25b38bf7f3025d6741 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerShowV257Test-2073693530 Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerShowV257Test-2073693530-project Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 062b5ec9e8574638a8a16713e52b4ecb Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerShowV257Test-2073693530-project Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '323a8830-f362-465a-b511-921699e23ffb'} Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:11.251409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. Oct 04 18:18:11.255353 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.257550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] Returning 404 to user: Instance 323a8830-f362-465a-b511-921699e23ffb could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:11.258711 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a34e4eb-ac78-4699-b604-488712b1b6fe tempest-ServerShowV257Test-2073693530 tempest-ServerShowV257Test-2073693530-project] 10.222.0.33 "GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb" status: 404 len: 111 microversion: 2.57 time: 0.076264 Oct 04 18:18:11.259579 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3468/4787] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/323a8830-f362-465a-b511-921699e23ffb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:11.263298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70963f07-e1ca-4c35-9f42-a1044966aa49", "device": "/dev/sdb"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:11.268751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.283701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.285733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.286180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.290114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:11.290925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 580ac462-300e-46fb-bd54-4ec9524981d2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.291087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.291516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.291950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.306123 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/580ac462-300e-46fb-bd54-4ec9524981d2/action HTTP/1.1 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 15 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: {"unpause": {}} Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '580ac462-300e-46fb-bd54-4ec9524981d2', 'body': {'unpause': {}}} Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:11.313622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:11.317441 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:11.317441 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:11.317441 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. Oct 04 18:18:11.317441 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:11.321536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 580ac462-300e-46fb-bd54-4ec9524981d2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:11.323281 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19a38f25-077a-4a5c-a322-229fa3be5f8a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/580ac462-300e-46fb-bd54-4ec9524981d2/action" status: 404 len: 111 microversion: 2.1 time: 0.038791 Oct 04 18:18:11.325493 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3469/4788] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:11 2022] POST /compute/v2.1/servers/580ac462-300e-46fb-bd54-4ec9524981d2/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:11.344777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.346723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.366038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.367840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.371023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.372020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.373033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.375526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.764748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.780199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab31bf0d-00ac-4ac7-92b1-d250d5b00415 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.450932 Oct 04 18:18:11.799206 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3470/4789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.811946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.812633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.829325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.829942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.830465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.831405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.831738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.832179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.874294 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54b87bfe-b9be-4d53-a164-2ad9d6f6b52e tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "POST /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621059 Oct 04 18:18:11.910293 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1320/4790] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:18:11 2022] POST /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:11.923247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.933382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.953193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.953833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.954532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.957952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.958685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.960692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.319234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.335128 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1a699dc6-9fb3-4fbc-9000-505ef7ecf611 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1251 microversion: 2.1 time: 0.418600 Oct 04 18:18:12.336336 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1321/4791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1251 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:12.342326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.343099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.382120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.383005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.383961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.385119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.385726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.386322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.408575 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb HTTP/1.1 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb'} Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.411607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.415992 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.418914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.420570 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6048df3f-ef1e-45bc-8667-39a003ef2600 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 404 len: 111 microversion: 2.1 time: 0.083167 Oct 04 18:18:12.421810 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1322/4792] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:12 2022] DELETE /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.438976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.439508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.446031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.446548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.446968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.447979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.448614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.449237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.480489 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb HTTP/1.1 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb'} Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.484935 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.490821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.491410 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b043ff4-7352-4660-bbeb-b9e645dbc83d tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb" status: 404 len: 111 microversion: 2.1 time: 0.064872 Oct 04 18:18:12.496501 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1323/4793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/6a5c0ba4-cb47-4ace-b5ab-a8e0a462adbb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.505853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.514229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-127fc576-a99e-4f07-bf07-f86cc98786e8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.710159 Oct 04 18:18:12.515011 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3471/4794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:12.546273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:12.546802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.568674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.569301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.569785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.574575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.581758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.582707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.668851 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'unpause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 15 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: {"unpause": {}} Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'unpause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'unpause': {}}} Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.677012 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.680945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'unpause' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.683060 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-009b1aaf-ce49-4198-b62d-38414f6143a8 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 145 microversion: 2.1 time: 0.139307 Oct 04 18:18:12.683646 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1324/4795] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:12 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 145 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:12.692909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.693782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.711571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.712288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.716936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.718135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.719590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.720950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.231371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.241485 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de4ac1e5-e1b5-45bc-8aea-5dce02e7acf6 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.552915 Oct 04 18:18:13.242093 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3472/4796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.270816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.275901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.297016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.298045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.301709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.302718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.303713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.304392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.387229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.388346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.410226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.410938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.411420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.420285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.420839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.421300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.735018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.745417 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb7adc94-e5c0-49f5-8873-51fe03a03028 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1305 microversion: 2.1 time: 0.362882 Oct 04 18:18:13.750522 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3473/4797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1305 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:13.821498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.856625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cacdb2b5-f9f2-4a52-a9fa-fdb02dcbc530 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.589643 Oct 04 18:18:13.857828 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1325/4798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.898250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:13.898878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: d63af907-f528-4de4-b901-31e34bc4990c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.917542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/d63af907-f528-4de4-b901-31e34bc4990c/action HTTP/1.1 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 18 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: {"unshelve": null} Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'd63af907-f528-4de4-b901-31e34bc4990c', 'body': {'unshelve': None}} Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:13.931560 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. Oct 04 18:18:13.935792 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:13.938663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance d63af907-f528-4de4-b901-31e34bc4990c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:13.939815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dfa35619-dcb9-419e-9493-7aa0a33315bc tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/d63af907-f528-4de4-b901-31e34bc4990c/action" status: 404 len: 111 microversion: 2.1 time: 0.058697 Oct 04 18:18:13.944512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3474/4799] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:13 2022] POST /compute/v2.1/servers/d63af907-f528-4de4-b901-31e34bc4990c/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:13.950233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.951240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.965217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.966051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.968938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.970296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.971210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.974126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.264466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.286241 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a8a94e3b-1525-4f6d-a1c6-aa46fda7432d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.340467 Oct 04 18:18:14.288308 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1326/4800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:14.314677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.315928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.339561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.340352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.340999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.341920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.343829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.345678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.799187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.801063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.814797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.817553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.819465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.820541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.824604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.827692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.099219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.111189 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-96d1969b-8129-45ea-a7c5-40b424e85ee8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1305 microversion: 2.1 time: 0.316173 Oct 04 18:18:15.114698 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1327/4801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1305 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:15.208134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.217366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:15.239494 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3316b257-47d7-4834-bbba-fdf1a7f65ccb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.925483 Oct 04 18:18:15.242764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3475/4802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:15.269235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:15.270452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.283090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.286566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.287187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.289665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.290143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.290584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.381124 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Cannot 'unshelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action HTTP/1.1 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 18 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: {"unshelve": null} Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: exception: Cannot 'unshelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'unshelve': None}} Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:15.383155 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active Oct 04 18:18:15.386710 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.388232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 409 to user: Cannot 'unshelve' instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e while it is in vm_state active {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:15.389253 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5f4e6bf4-4a0c-45df-8f5c-089292eb9e3a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action" status: 409 len: 146 microversion: 2.1 time: 0.124892 Oct 04 18:18:15.390306 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1328/4803] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:15 2022] POST /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e/action => generated 146 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:15.399471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.401168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.420343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.421075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.422576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.425305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.425965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.427936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.000441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.011781 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e32c0dc-5a43-4547-a287-b251af3bcb52 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.617068 Oct 04 18:18:16.013116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3476/4804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:16.040916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.043310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.059219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.060031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.062949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.064246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.065757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.065757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.151566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.156405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.202024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.202544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.202993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.204774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.205646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.209216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.438944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.453810 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-baf8fa89-c558-46d4-884e-17050ba30c6c tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.417310 Oct 04 18:18:16.454403 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1329/4805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:16.485153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1233191810_updated"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:16.488406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 70f0dbf7-d210-4c01-89a8-12947d35b933] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.497578 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/servers/70f0dbf7-d210-4c01-89a8-12947d35b933 HTTP/1.1 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 81 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1233191810_updated"}} Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '70f0dbf7-d210-4c01-89a8-12947d35b933', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1233191810_updated'}}} Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:18:16.500461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. Oct 04 18:18:16.504230 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.507798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 70f0dbf7-d210-4c01-89a8-12947d35b933 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:16.513867 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-953f0b2d-3427-4b1d-9e74-658d2a023911 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "PUT /compute/v2.1/servers/70f0dbf7-d210-4c01-89a8-12947d35b933" status: 404 len: 111 microversion: 2.1 time: 0.034373 Oct 04 18:18:16.517518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.522743 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1330/4806] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:18:16 2022] PUT /compute/v2.1/servers/70f0dbf7-d210-4c01-89a8-12947d35b933 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:16.545515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4f39c6de-d79d-4a98-bd68-c2edcf855fbb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 0.405884 Oct 04 18:18:16.551971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3477/4807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:16.568394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.572000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.617819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.630915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.632401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.638272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.640071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.644633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.019608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.085260 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eaa7bf24-3f69-4de4-b422-cae71dae0876 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.538077 Oct 04 18:18:17.088735 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1331/4808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.113910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.114448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.132951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.133782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.134425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.136544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.137196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.141173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.445862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.456021 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-106357b8-7b6f-4636-9ce0-2422c78c0a71 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.345485 Oct 04 18:18:17.460018 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3478/4809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.487059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7dcdf766-5c3a-4127-82dd-699ff291b25a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7dcdf766-5c3a-4127-82dd-699ff291b25a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e HTTP/1.1 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 280 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.492565 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.496877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7dcdf766-5c3a-4127-82dd-699ff291b25a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:17.499959 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7dcdf766-5c3a-4127-82dd-699ff291b25a tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 400 len: 619 microversion: 2.1 time: 0.015599 Oct 04 18:18:17.499959 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1332/4810] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Oct 4 18:18:17 2022] PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:17.507738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.510984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.534698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.535237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.535574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.536294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.536763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.537203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.575880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.576500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.600846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:17.606552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.611460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.611984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.612864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.613934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.614375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.664158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:17.909728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.930988 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31c41ef5-e280-45d2-9704-2a2d12f8a02d tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.428991 Oct 04 18:18:17.937696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3479/4811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.971267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.973925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.997756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.999121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.001869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.002930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.005925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.007805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.024364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.042623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36426a64-38da-47ae-a74c-b8dece7f3f93 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 0.468987 Oct 04 18:18:18.055138 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1333/4812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:18.222143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.231433 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c283ee7-919c-48d5-884b-aaedff46bfe5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.268944 Oct 04 18:18:18.232598 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3480/4813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:18.254928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f9d529b-c4d0-498f-96e6-4f53f4885e04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f9d529b-c4d0-498f-96e6-4f53f4885e04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: request: PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e HTTP/1.1 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 24 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: {"server": {"name": ""}} Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e', 'body': {'server': {'name': ''}}} Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi '' Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:18:18.259306 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:18:18.263948 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.265780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f9d529b-c4d0-498f-96e6-4f53f4885e04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:18.266822 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f9d529b-c4d0-498f-96e6-4f53f4885e04 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 400 len: 108 microversion: 2.1 time: 0.016469 Oct 04 18:18:18.267628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1334/4814] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:18:18 2022] PUT /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:18.277240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.278211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.285702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.286793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.287465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.288369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.289003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.289621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.418525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.419860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.427659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.428420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.429056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.429937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.430576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.431219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.456675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 HTTP/1.1 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e5f940f1-1345-4356-94f8-4578d1ea8581'} Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:18.458465 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.461911 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.464973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:18.471625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-040dfe9d-f89a-488e-896d-4092d5350b57 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 404 len: 111 microversion: 2.1 time: 0.058294 Oct 04 18:18:18.476032 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1335/4815] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:18 2022] DELETE /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:18.481825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.487954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: e5f940f1-1345-4356-94f8-4578d1ea8581] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.503991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.504812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.505560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.506457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.507123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.507931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.536676 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 HTTP/1.1 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e5f940f1-1345-4356-94f8-4578d1ea8581'} Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.538546 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. Oct 04 18:18:18.542593 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.555951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance e5f940f1-1345-4356-94f8-4578d1ea8581 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:18.557166 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4243c0f5-ff94-4abb-b808-d99502ce5d87 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581" status: 404 len: 111 microversion: 2.1 time: 0.079800 Oct 04 18:18:18.557922 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1336/4816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/e5f940f1-1345-4356-94f8-4578d1ea8581 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:18.566043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.566824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.576349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.584621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.585366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.586287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.586924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.587569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.596475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.605545 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a39f0d91-df74-4012-8d10-83e34261fa4b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1506 microversion: 2.1 time: 0.332972 Oct 04 18:18:18.642127 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3481/4817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:18.647545 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 HTTP/1.1 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '69c262ea-b902-4d9f-8138-a12f645e0112'} Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:18.649112 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.653141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:18.663383 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-092225e8-e055-4547-b5ac-aa70d406b373 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 404 len: 111 microversion: 2.1 time: 0.088236 Oct 04 18:18:18.664368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1337/4818] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:18 2022] DELETE /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:18.676074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.676692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: 69c262ea-b902-4d9f-8138-a12f645e0112] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.697815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.698329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.698775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.699527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.699985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.700415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.733821 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 HTTP/1.1 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '69c262ea-b902-4d9f-8138-a12f645e0112'} Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:18.735779 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. Oct 04 18:18:18.739299 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:18.741117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance 69c262ea-b902-4d9f-8138-a12f645e0112 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:18.742189 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1f2743e9-3427-4adb-8b92-612395cbc1ba tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112" status: 404 len: 111 microversion: 2.1 time: 0.072685 Oct 04 18:18:18.743272 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3482/4819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/69c262ea-b902-4d9f-8138-a12f645e0112 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:19.078688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:19.079501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:19.087647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.089524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.093031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.093859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.104373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.104962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.403914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:19.415383 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db1456cf-835e-4ea3-9cc0-e17b52e790db tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 0.342887 Oct 04 18:18:19.417207 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1338/4820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:19 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:20.445732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:20.447194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:20.462455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.465443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.466672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.468811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.471462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.472151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.670746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed2aa6b-6f93-46fa-8318-f3679f32ed4e", "tag": "210438d4-e8de-4213-a98a-c1be8e092f4d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:20.705894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:20.708675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.710405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.713891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.747150 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] Creating event network-changed:210438d4-e8de-4213-a98a-c1be8e092f4d for instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e on n-h1-831193-17 Oct 04 18:18:20.762724 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-53f93528-2a46-423d-9e87-5d1f76aeeced req-54e33f8a-27df-439d-b9cf-68993d44f729 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095366 Oct 04 18:18:20.763382 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1339/4821] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:21.438047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:21.448700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-417453c3-4dab-468e-b204-8a4b1f3b8144 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 1.005848 Oct 04 18:18:21.467449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3483/4822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:20 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:22.475709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.477017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:22.485832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:22.497557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.499408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.499408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.499808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.500437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.501027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.562015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.580957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-235c3971-9188-4f11-9feb-9cc432ab1e08 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 1.109700 Oct 04 18:18:23.581886 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1340/4823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:24.606171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:24.607555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:24.634547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.635656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.641805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.644245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.644752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.645464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.311335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.311829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.327245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.327755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.329546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.331412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.333451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.334936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.355176 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c HTTP/1.1 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c'} Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:25.359830 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.367497 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.370868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:25.372282 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8532a216-37dd-4c68-b2d0-0472fbc26ff5 tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 404 len: 111 microversion: 2.1 time: 0.065995 Oct 04 18:18:25.375010 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1341/4824] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:25 2022] DELETE /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:25.386711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.389949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] [instance: f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.426858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.429911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.432144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.434800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.435633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.436483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.497229 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] HTTP exception thrown: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Request method failure captured: Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c HTTP/1.1 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHdPWYh_myG3w88fKMUo36Zf2s7ttmK4MxS7B9UT6sFLYtyBR18PugzpHiz_TZxcZ1-IHB9hGQTWfyNUNNryhN5OVqIFIFfLshPWZ9fAXYyuawI0Gfjbu3C-qFNLMZv2Svh1CKDH0XefCxW-NwlQ3zYl-BNeBfjzwqAcVXymPxKb7qc Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d537f30be51b4aa682baf624b4b558c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d537f30be51b4aa682baf624b4b558c4 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-87476111 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 56342562970646fba44f4e59cd355761 Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeNegativeTest-87476111-project Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c'} Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.502904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.506528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] Returning 404 to user: Instance f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:25.509138 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-655b5e5c-c43c-48a7-a319-492877b126fa tempest-AttachVolumeNegativeTest-87476111 tempest-AttachVolumeNegativeTest-87476111-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c" status: 404 len: 111 microversion: 2.1 time: 0.127702 Oct 04 18:18:25.511517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.513970 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1342/4825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:25 2022] GET /compute/v2.1/servers/f0f14f49-ce7e-45c9-8e0f-177fc43f8d6c => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:25.527994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a7557c59-e765-4d22-956f-35f188ec7305 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 0.926144 Oct 04 18:18:25.532175 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3484/4826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:24 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:26.558453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.559604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.578480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.579432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.580647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.583549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.586749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.587455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.126828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.137984 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3cf3ab31-989e-459c-925c-8755fe199cbe tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 1.585117 Oct 04 18:18:28.150573 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1343/4827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:29.161385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.161908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.173463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.174102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.200434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.210081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.210601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.211059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.211812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.227518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.228152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.228887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.229446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.241603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.242171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.242629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.318098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 HTTP/1.1 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92'} Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:29.325352 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:29.330109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-000bebaf-c47b-4b4a-9661-ec9c9e35454b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 404 len: 111 microversion: 2.1 time: 0.172536 Oct 04 18:18:29.335430 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3485/4828] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:29 2022] DELETE /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:29.345428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.359533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.372001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.373616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.374434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.378457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.380110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.380826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.455529 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 HTTP/1.1 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92'} Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:29.460147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. Oct 04 18:18:29.464331 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:29.470604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:29.479536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e13c577a-cd6e-4d54-9251-c7e6febe093b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92" status: 404 len: 111 microversion: 2.1 time: 0.140427 Oct 04 18:18:29.480424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3486/4829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/86c56cce-6f8c-4ea7-9ef2-d9dc94c3fb92 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:29.502330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.503722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.539698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.541915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.542536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.546564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.547424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.549082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.639534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:29.882989 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3156620e-ac36-47d4-8853-fc005b5a67cb tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "DELETE /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 204 len: 0 microversion: 2.1 time: 0.396705 Oct 04 18:18:29.895166 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3487/4830] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:29 2022] DELETE /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:29.904485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.905204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.914749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.915424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.916429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.917334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.917808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.920349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.736991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.751976 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16aef6ae-412d-4424-aae8-df93b10ca316 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.854874 Oct 04 18:18:30.752879 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3488/4831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:30.772762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed2aa6b-6f93-46fa-8318-f3679f32ed4e", "name": "network-vif-plugged", "status": "completed", "tag": "210438d4-e8de-4213-a98a-c1be8e092f4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:30.795278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.795816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.796249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.836033 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] Creating event network-vif-plugged:210438d4-e8de-4213-a98a-c1be8e092f4d for instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e on n-h1-831193-17 Oct 04 18:18:30.851966 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0ca35b9b-d64b-4348-85ca-015a4d96bdee req-000a976f-c17a-48df-b981-189457f66b24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096731 Oct 04 18:18:30.856831 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3489/4832] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:30.862183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.874800 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ff99370-cd86-465c-a077-aade327c5e8b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 1.706028 Oct 04 18:18:30.875444 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1344/4833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:31.778506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.779430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.793527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.795478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.800291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.801385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.802020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.802611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.899348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.899967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.918302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.919979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.920448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.921180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.923684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.925894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.599840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.612673 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-764a55b2-7d47-428b-a16f-126a952bc5b9 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1512 microversion: 2.1 time: 0.839507 Oct 04 18:18:32.624923 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3490/4834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.082970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.107952 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a50a59aa-1d98-40dd-a404-a186fe018c46 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1373 microversion: 2.1 time: 1.210664 Oct 04 18:18:33.108786 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1345/4835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1373 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.228935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391a0c88-75a9-4f3b-a314-af7fbcb5fe3e", "name": "network-vif-deleted", "tag": "e6cd1033-d09a-40ed-bfa1-83813f407b3c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:33.243867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.244647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.245315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.258109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] Creating event network-vif-deleted:e6cd1033-d09a-40ed-bfa1-83813f407b3c for instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e on n-h1-831193-17 Oct 04 18:18:33.266347 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7fc0f7a7-b216-4e6d-9c84-7b5079968920 req-6dad9ba2-4c47-420f-bad2-a62cce570177 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Oct 04 18:18:33.268812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3491/4836] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:33.653965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.655770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.672285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.673334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.673938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.676717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.677803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.680453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.766862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.767889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.768522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.769877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lazy-loading 'fault' on Instance uuid 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:33.848819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af2155917fb4782857c0a1a218813cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40e31e7143c4569ab5cb1c37989b048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.883708 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a563010e-5b23-4a45-ad9e-9a75ee458a3b tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 200 len: 1307 microversion: 2.1 time: 0.235305 Oct 04 18:18:33.887939 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1346/4837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:34.137083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.137788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.182154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.183480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.193702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.198115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.198616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.199076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.920049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.921430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] [instance: 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.940486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.941289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.944086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.945054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.945784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.948064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.996876 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] HTTP exception thrown: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Request method failure captured: Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e HTTP/1.1 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHgef2s_2Yt5gzalVEwdkFM1Vn65yOUoLRREOFPfretD9bKGR6fLTrV4ybXp8WBOQkarfvvsiV0x9jbWaBBQwlH0_F8Pzm6PS800jv31_mGtT8Vr_NVT0KJwctZL7TuOpMpHGKqBm7nH1A9aj2dm51-tgf5nLCT_5WMoByHirI1FAI4 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b40e31e7143c4569ab5cb1c37989b048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b40e31e7143c4569ab5cb1c37989b048 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1437017051 Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8af2155917fb4782857c0a1a218813cd Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-1437017051-project Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '391a0c88-75a9-4f3b-a314-af7fbcb5fe3e'} Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:34.998607 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. Oct 04 18:18:35.003059 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:35.007914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] Returning 404 to user: Instance 391a0c88-75a9-4f3b-a314-af7fbcb5fe3e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:35.012648 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-494529a3-aa5a-4918-b345-44d60cd4eab5 tempest-ServersNegativeTestJSON-1437017051 tempest-ServersNegativeTestJSON-1437017051-project] 10.222.0.33 "GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e" status: 404 len: 111 microversion: 2.1 time: 0.097175 Oct 04 18:18:35.017945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1347/4838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/391a0c88-75a9-4f3b-a314-af7fbcb5fe3e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:35.044901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.062749 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3e18e87-5434-451f-84b7-1fe65a5de231 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1545 microversion: 2.1 time: 0.924186 Oct 04 18:18:35.063571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3492/4839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1545 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:35.089973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.090951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.103953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.104729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.105383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.106247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.106847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.107693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.513694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.531702 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-90de27a4-88bd-4ed2-bd6f-92e60cb779d9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1545 microversion: 2.1 time: 0.445884 Oct 04 18:18:35.532935 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1348/4840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1545 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:36.316940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41010757-9976-4cc1-8f3c-e12d8b2e8f33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: .version_select at 0x7f6340d634c0>, body: {"keypair": {"name": "tempest-keypair-2107685685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP16sG+p/HltOg0l2ZtMDAPW+CvIdZr6JmL+3gqd+1lz6M8W2rqaWoEe1og0O6CDcczBDe0kScG4F8GwQfmiMSATcuNg4Hk3pnkqIvjEtXmH+fNf1PSu11vsYDp8rJ7HQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:36.380173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-41010757-9976-4cc1-8f3c-e12d8b2e8f33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for project dce667ac90f94299aa0f3a2767614939. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:36.426501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-41010757-9976-4cc1-8f3c-e12d8b2e8f33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for user b4a7019401cf4e98a437d334a6a9de2f and project dce667ac90f94299aa0f3a2767614939. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:36.507464 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41010757-9976-4cc1-8f3c-e12d8b2e8f33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.877955 Oct 04 18:18:36.515143 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3493/4841] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 18:18:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 889 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:18:43.146700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed2aa6b-6f93-46fa-8318-f3679f32ed4e", "tag": "210438d4-e8de-4213-a98a-c1be8e092f4d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:43.180551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.182287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.187208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.212957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] Creating event network-changed:210438d4-e8de-4213-a98a-c1be8e092f4d for instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e on n-h1-831193-17 Oct 04 18:18:43.225633 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3e56ee12-b88d-450e-aea6-023e206cf9e0 req-691ddfd0-ef5d-4809-ac0e-05d2c1e07f40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.419730 Oct 04 18:18:43.227934 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1349/4842] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:45.722682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:45.727768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1910142338", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af8030e-2c85-45c4-a4fe-f17edfb54b65"}], "security_groups": [{"name": "tempest-securitygroup--1519730487"}], "key_name": "tempest-keypair-2107685685", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:45.781362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:46.194544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] validate_networks() for [('2af8030e-2c85-45c4-a4fe-f17edfb54b65', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:46.449538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:48.616860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:48.617440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:48.617931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:48.618347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:48.618798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:48.642644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.644573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.644989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.646022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.646493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.646931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.716077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for project dce667ac90f94299aa0f3a2767614939. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:48.729180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for user b4a7019401cf4e98a437d334a6a9de2f and project dce667ac90f94299aa0f3a2767614939. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:48.792840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:48.801036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:49.057166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cabfa8c3-79c5-4da1-b4c5-f879f0f94446 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.333656 Oct 04 18:18:49.060325 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3494/4843] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:18:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3340 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:18:49.077532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.079057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.081411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=34 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:49.284530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.309926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.328404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.330361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c408b7de-7559-4821-beb9-fc6feb4bed9f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1282 microversion: 2.20 time: 0.260494 Oct 04 18:18:49.333777 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1350/4844] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:50.363491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.364128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.694278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.715342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.727192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.732360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5a105b5e-d919-4703-8632-abe40bb40e05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1282 microversion: 2.20 time: 0.373242 Oct 04 18:18:50.734710 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3495/4845] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1282 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:51.759478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.760245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.775660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.777753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.778288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.779209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.781287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.782369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.837069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=63 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:52.427094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.441616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.443690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.445065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-48e0adc7-4b16-49e5-806e-333478573a65 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1334 microversion: 2.20 time: 0.690750 Oct 04 18:18:52.448090 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1351/4846] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1334 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:53.099768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63a7a325-32dc-43a7-8529-175e26df237d tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Action: 'create', calling method: .version_select at 0x7f6340b81430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2119381124", "metadata": {"Type": "work"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63a7a325-32dc-43a7-8529-175e26df237d tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 122 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2119381124", "metadata": {"Type": "work"}}} Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2119381124', 'metadata': {'Type': 'work'}}}} Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:18:53.105857 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:18:53.110809 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.119177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63a7a325-32dc-43a7-8529-175e26df237d tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.121332 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63a7a325-32dc-43a7-8529-175e26df237d tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.605588 Oct 04 18:18:53.133676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6e8924f-0d5f-4503-b764-a0fb0d94e245 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Action: 'create', calling method: .version_select at 0x7f6340eff9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1364316957", "metadata": {"Type": "work"}}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6e8924f-0d5f-4503-b764-a0fb0d94e245 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 120 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1364316957", "metadata": {"Type": "work"}}} Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1364316957', 'metadata': {'Type': 'work'}}}} Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi '0' Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:18:53.139912 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:18:53.144811 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.148111 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3496/4847] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 18:18:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 613 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:53.150416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6e8924f-0d5f-4503-b764-a0fb0d94e245 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.151890 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6e8924f-0d5f-4503-b764-a0fb0d94e245 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022818 Oct 04 18:18:53.156457 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1352/4848] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 18:18:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:53.167599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c378f421-8313-41bd-8131-944983cb98a2 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Action: 'create', calling method: .version_select at 0x7f6340c18a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-482259397", "metadata": {"Type": "work"}}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c378f421-8313-41bd-8131-944983cb98a2 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 118 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-482259397", "metadata": {"Type": "work"}}} Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-482259397', 'metadata': {'Type': 'work'}}}} Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:18:53.176477 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.180482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c378f421-8313-41bd-8131-944983cb98a2 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.183770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c378f421-8313-41bd-8131-944983cb98a2 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019132 Oct 04 18:18:53.195724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce781d16-6d31-488e-8d30-6d606b676555 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Calling method '.version_select at 0x7f6340eb5dc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.208847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3497/4849] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 18:18:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:53.264669 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ce781d16-6d31-488e-8d30-6d606b676555 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] HTTP exception thrown: Volume tempest-invalid-1711215148 could not be found. Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce781d16-6d31-488e-8d30-6d606b676555 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1711215148 HTTP/1.1 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: exception: Volume tempest-invalid-1711215148 could not be found. Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'tempest-invalid-1711215148'} Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1711215148 could not be found. (HTTP 404) (Request-ID: req-1e61bdc0-efaf-4c06-8881-7b54c37359af) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:18:53.268142 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1711215148 could not be found. Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1711215148 could not be found. Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1711215148 could not be found. Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce781d16-6d31-488e-8d30-6d606b676555 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 404 to user: Volume tempest-invalid-1711215148 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.274125 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce781d16-6d31-488e-8d30-6d606b676555 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1711215148" status: 404 len: 99 microversion: 2.1 time: 0.082032 Oct 04 18:18:53.281068 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1353/4850] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:18:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1711215148 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:53.286109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7683afad-2004-4dc2-9ce4-2f2f878e244d tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005228 Oct 04 18:18:53.291798 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3498/4851] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 18:18:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:18:53.301393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-93b2a608-0fb4-42f2-aa56-ea9587489cf6 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008073 Oct 04 18:18:53.301875 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1354/4852] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:18:53.327315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee64034a-1c43-4e4f-8a89-06d9dcc26e90 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Calling method '.version_select at 0x7f6340c20310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.380607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-ee64034a-1c43-4e4f-8a89-06d9dcc26e90 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] HTTP exception thrown: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee64034a-1c43-4e4f-8a89-06d9dcc26e90 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/os-volumes/2089f7c9-cb85-48a6-9074-37179db7fee2 HTTP/1.1 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: method: Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: exception: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2089f7c9-cb85-48a6-9074-37179db7fee2'} Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. (HTTP 404) (Request-ID: req-d196a3ed-2c68-443d-80ee-800b9ce12c46) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:18:53.382688 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee64034a-1c43-4e4f-8a89-06d9dcc26e90 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 404 to user: Volume 2089f7c9-cb85-48a6-9074-37179db7fee2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.386383 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee64034a-1c43-4e4f-8a89-06d9dcc26e90 tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2089f7c9-cb85-48a6-9074-37179db7fee2" status: 404 len: 109 microversion: 2.1 time: 0.073168 Oct 04 18:18:53.394145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a312296-7dd7-4505-8d1a-a79f7f7334ff tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Calling method '.version_select at 0x7f6340effc10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.398091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3499/4853] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 18:18:53 2022] DELETE /compute/v2.1/os-volumes/2089f7c9-cb85-48a6-9074-37179db7fee2 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:53.440573 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3a312296-7dd7-4505-8d1a-a79f7f7334ff tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] HTTP exception thrown: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a312296-7dd7-4505-8d1a-a79f7f7334ff tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Request method failure captured: Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/os-volumes/1029cf35-62a2-4f5f-af61-acc225d70a6c HTTP/1.1 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHkM0XGw0dUwoEDxoE3T-fMZYW5gGFXMh6tmIR4dW8fPf3vFvwhA8S_dpSRXFcgmQblDtolWH76DKMgcXuvHQIdGR0zvbP26hfbq7aRaRKMuGWOJrBbcAgVXbPSjwGFmci0fvl1yPg-u0FJ654VRkzXuypA5mtV8d8fqVrEgaQWfwEg Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1fdf97775ece42dfa7b6677c1962f38f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 1fdf97775ece42dfa7b6677c1962f38f Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesNegativeTest-1539969522 Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 951e7e99d1dd47e0800939cf18ba63aa Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesNegativeTest-1539969522-project Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: method: Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: exception: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '1029cf35-62a2-4f5f-af61-acc225d70a6c'} Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. (HTTP 404) (Request-ID: req-ca2d6bb6-a257-4d53-a61e-353e83fa5d13) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:18:53.443387 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. Oct 04 18:18:53.447141 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:18:53.457673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a312296-7dd7-4505-8d1a-a79f7f7334ff tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] Returning 404 to user: Volume 1029cf35-62a2-4f5f-af61-acc225d70a6c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:53.458971 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a312296-7dd7-4505-8d1a-a79f7f7334ff tempest-VolumesNegativeTest-1539969522 tempest-VolumesNegativeTest-1539969522-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1029cf35-62a2-4f5f-af61-acc225d70a6c" status: 404 len: 109 microversion: 2.1 time: 0.068857 Oct 04 18:18:53.463930 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1355/4854] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/os-volumes/1029cf35-62a2-4f5f-af61-acc225d70a6c => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:53.481537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.485533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.503406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.504403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.506984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.510855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.511625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.512648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.831604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.853380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.863074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.881910 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db3ce1e4-b61a-480f-80b2-a0f469f627af tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1340 microversion: 2.20 time: 0.402272 Oct 04 18:18:53.910792 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3500/4855] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1340 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:54.950204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.952201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.982464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.983968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.986091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.991217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.992064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.993523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.666518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.684818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.686286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.688293 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db52f5df-d98f-4eae-bc75-c796bfff0f90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.746518 Oct 04 18:18:55.689163 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1356/4856] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:56.564063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:56.590235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.595408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.596843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.648299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] Creating event network-changed:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:18:56.669127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-68b2d954-134b-4a6c-a5f6-5656848dce1b req-e7521a5d-462c-40d5-a6b7-513153b63720 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109510 Oct 04 18:18:56.670056 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3501/4857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:56.718293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.718931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.760850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.761199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.761729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.762359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.777147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.777991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.219163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.232741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.237083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.242906 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d61c203-aca5-49ad-8c8a-4da3b016e600 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.528155 Oct 04 18:18:57.244854 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1357/4858] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:58.281282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.282295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.306997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.312323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.313837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.314616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.318703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.319473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.688100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:58.968699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:58.972637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.987391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.990137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.991156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.992112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.992842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.993647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.058872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.064269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-00a65fe1-b35c-4572-adf7-a0c6573cc00c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e/action" status: 200 len: 24553 microversion: 2.1 time: 0.099120 Oct 04 18:18:59.064937 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1358/4859] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:58 2022] POST /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e/action => generated 24553 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:59.069459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.075217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.076512 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79c2ea9c-3779-4cab-af8f-755865aa6149 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.808605 Oct 04 18:18:59.095687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3502/4860] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:00.112291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.120515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:00.128925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:00.157950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.161370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.167968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.168983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.173302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.174012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.429641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.443361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.445882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.449675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7560848f-df04-4992-a704-18b2387acdad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.341892 Oct 04 18:19:00.454255 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1359/4861] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:01.481245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.482070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:01.485481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:01.501366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.503520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.504238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.507185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.511122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.513418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.166436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.180966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.184139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.185816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8894beb1-9e3d-4209-b854-cfce43d431a0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.709198 Oct 04 18:19:02.186851 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3503/4862] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:01 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:03.077204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-plugged", "status": "completed", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:03.103680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.111319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.111901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.135659 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] Creating event network-vif-plugged:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:19:03.147224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6fc954c7-1cd7-4657-b348-7cffc3a6a993 req-a5726262-63c6-4525-ad64-80b8808899d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074861 Oct 04 18:19:03.151394 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1360/4863] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:03.217035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.219144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.235398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.235912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.238391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.239467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.245665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.246202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.640206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.659112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.669397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.670495 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-180d3913-bbae-4ea8-9be6-4c87bd8b35fd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1408 microversion: 2.20 time: 0.458948 Oct 04 18:19:03.678400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3504/4864] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:04.705339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.706041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:04.718734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.721532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.722809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.723757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.724223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.727596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.941664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.952488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.955682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.957710 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-088a9c91-22a9-4647-8461-af630776666b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1599 microversion: 2.20 time: 0.258903 Oct 04 18:19:04.960017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1361/4865] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1599 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:04.992225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.992727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.011310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.011916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.012604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.013581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.014251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.014963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.216967 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14008361-6291-4183-8ed5-6cb38c14000c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.228920 Oct 04 18:19:05.226800 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3505/4866] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:07.676677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:07.720322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.724975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.725583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.762048 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] Creating event network-changed:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:19:07.780698 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ca29ce30-d2e4-4d70-b8f8-3a6d8bff8651 req-e61592fd-5a2e-493a-a865-0ead282dafb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107915 Oct 04 18:19:07.790195 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1362/4867] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:13.841242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f3f76c92-bf17-4207-9091-8ea81ca09d0e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: .version_select at 0x7f6340d63280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1283781364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01k1DoyM+qPX7D4JJFriZW1nOKUYhJbExiZ/ezu7C2OaoJzB0Vf+I617lu+oAjFXbqS0LRraACf3jBTBYYUvnZ1k2BHeSrwn2RpcpG3n/J8beX3OkTBxq8vOFrVUdR7Q=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:13.870405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3f76c92-bf17-4207-9091-8ea81ca09d0e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:13.902022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f3f76c92-bf17-4207-9091-8ea81ca09d0e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:13.966127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f3f76c92-bf17-4207-9091-8ea81ca09d0e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.130104 Oct 04 18:19:13.975022 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3506/4868] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:19:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:17.545862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-332485016", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "8ba53706-c3c3-438c-a1f2-4e6af368b72f"}], "key_name": "tempest-TestNetworkBasicOps-1283781364", "security_groups": [{"name": "tempest-secgroup-smoke-1469387596"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:17.761771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=37 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:17.767809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] validate_networks() for [('8ba53706-c3c3-438c-a1f2-4e6af368b72f', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:18.403747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:18.404172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:18.404643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:18.405053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:18.405462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:18.420321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.420804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.421243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.433155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.434864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.435344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.468474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:18.486939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:18.526279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:18.535934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:18.663776 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78370b00-f533-46c6-aa5e-17f05d465b99 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.122935 Oct 04 18:19:18.667157 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1363/4869] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:18.674854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=32 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:18.680495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b05219af-a229-4a09-a35c-bba5ecddacb1 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:18.681678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b05219af-a229-4a09-a35c-bba5ecddacb1 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:18.693872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:18.952631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b05219af-a229-4a09-a35c-bba5ecddacb1 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.966861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b05219af-a229-4a09-a35c-bba5ecddacb1 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1248 microversion: 2.1 time: 0.293738 Oct 04 18:19:18.985889 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3507/4870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:18 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1248 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:19.994640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.995951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.011467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:20.016728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.020037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.021801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.023203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.024979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.026928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.289710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.326240 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a7f41c1-ad66-4677-b41c-79f475a0b05c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1252 microversion: 2.1 time: 0.332760 Oct 04 18:19:20.329875 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1364/4871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1252 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:21.357164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.358639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.379697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.380341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.380884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.381927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.384590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.385129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.701444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:21.720721 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7069fb4a-00b5-49b5-b1d5-55e590675aca tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1306 microversion: 2.1 time: 0.367955 Oct 04 18:19:21.723855 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3508/4872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1306 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:22.750142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.750759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.760620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.761114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.761555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.762266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.762725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.766431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.064584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:23.073089 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e828a1c-34a2-4bda-b310-b5173e36e5b2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 0.327181 Oct 04 18:19:23.073690 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1365/4873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.097458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.098890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.115248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.115998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.118729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.119741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.120212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.124589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.938078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.953765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-458cf403-9425-42fb-b47e-3f7b7bd32ff5 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 0.860582 Oct 04 18:19:24.957737 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3509/4874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:25.557265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc7a976-a7d5-4571-8de6-a5303277ffa9", "tag": "bf2cb078-8aee-403c-aff2-272313c74ed8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:25.587688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.588380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.589385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.639679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] Creating event network-changed:bf2cb078-8aee-403c-aff2-272313c74ed8 for instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 on n-h1-831193-17 Oct 04 18:19:25.676299 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c1a041c2-8531-49fa-bff5-97052cdcc7cf req-9e897689-81d5-4c78-a6c4-309822407694 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.566659 Oct 04 18:19:25.699700 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1366/4875] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:25.984995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.986191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.993132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.998360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.999823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.000814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.004037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.004702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.100716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.110028 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb2377ef-c8c9-4183-997a-1efd9d1564e7 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 1.129323 Oct 04 18:19:27.140069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3510/4876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:28.153148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.153856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.171856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.177617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.177617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.177970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.178456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.178891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.455725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:28.511973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:28.519693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.529402 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6c846e62-84c8-4874-ab84-1306ef0caf2d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 0.381377 Oct 04 18:19:28.534236 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1367/4877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.575582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.576968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.584382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:29.596616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.599812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.600488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.606209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.606891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.607382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.278388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:30.288580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-619736c1-448e-41d5-aaa0-d93d64845ee2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 0.719710 Oct 04 18:19:30.290734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3511/4878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.747445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc7a976-a7d5-4571-8de6-a5303277ffa9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2cb078-8aee-403c-aff2-272313c74ed8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:30.765273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.766032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.766828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.783849 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] Creating event network-vif-plugged:bf2cb078-8aee-403c-aff2-272313c74ed8 for instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 on n-h1-831193-17 Oct 04 18:19:30.791123 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-bf354705-635f-4d0b-9600-13c6ba612972 req-be6b553b-48f9-46fc-89c9-39fb5a6b2ee2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048380 Oct 04 18:19:30.792032 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1368/4879] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:31.315262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.316280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.332322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.334084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.336046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.337661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.340546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.341225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.650069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.665079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-955ae895-ac40-4d48-8b14-13ebb03a7713 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1374 microversion: 2.1 time: 0.354828 Oct 04 18:19:31.666160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3512/4880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1374 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.690489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.691269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.698296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.698794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.699262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.699971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.700425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.700853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.989583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.016543 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-99936aad-00b0-4607-ba9d-a02960deb757 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1546 microversion: 2.1 time: 0.330898 Oct 04 18:19:33.027239 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1369/4881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1546 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:33.042433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.043114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.052385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.053282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.053365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.054014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.054473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.054902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.362904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.378035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73f87b34-2761-4426-b758-2f13a0c2eff8 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1546 microversion: 2.1 time: 0.339672 Oct 04 18:19:33.378628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3513/4882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:41.068076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.068564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:41.077859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.089952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.091161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.093624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.094493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.095444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.129827 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-93414998-acab-4a80-afc9-301f6cfd068f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/ips" status: 200 len: 151 microversion: 2.20 time: 0.065841 Oct 04 18:19:41.131086 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1370/4883] 10.222.0.33 () {60 vars in 1289 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/ips => generated 151 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:44.769177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:44.769728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.791142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:44.791949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:44.793793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.799546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.800710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.801487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.802168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.803222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.840497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lazy-loading 'flavor' on Instance uuid c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:45.238401 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ec9f7d2-9461-4a64-a5a0-025100d62e0b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/action" status: 202 len: 0 microversion: 2.20 time: 0.473137 Oct 04 18:19:45.240131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3514/4884] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:19:44 2022] POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:19:45.249235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.250539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.283686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.285572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.288604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.291573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.292324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.292985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.733250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.751798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.763188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.766870 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f41d877b-a8b1-4315-9e37-d069a7e8ebfb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.522342 Oct 04 18:19:45.780120 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1371/4885] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:46.810672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.812517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.836495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.837662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.838463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.840340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.841144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.843684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.204735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.213603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.227592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.229113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6478df98-80eb-4415-a98c-e2b2801f1aba tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.422866 Oct 04 18:19:47.229613 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3515/4886] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:48.258332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.259257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.317459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.319632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.320801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.324336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.326561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.327584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.331671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=41 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:48.712906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.725154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.735311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.736783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0663fdfe-86d6-43cd-8806-14b3175f3037 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.483600 Oct 04 18:19:48.737355 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1372/4887] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:49.765214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.766453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.778261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.786302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.790364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.791821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.800606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.801116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.256662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.270074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.284430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.288277 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d51c4ff6-8d58-4857-9303-e2fcc540e75e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.527191 Oct 04 18:19:50.291122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3516/4888] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:51.325821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.327573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:51.335668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=18 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:51.347826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.350634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.354837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.356754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.357421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.359726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.000816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.015769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.020938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.023768 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-66a79635-1808-449d-bc1e-2f654cfb9976 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.708197 Oct 04 18:19:52.027906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1373/4889] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:51 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:53.058344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.067058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.089909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.090836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.092004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.093145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.093928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.094588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.466297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.481768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.502250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.510098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1515f5dc-9a11-49b6-95ee-aef7fa530b98 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.455618 Oct 04 18:19:53.531891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3517/4890] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:54.542181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.544905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.572566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.573799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.575010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.576575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.591403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.592317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.881103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.892424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.907320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.914907 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c16059e5-81e3-4492-9d7d-f229f560b28c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 1.378678 Oct 04 18:19:55.917169 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1374/4891] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:56.950642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.953280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:56.971083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.974338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.976664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.979750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.981591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.982252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.043181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.067939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.074965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.080198 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-639b6e29-88c0-4dd2-95da-cf673f6dd062 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1745 microversion: 2.20 time: 1.136780 Oct 04 18:19:58.085991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3518/4892] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1745 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:59.115511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.116160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.132157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.134280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.134740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.135517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.140829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.141343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.754290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.761785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.762484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.763136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.766631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.768110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.769605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.849696 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-860c29c0-cd7f-4905-a96d-3104e796b722 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.886913 Oct 04 18:19:59.851979 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1375/4893] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:00.373528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.382352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.383898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.385126 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bea994c8-acef-4e8b-9de7-651303256399 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 1.273686 Oct 04 18:20:00.438686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3519/4894] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:00.444210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-72015271", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "availability_zone": "nova:n-h2-831193-17", "networks": [{"uuid": "afaa18d7-82aa-4bdf-849c-93b3da8d2f1f"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:01.121057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-plugged", "status": "completed", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:01.140552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.141568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.142219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.196518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] Creating event network-vif-plugged:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:20:01.210157 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6f5b89b0-58c2-44c6-a182-89c91ca9c38a req-9959d84c-7f57-457d-88e8-6ce41bb3c8a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.639864 Oct 04 18:20:01.215983 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3520/4895] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:01.416475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.417306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.443416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.449929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.452128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.453023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.453403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.460498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.179824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.202280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.206047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.212329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5be5a09e-e7d3-42c8-8e3c-1d70c21c0912 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.793892 Oct 04 18:20:02.227074 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3521/4896] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:02.342738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:02.343459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:02.357772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.358441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.359888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.362337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.366083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.366654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.367197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] validate_networks() for [('afaa18d7-82aa-4bdf-849c-93b3da8d2f1f', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:02.534070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:02.838917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dff73210-ba1c-44ab-a27a-9d3c9b428583 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 204 len: 0 microversion: 2.1 time: 0.500891 Oct 04 18:20:02.844648 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3522/4897] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:02 2022] DELETE /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:02.850573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:02.851680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:02.862211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.862362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.863173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.864067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.864685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.865302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.698515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.719709 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2edcdf00-1245-498a-ac5c-7fe37ca6633c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1552 microversion: 2.1 time: 1.873462 Oct 04 18:20:04.735248 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3523/4898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:02 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1552 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:04.751703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.753568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:04.772457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.779254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.781125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.785795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.787014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.790483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.464364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:05.466006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:05.466813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:05.467413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:05.468904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:05.492462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.493919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.494745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.496250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.496935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.497703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.532280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Getting quotas for project 1d553b249d844d55ba8784d0c19f8a55. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:05.548302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Getting quotas for user 0a4adcd742ac4dfbad0501bebd5eaf2a and project 1d553b249d844d55ba8784d0c19f8a55. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:05.571776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:05.575066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:05.584071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.593215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.594705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.609337 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-53762fe4-1efe-4228-902f-420667e4c618 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.878663 Oct 04 18:20:05.609963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3524/4899] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:04 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:05.709905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b573a746-8fb8-4817-a347-fc08a99ea717 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.274970 Oct 04 18:20:05.721607 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1376/4900] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:05.726600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3593ae08-b9c0-4605-8954-6388777abd5e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.727483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3593ae08-b9c0-4605-8954-6388777abd5e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.751143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.752156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.759191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.760057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.760712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.762347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.763060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.763706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.945658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3593ae08-b9c0-4605-8954-6388777abd5e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1327 microversion: 2.1 time: 0.222917 Oct 04 18:20:05.955466 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3525/4901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.221757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.234695 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0e4fe29-dec5-4410-a8a2-1c027e8fb8bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1552 microversion: 2.1 time: 0.488647 Oct 04 18:20:06.235337 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1377/4902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1552 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:06.640255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.640908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.663476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.663981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.664485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.665216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.665684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.666127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.974539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b3ec088-f81e-40bd-b6ca-106f957d38e7 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.976504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b3ec088-f81e-40bd-b6ca-106f957d38e7 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:07.228050 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b3ec088-f81e-40bd-b6ca-106f957d38e7 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1327 microversion: 2.1 time: 0.257893 Oct 04 18:20:07.232624 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1378/4903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1327 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:07.254358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.266633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.267289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:07.278304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.284852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.285051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.285560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.286013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.286776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.287253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.287695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.289340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e83528f-526e-4a29-ab6d-aa7c322eee77 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.653032 Oct 04 18:20:07.301557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3526/4904] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:07.587816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.597331 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-393d97db-68c4-4c8b-9e5f-874be5bcc43b tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1552 microversion: 2.1 time: 0.336442 Oct 04 18:20:07.602088 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1379/4905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:07 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1552 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:08.320421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.324899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.325507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.332252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.344933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.345442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.345894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.346621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.362723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.363400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.365479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.369921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.372719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.376088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.382492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.384744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.167275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc4ccb33-b18b-4785-ab85-b4b48e2bde86 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1416 microversion: 2.1 time: 0.909362 Oct 04 18:20:09.169044 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3527/4906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1416 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.181585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.182712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:09.213335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.218308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.226231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.228983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.242415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.242909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.324688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:09.391406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.393197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.397869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.400753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lazy-loading 'fault' on Instance uuid ffc7a976-a7d5-4571-8de6-a5303277ffa9 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:09.544136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.552965 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29c3ddef-1a50-413b-97a7-9c848d078da4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 200 len: 1338 microversion: 2.1 time: 0.379014 Oct 04 18:20:09.561490 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3528/4907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 1338 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.596258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc7a976-a7d5-4571-8de6-a5303277ffa9", "name": "network-vif-deleted", "tag": "bf2cb078-8aee-403c-aff2-272313c74ed8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:09.634565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.650564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.651193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.704846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] Creating event network-vif-deleted:bf2cb078-8aee-403c-aff2-272313c74ed8 for instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 on n-h1-831193-17 Oct 04 18:20:09.726439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fc2518e1-df29-41c3-b471-d6bf4d2df6db req-36f4e55f-91c2-47d5-9851-e80342d562f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153596 Oct 04 18:20:09.727134 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3529/4908] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:09.775377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.785334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.786816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.798406 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d873de72-4eb5-4cdf-b6e7-f8c5c983cbe5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 1.477655 Oct 04 18:20:09.802175 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1380/4909] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:10.194601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.195864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.223401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.224610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.225294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.226434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.228109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.239436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.457747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce7710f0-660d-48d1-b9e1-b143a7cbf9ae tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1422 microversion: 2.1 time: 0.268769 Oct 04 18:20:10.462502 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3530/4910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1422 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:10.581931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.582726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: ffc7a976-a7d5-4571-8de6-a5303277ffa9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.608205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.619784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.620311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.625783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.628975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.630059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.676000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] HTTP exception thrown: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Request method failure captured: Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 HTTP/1.1 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHjJy2SMVQwTheFcuMlaWH9--Xtt34gzT7j0k_wp6e4l4cyZp_-aiWqRI0xjFiVVS8APW3ywafYaOdzlXJn1IqKfe3FvQ6VrDcrkPpEWPF2c1RNXt-tTZZm5ftW6LEE6GXtMA5P0DpxA0Rqyk_TOsdK1mn6l1kO_rucCU4XTBLSI1V8 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8d213042530f4833b3e14427537c647f Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'ffc7a976-a7d5-4571-8de6-a5303277ffa9'} Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:10.681369 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Returning 404 to user: Instance ffc7a976-a7d5-4571-8de6-a5303277ffa9 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:10.685568 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7f31873-d43e-451e-b4d7-291cc0734c0a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9" status: 404 len: 111 microversion: 2.1 time: 0.109807 Oct 04 18:20:10.697427 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1381/4911] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/ffc7a976-a7d5-4571-8de6-a5303277ffa9 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:10.830383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.831246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.841743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.843949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.848267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.849247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.849741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.850179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.267990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.282967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.285036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.289098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1016370b-f938-4db7-9a3b-2c4791c9e2d2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.463443 Oct 04 18:20:11.321865 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3531/4912] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:11.490088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.490723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.507459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.508000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.508451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.509194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.509653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.510088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.778645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01b82816-8994-49d8-a9e9-9c8f00d3f870 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '.version_select at 0x7f6340c02f70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.838736 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01b82816-8994-49d8-a9e9-9c8f00d3f870 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1283781364" status: 202 len: 0 microversion: 2.1 time: 0.064732 Oct 04 18:20:11.848970 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3532/4913] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 18:20:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1283781364 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:12.323585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.324446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.357215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.357762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.358214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.358954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.359447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.359882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.995668 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03db6c85-5cd5-43ab-bc6d-7f2fed56bbfe tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 1.509662 Oct 04 18:20:13.011562 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1382/4914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:13.494977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.512502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.515250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.525961 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f39cf1d-8824-4a37-9439-b4fd8141431b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 1.206908 Oct 04 18:20:13.528814 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3533/4915] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:14.025077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.025798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.044751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.046359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.048653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.066168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.066793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.067139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.555811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.556571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.577781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.580350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.580350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.580350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.580350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.580881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.136282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.152999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.160300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.161922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cef16b4d-e6b0-4180-a6f1-1644b64588ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.610155 Oct 04 18:20:15.162830 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3534/4916] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:15.514148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:15.682048 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ac744e9b-be3e-4e0d-8716-2aba27b58cce tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 1.661619 Oct 04 18:20:15.686845 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1383/4917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:16.188836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.190068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.193890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.194571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.224389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.224915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.225359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.226093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.226551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.227134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.714727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.715407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.730658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.731178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.731627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.732350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.732808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.733253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.227354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:17.667190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c46759a2-577f-4fa7-b0b2-1c86c3e72e2c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.959249 Oct 04 18:20:17.671744 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1384/4918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:17.687457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.689831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.721733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.722313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.722693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.727406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.727915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.728366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.870921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:18.162769 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b0e49cdd-e881-4819-b641-f83a14bb06c9 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 204 len: 0 microversion: 2.1 time: 0.489507 Oct 04 18:20:18.169210 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1385/4919] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:17 2022] DELETE /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:18.203231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed2aa6b-6f93-46fa-8318-f3679f32ed4e", "tag": "210438d4-e8de-4213-a98a-c1be8e092f4d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:18.239451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.239932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.245354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.341294 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] Creating event network-changed:210438d4-e8de-4213-a98a-c1be8e092f4d for instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e on n-h1-831193-17 Oct 04 18:20:18.356566 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4921850d-3eb3-4230-b679-704a0f23deef req-9af83623-258f-4b37-95f5-a3641753ef80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185208 Oct 04 18:20:18.361565 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1386/4920] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:18.423834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.427860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:18.446541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.447321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.450484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.452401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.453668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.454168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.456249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.464685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:18.468590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.479069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.483271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fbe2d7c1-291c-4538-ac05-921953c88ce1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 2.297088 Oct 04 18:20:18.513263 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3535/4921] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:18.524926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457d802f-d100-4519-836b-a9bc114d804f", "tag": "be642809-a79e-486b-881e-3408cdb17d03"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:18.631428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.631948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.632399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.677528 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] Creating event network-changed:be642809-a79e-486b-881e-3408cdb17d03 for instance 457d802f-d100-4519-836b-a9bc114d804f on n-h2-831193-17 Oct 04 18:20:18.688094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7b59d76a-7ff9-4cfb-bee1-808f8e91b9e2 req-c9de54e7-2d12-4267-b442-081b1ffdb023 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173456 Oct 04 18:20:18.689994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3536/4922] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:18.713810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.714524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:18.752051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.752560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.753007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.753732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.755712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.756215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.154003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.168512 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b512aa6-a045-4abf-8a57-012699de99f4 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1670 microversion: 2.1 time: 0.801609 Oct 04 18:20:19.172049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1387/4923] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1670 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.416685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c526424-2faa-4ecd-81be-15afedab628b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.718923 Oct 04 18:20:19.428214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3537/4924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.520751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.521511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.546766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.550776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.551443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.553112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.558643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.559128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.977827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.978847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.988991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.993170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.999790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.000833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.001485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.002122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.031811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.041856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.050224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.060568 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1ceebed-b59d-4fc1-85a2-310d9c952aa5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.543688 Oct 04 18:20:20.061315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1388/4925] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:20.196769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.197433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:20.215784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.216304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.216757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.217485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.217950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.218391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.288195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lazy-loading 'services' on Instance uuid 875d66e5-1d55-4932-a479-03d41799c7a2 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:20.462339 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51233b71-0eb0-45be-8447-ff1511ff7ec8 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "DELETE /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2/os-volume_attachments/70963f07-e1ca-4c35-9f42-a1044966aa49" status: 202 len: 0 microversion: 2.1 time: 0.487829 Oct 04 18:20:20.464116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3538/4926] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:20:19 2022] DELETE /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2/os-volume_attachments/70963f07-e1ca-4c35-9f42-a1044966aa49 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:20:20.475058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.482026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:20.500158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.512666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.514431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.515894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.517486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.518715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.133568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.149898 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de4c58de-c38b-4af1-b55c-96e66e54f310 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 200 len: 1551 microversion: 2.1 time: 0.958699 Oct 04 18:20:21.160421 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1389/4927] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 1551 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:21.179069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.179742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.207648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.210486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.213282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.222796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.224969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.227623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.426414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-57e5fa77-6c57-415a-bad5-bf925078e358 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.959536 Oct 04 18:20:21.431971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3539/4928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.454225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed2aa6b-6f93-46fa-8318-f3679f32ed4e", "name": "network-vif-deleted", "tag": "210438d4-e8de-4213-a98a-c1be8e092f4d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:21.473884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.474364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.493457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.557861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] Creating event network-vif-deleted:210438d4-e8de-4213-a98a-c1be8e092f4d for instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e on n-h1-831193-17 Oct 04 18:20:21.574955 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ee642015-d4c6-4f0c-aa5c-1c67a42bede9 req-f3649f5d-4b75-4834-9807-7433f9ec2714 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139836 Oct 04 18:20:21.576172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3540/4929] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:22.130549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.151592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.154507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.163057 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e5231307-3718-4934-93ee-9d84178b602b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.999027 Oct 04 18:20:22.166004 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1390/4930] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:22.195395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.196116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.228094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.228604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.235344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.238643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.240713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.242492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.284050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] HTTP exception thrown: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Request method failure captured: Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e HTTP/1.1 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHjJy2SMVQwTheFcuMlaWH9--Xtt34gzT7j0k_wp6e4l4cyZp_-aiWqRI0xjFiVVS8APW3ywafYaOdzlXJn1IqKfe3FvQ6VrDcrkPpEWPF2c1RNXt-tTZZm5ftW6LEE6GXtMA5P0DpxA0Rqyk_TOsdK1mn6l1kO_rucCU4XTBLSI1V8 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8d213042530f4833b3e14427537c647f Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0ed2aa6b-6f93-46fa-8318-f3679f32ed4e'} Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:22.286055 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. Oct 04 18:20:22.291943 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:20:22.294337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Returning 404 to user: Instance 0ed2aa6b-6f93-46fa-8318-f3679f32ed4e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:22.298747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12540e2e-1833-431a-9e06-48de2fea92be tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e" status: 404 len: 111 microversion: 2.1 time: 0.109179 Oct 04 18:20:22.303771 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3541/4931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/0ed2aa6b-6f93-46fa-8318-f3679f32ed4e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:22.458721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.459486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.477716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:22.483977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.487660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.488372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.492383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.495413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.499741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.149618 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5dd1993c-d68d-41d9-b22b-46ba86692ee9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.696435 Oct 04 18:20:23.157059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1391/4932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.184652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3891e2e7-2e71-4273-a613-496dc6841aac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '.version_select at 0x7f6345d87700>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.196272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.197048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.217575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.220061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.221291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.222662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.225426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.226134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.263210 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3891e2e7-2e71-4273-a613-496dc6841aac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-95440069" status: 202 len: 0 microversion: 2.1 time: 0.083334 Oct 04 18:20:23.265129 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3542/4933] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-95440069 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:23.692351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.703287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.728667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.732635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ec98004-e2d6-4d0a-a242-428de1198ae8 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.541596 Oct 04 18:20:23.734246 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1392/4934] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:24.173870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.174518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.190180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.195630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.198293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.201887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.205333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.209374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.770280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.771018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.783698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.786895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.788324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.789459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.791370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.804183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.351271 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-352eb6ff-f793-4229-83b0-36acd19324e4 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 1.181140 Oct 04 18:20:25.358320 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3543/4935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.681206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.691821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.701709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.705543 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60b4e464-d27f-449c-8481-01a30c9ad88a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.944278 Oct 04 18:20:25.713431 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1393/4936] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:26.375890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.376507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.391884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.394248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.399747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.403804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.407700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.423803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.721874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42a1c265-54c6-4e0e-bd86-98e666c5552c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.349641 Oct 04 18:20:26.726198 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3544/4937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.743551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.744160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.763975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.767120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.768049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.770603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.776665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.777332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.231645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.247704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.255893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.263218 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6aa6bb7e-81d3-4f2a-88ee-ed8d126b7441 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.519515 Oct 04 18:20:27.268315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1394/4938] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:27.562890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d802f-d100-4519-836b-a9bc114d804f", "name": "network-vif-plugged", "status": "completed", "tag": "be642809-a79e-486b-881e-3408cdb17d03"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:27.596491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.599935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.603365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.627580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] Creating event network-vif-plugged:be642809-a79e-486b-881e-3408cdb17d03 for instance 457d802f-d100-4519-836b-a9bc114d804f on n-h2-831193-17 Oct 04 18:20:27.644379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cc93ae24-a1ff-41a2-ba5e-ab1aa0fa4e56 req-3fdd420c-ce48-4f7a-9640-5c3655b6c4c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085266 Oct 04 18:20:27.647615 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3545/4939] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:27.752746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.754012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.761462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.762171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.762849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.772838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.774057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.774512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.135743 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb3226cf-1f89-4b86-9d8c-f2e4d76b05ee tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1464 microversion: 2.1 time: 0.387264 Oct 04 18:20:28.138807 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1395/4940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1464 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.299986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.302922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.319781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.320586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.321196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.322251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.322906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.323519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.604510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.620239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.622164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.623626 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1dad134-413a-48db-b275-e4077cffa739 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 0.331996 Oct 04 18:20:28.644459 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3546/4941] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:29.162224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.163084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.176679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.186609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.187479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.190009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.191731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.192813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.667057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.668894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.691846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.698904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.700065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.703394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.705404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.708811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.729706 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55eaafa4-e08d-4be7-8556-a6703d26be4e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1650 microversion: 2.1 time: 1.569780 Oct 04 18:20:30.752666 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1396/4942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1650 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.794165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.794810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.817289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.827227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.828038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.830156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.830896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.831551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.932041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.949609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.952122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.958682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d38f7e9b-bc81-4cfd-a4cd-6c458b0f6680 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1740 microversion: 2.20 time: 1.305737 Oct 04 18:20:30.966890 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3547/4943] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1740 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:31.798636 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7e89575d-6390-47b6-889c-f38e6536554e tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1650 microversion: 2.1 time: 1.044439 Oct 04 18:20:31.808023 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1397/4944] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1650 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:31.823792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.824856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.838694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.839242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.839691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.845145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.845875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.846643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.930456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.931406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.938210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.939502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.940669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.941905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.942716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.943414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.976864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:32.096544 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4515194f-973e-4326-bf6a-9b3050a96d5b tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "DELETE /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 204 len: 0 microversion: 2.1 time: 0.170138 Oct 04 18:20:32.097524 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1398/4945] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:31 2022] DELETE /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:20:32.105846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.106907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.114612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.115816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.116567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.123827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.127087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.127859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.281469 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4989356b-6cb0-4f0d-8ad1-71ddc0b63a3a tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1650 microversion: 2.1 time: 0.461523 Oct 04 18:20:32.287239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3548/4946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1650 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.299869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.302197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.319174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.321496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.321952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.325942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.332038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.332479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.398789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:32.604027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.615207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-412f4d28-a82b-419d-bc7d-f35f4f39ef0d tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1469 microversion: 2.1 time: 0.321450 Oct 04 18:20:32.615805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3549/4947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.621114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1434184524", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "availability_zone": "nova:n-h1-831193-17", "networks": [{"uuid": "afaa18d7-82aa-4bdf-849c-93b3da8d2f1f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:32.717174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] validate_networks() for [('afaa18d7-82aa-4bdf-849c-93b3da8d2f1f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:33.015494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.026426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.028502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.030037 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-97392e59-83a4-4bf0-9422-6cc5a465082d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1722 microversion: 2.20 time: 0.931051 Oct 04 18:20:33.031799 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1399/4948] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1722 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:33.642469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.643133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.651736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.652852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.653539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.654485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.655219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.655867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.150091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:34.150585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:34.151562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:34.152073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:34.152645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:34.177592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.178661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.180458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.181442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.182877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.183564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.206474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.219329 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b25e61a5-6b3e-4531-a977-1d1e2eb15941 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1469 microversion: 2.1 time: 0.582000 Oct 04 18:20:34.223216 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1400/4949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:34.230819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.232692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.235307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Getting quotas for project 1d553b249d844d55ba8784d0c19f8a55. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:34.247603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Getting quotas for user 0a4adcd742ac4dfbad0501bebd5eaf2a and project 1d553b249d844d55ba8784d0c19f8a55. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:34.251537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.252037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.252579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.258519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.258519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.258519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.269581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:34.272849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:34.359303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05e57751-a687-47a3-918d-49cde2c06edb tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742049 Oct 04 18:20:34.360267 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3550/4950] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:34.377099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4be8141c-c009-4049-bedd-289098516e1d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.378854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4be8141c-c009-4049-bedd-289098516e1d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.003975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4be8141c-c009-4049-bedd-289098516e1d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1329 microversion: 2.1 time: 0.635658 Oct 04 18:20:35.004910 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3551/4951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1329 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.247026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:35.266020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.266528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.266975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.297676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] Creating event network-vif-unplugged:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:20:35.315623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ef8c28c4-580a-4936-a756-334e2255f1da req-1a71d731-ecb6-4ff6-a156-b9282061dc1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071226 Oct 04 18:20:35.316771 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3552/4952] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:35.332334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.334152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.342925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.350714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.354338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.354837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.355696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.356181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.356621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.363323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.380540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.385254 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd2e9688-8e63-4789-8b89-fd5eadcb6e01 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1722 microversion: 2.20 time: 1.160820 Oct 04 18:20:35.408672 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1401/4953] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1722 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:35.846181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.855700 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dcf1d358-9c23-42d3-8f6a-62bb5e4f6f7f tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1469 microversion: 2.1 time: 0.535503 Oct 04 18:20:35.860850 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3553/4954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.029710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.031599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.045575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.046091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.048836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.051767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.053548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.059715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.072319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:36.419517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.421347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.436638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.437157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.437606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.438376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.441592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.442056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.518737 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-481b9b54-bccb-4902-90d2-00f8d360d522 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1426 microversion: 2.1 time: 0.492695 Oct 04 18:20:36.532280 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1402/4955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1426 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.548500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875d66e5-1d55-4932-a479-03d41799c7a2", "name": "network-vif-deleted", "tag": "e3141eef-d134-4650-b70e-14e6eb2213a1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:36.584467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.585296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.589206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.629317 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] Creating event network-vif-deleted:e3141eef-d134-4650-b70e-14e6eb2213a1 for instance 875d66e5-1d55-4932-a479-03d41799c7a2 on n-h2-831193-17 Oct 04 18:20:36.644903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-369cfa55-5dc2-4b75-bc2c-8d8c208ab37a req-11880c2c-3b4d-4600-b63d-12d7bd3b5b60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099993 Oct 04 18:20:36.646198 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1403/4956] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:36.914522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.919499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.950615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.954865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.957411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.958277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.958772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.959247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.139354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.152760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.153378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.153839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.154316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lazy-loading 'fault' on Instance uuid 875d66e5-1d55-4932-a479-03d41799c7a2 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:37.161301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.168505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.174573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4574023a-0eab-451d-94d0-d000ba07d450 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1722 microversion: 2.20 time: 0.759995 Oct 04 18:20:37.175217 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3554/4957] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1722 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:37.317906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '009378bc5e6a4c88bd59d8290cc3c68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d877e4f9d44ef8ac05a47b3620c831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.327291 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe900616-3ee9-474c-a727-89b2cd4dae65 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 200 len: 1303 microversion: 2.1 time: 0.442372 Oct 04 18:20:37.328220 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1404/4958] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 1303 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.556344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.559014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.575610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.576644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.578552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.581954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.583019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.583914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.770020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1531531-4b7a-43b7-98a0-772384802c97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1424 microversion: 2.1 time: 0.225534 Oct 04 18:20:37.770607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3555/4959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1424 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.970165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Calling method '.version_select at 0x7f6340ec2ca0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.972224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.972781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.973291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.008676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.009469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.010113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.032623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.033131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.033638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.058314 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e470dde3-619e-49d0-a569-7f8b90e929b3 tempest-PortsAdminExtendedAttrsTestJSON-1682800970 tempest-PortsAdminExtendedAttrsTestJSON-1682800970-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.449621 Oct 04 18:20:38.078627 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1405/4960] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:38.209358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.209992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.226223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.227504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.228935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.229843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.230597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.231221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.356658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.357282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] [instance: 875d66e5-1d55-4932-a479-03d41799c7a2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.369202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.373899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.374635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.375622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.376366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.376946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.406503 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] HTTP exception thrown: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Request method failure captured: Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 HTTP/1.1 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHjHrq1g9ghXt5uKetSPBjt3WKfYHNC8mRd8YYjZ4ODA4CpMYUFRTFy2S0_PkjgzJl0qjZkq7oG89VtDcFqtMHePieUMq_ibfIiSBQxiBvo22BrEwQ855et3GXlUumzCj1ayexChxcCwyYGMOq8eoHKI-1LqQYlUQ3C9PLMk8GMX0iw Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 66d877e4f9d44ef8ac05a47b3620c831 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesBackupsTest-1752413828 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66d877e4f9d44ef8ac05a47b3620c831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66d877e4f9d44ef8ac05a47b3620c831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66d877e4f9d44ef8ac05a47b3620c831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66d877e4f9d44ef8ac05a47b3620c831"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesBackupsTest-1752413828 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 66d877e4f9d44ef8ac05a47b3620c831 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesBackupsTest-1752413828 Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesBackupsTest-1752413828-project Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 009378bc5e6a4c88bd59d8290cc3c68c Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesBackupsTest-1752413828-project Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '875d66e5-1d55-4932-a479-03d41799c7a2'} Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.408825 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. Oct 04 18:20:38.413456 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.416986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] Returning 404 to user: Instance 875d66e5-1d55-4932-a479-03d41799c7a2 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:38.418076 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-02a4af56-a627-47e2-b5c4-0ca0fcd85fc0 tempest-VolumesBackupsTest-1752413828 tempest-VolumesBackupsTest-1752413828-project] 10.222.0.33 "GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2" status: 404 len: 111 microversion: 2.1 time: 0.066411 Oct 04 18:20:38.419695 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1406/4961] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/875d66e5-1d55-4932-a479-03d41799c7a2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:38.710534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.723734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.728371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.730288 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df566013-a106-433e-8081-ee2dccf746c2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1665 microversion: 2.20 time: 0.530965 Oct 04 18:20:38.736213 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3556/4962] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1665 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:38.762218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4044202-81f2-44a6-8d28-c8ec33920802"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:38.770869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.782293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.783003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.786929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.788066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.788710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.789881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.798330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.799223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.817143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.817674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.824104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.825025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.825874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.834067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.422381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e8703e17-0d05-4c57-8cf5-4c4a7f32bc9f tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.620895 Oct 04 18:20:39.424170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3557/4963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.518546 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36cf8fb6-88d2-4972-8e7f-2ccdb1a9a5de tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.760123 Oct 04 18:20:39.533048 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1407/4964] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 18:20:38 2022] POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 188 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:20:39.803183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:39.806112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.823113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.825120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.825807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.826756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.827426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.828041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.910863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:20:40.075638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-858d90f5-0cc9-4f6e-a18a-fef28a324edf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/action" status: 202 len: 0 microversion: 2.20 time: 0.276837 Oct 04 18:20:40.086254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3558/4965] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:20:39 2022] POST /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:40.096614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.097392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.112709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.114848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.117782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.118787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.119673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.121777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.452640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.453273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.481487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.488806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.499426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.501371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.502311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.503904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.544414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.561501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.567158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.572750 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a0a8f9c9-7e6f-426f-9439-09af67779a19 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1751 microversion: 2.20 time: 0.482377 Oct 04 18:20:40.579293 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1408/4966] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1751 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:40.946460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b02091bc-8081-482f-a60f-e702668f2cf5 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.501082 Oct 04 18:20:40.948067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3559/4967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.602844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.603364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.617804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.618712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.619410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.622015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.622730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.623564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.949506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.964770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.968745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.970065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.971490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.972595 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe316e2b-f955-4456-863c-79327a927638 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1751 microversion: 2.20 time: 0.374256 Oct 04 18:20:41.973187 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1409/4968] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1751 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:42.002342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.003345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.003836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.004723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.010299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.021140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.394045 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-541fea30-47bc-404d-96e0-4aee4a46a196 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.427982 Oct 04 18:20:42.413019 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3560/4969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.008560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.010402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.028024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.028851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.029714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.031284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.032030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.032862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.332587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.345239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.347152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.349796 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d046c98-a1e0-459d-8ad2-e1a13c6bf8d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1751 microversion: 2.20 time: 0.348101 Oct 04 18:20:43.365051 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1410/4970] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1751 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:43.419100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.420465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.451291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.454627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.459363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.460180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.467571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.468134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.841225 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e3e1cc3f-9e96-48cd-8859-6315b20fad97 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.426340 Oct 04 18:20:43.846971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3561/4971] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.253735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b535df-b326-4849-958a-907f0e3acefc", "tag": "1cbe9f1f-eec0-484c-963a-b6d9d7e04508"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:44.289339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.289824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.290429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.322548 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] Creating event network-changed:1cbe9f1f-eec0-484c-963a-b6d9d7e04508 for instance f6b535df-b326-4849-958a-907f0e3acefc on n-h1-831193-17 Oct 04 18:20:44.340173 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-89074e28-a8c4-4c51-a0dc-f432bcc5ad87 req-2429f958-25b1-4e82-ac6e-00b1304e2d25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090046 Oct 04 18:20:44.341230 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1411/4972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:44.376323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.376955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.379953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:44.391824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.392922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.394067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.395243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.395893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.396533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.661116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.678559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.681141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.682411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3668e7c5-1d17-4da3-b7d9-679717bb49e5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.310127 Oct 04 18:20:44.685039 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3562/4973] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:44.869746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.870457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.885392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.885909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.886350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.887083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.887546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.887976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.320993 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d725912-fd91-4fdb-92bf-b139ee92aca9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.454804 Oct 04 18:20:45.337190 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1412/4974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.711435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.712042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.732888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=8 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:45.735525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.736055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.736686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.740690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.742770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.743405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.062877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.073556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.075779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.076995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e3b1e99-5d61-47ac-b7f7-1b8c812c7dad tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.370265 Oct 04 18:20:46.077579 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3563/4975] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:46.346822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.347524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.357454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.357997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.358486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.359268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.359732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.360162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.088953 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-712a11ec-ecce-44af-b992-5185673dde89 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.745804 Oct 04 18:20:47.089541 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1413/4976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.111111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.111750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.121140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:47.122609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.123140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.125625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.126375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.126843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.127880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.475204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.503702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.505861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.507824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5d9ffcc-f91c-4c7a-9dfd-caec3571a994 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.400701 Oct 04 18:20:47.510492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3564/4977] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:48.113565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.114209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.133034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.138151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.141008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.143363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.146255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.150165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.515919 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e77ee61-530c-40f2-8a00-5bd3542d03fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.406457 Oct 04 18:20:48.519656 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1414/4978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.540818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.543340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.561232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.563418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.564259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.566191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.568391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.569275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.120915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.138465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.140757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.142026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f68888f-65e7-44cb-9457-7ea73a842e9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.609091 Oct 04 18:20:49.144772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3565/4979] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:49.475755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b3d82708-bb28-472e-ac83-e3b51b8a92bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: .version_select at 0x7f6340eafd30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1297486434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDImM8uwPRRJXxcDiJSlIroUFqn0q47UFUFhmbUIbWJWkdM0m07qW+OP+AYw7gOWQZc1tpLUogGMstmG9RhmoOvTLSb8lysNpQCFIbhekkGrakiglee5yQuFXTLYKTMK6w=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:49.544155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.548869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.565553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-b3d82708-bb28-472e-ac83-e3b51b8a92bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:49.600448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.606212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.610095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.615574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.616928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-b3d82708-bb28-472e-ac83-e3b51b8a92bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:49.617641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.620273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.699381 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b3d82708-bb28-472e-ac83-e3b51b8a92bd tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.229890 Oct 04 18:20:49.704879 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1415/4980] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:20:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:49.959411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb929c57-a32c-4204-8a9e-9901f984d046 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.417979 Oct 04 18:20:49.960034 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3566/4981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:50.174627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.175491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.193229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.196025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.197102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.201583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.205441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.207512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.967069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.983724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.984779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.986338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.990145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.998714 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e789782-dc4f-4ea9-9fb2-b22efe4f3f56 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.825965 Oct 04 18:20:51.002690 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1416/4982] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:51.018375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.019693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.020162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.020927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.021394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.021838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.115833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:51.683729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28ef9483-66e5-4ec6-a6a2-1c21d4f9bd0b tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.703399 Oct 04 18:20:51.686176 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3567/4983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.034300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.036098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.054548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.055807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.056613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.058567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.060824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.062126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.582635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.600811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.603185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.605206 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40ffda11-d701-4926-9ca0-15f75689f96d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1753 microversion: 2.20 time: 0.578486 Oct 04 18:20:52.606482 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1417/4984] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1753 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:52.709437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.710053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.722340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.726506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.727172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.729083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.730056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.732886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.253988 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bac053d8-553b-494d-9a4d-b41a4465aac1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.545536 Oct 04 18:20:53.255091 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3568/4985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:53.633967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.634692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.648935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:53.664171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.665492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.666269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.672242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.674295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.675093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.763653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b535df-b326-4849-958a-907f0e3acefc", "name": "network-vif-plugged", "status": "completed", "tag": "1cbe9f1f-eec0-484c-963a-b6d9d7e04508"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:53.784939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.793887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.794671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.821561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] Creating event network-vif-plugged:1cbe9f1f-eec0-484c-963a-b6d9d7e04508 for instance f6b535df-b326-4849-958a-907f0e3acefc on n-h1-831193-17 Oct 04 18:20:53.837979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c84f122e-fdb9-4397-a722-acef1dc838ed req-4ea4ed23-b076-47b3-8ce3-a87b20820e89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079762 Oct 04 18:20:53.839223 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3569/4986] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:54.282652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.284690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.292348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.293851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.294517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.295663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.296346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.297016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.656046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.660704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:54.677190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.684168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.686832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ed81450e-a4e8-42bc-a277-ca7655fb7e1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.059363 Oct 04 18:20:54.688566 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1418/4987] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:55.044692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7dd81358-a0a8-48f1-959e-e73fd77185a2 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1466 microversion: 2.1 time: 0.765579 Oct 04 18:20:55.064679 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3570/4988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1466 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:55.273366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1268062749", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "f5913a05-6f94-4be5-92f5-87d0d9d1667a"}], "key_name": "tempest-TestNetworkBasicOps-1297486434", "security_groups": [{"name": "tempest-secgroup-smoke-1871729841"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:55.572292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] validate_networks() for [('f5913a05-6f94-4be5-92f5-87d0d9d1667a', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:55.722630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.725796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.745720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.747588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.749509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.750283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.754234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.754704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.575266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:56.576414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:56.577057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:56.577700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:56.578371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:56.599764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.600624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.601887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.610623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.613495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.615002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.626702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.648695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.658979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.661962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ca1cbe4-40d9-4753-aca7-a24cb7206589 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.951957 Oct 04 18:20:56.682039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:56.685062 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3571/4989] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:56.690333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.692120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.703287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Getting quotas for user 8d213042530f4833b3e14427537c647f and project 76bb87d3bc4c46ed8666e59a6a766e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:56.713595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.715072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.716308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.717890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.719293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.720722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.738495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:56.748809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:56.892828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03a8e9cc-8a4b-4e11-9cf6-31c70ac37897 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.626145 Oct 04 18:20:56.894238 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1419/4990] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:56.932134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-184c283c-c49c-4669-b2dc-5d9d85a575fb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.940548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-184c283c-c49c-4669-b2dc-5d9d85a575fb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.146947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-184c283c-c49c-4669-b2dc-5d9d85a575fb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:57.164977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-184c283c-c49c-4669-b2dc-5d9d85a575fb tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1249 microversion: 2.1 time: 0.258069 Oct 04 18:20:57.165894 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1420/4991] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1249 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.219076 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63dd18ca-23b8-4956-8535-9d5424584691 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1652 microversion: 2.1 time: 0.532586 Oct 04 18:20:57.219703 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3572/4992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1652 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.244703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.248544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.275787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.276479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.278161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.282019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.283067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.284236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.692346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.693753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.702637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.703151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.716427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.719696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.724481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.727439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.767710 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe84d9f4-8ebb-4cc6-8d9f-25740f3b39ec tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1652 microversion: 2.1 time: 0.526851 Oct 04 18:20:57.770295 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1421/4993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1652 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.807671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.809512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.838070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.838654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.839180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.839928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.840386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.840816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.574652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.596161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.604880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.609642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c10dc67-2590-467a-a256-dfcc6fcaaccb tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.921533 Oct 04 18:20:58.610110 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3573/4994] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:58.625388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.631106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.662212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.662725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.663246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.664085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.664581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.664999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.778740 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e8e9e12-810d-463b-8304-d4134833b598 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1652 microversion: 2.1 time: 0.980752 Oct 04 18:20:58.780906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1422/4995] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1652 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:58.808146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.808990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.829085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.829594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.830168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.830891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.831385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.831818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.933086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:59.118739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.140482 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-732ab3e2-6e24-4731-b342-e1ec765f9417 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1301 microversion: 2.1 time: 0.527394 Oct 04 18:20:59.142644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3574/4996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1301 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.281426 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-872a4ad4-51ce-4675-94f4-022ad0904a91 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 204 len: 0 microversion: 2.1 time: 0.479032 Oct 04 18:20:59.282388 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1423/4997] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:58 2022] DELETE /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:20:59.290944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.291668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.305158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.306124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.307167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.309645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.311486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.313247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.646132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.647295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.660905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.661963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.662804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.665985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.668253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.670786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.996630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12ded9a0-60ed-42b8-8265-35a6a8ecdd37 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1658 microversion: 2.1 time: 0.707104 Oct 04 18:20:59.999426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3575/4998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1658 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.068665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.080464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.089338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.090953 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7fa7f33-48ac-480c-b520-fc251fdde55e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.452091 Oct 04 18:21:00.122663 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1424/4999] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:00.167971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.168805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.190440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.190997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.193513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.195502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.200008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.203789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.606573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.630245 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-417de9fb-a6b6-4d60-839c-6c21cbb5e28e tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1319 microversion: 2.1 time: 0.461380 Oct 04 18:21:00.633810 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3576/5000] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.027596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.029183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.041151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.041942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.042563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.043689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.044296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.045142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.122959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.124078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.149842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.155092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.155092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.155616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.172847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.173558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.732445 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-265862c1-7271-43b4-a45d-efa10eb45579 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1658 microversion: 2.1 time: 0.708342 Oct 04 18:21:01.749006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1425/5001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1658 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:01.759761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.761796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.775350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.784244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.792786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.801101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.803779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.804997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.806255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.807917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.808854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.810249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-09a73589-d836-4355-b112-5ec013db3e4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.691191 Oct 04 18:21:01.834715 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3577/5002] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:02.054324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.078143 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6cc74564-e749-48ae-ba64-6c8b7cdddf23 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1307 microversion: 2.1 time: 0.321084 Oct 04 18:21:02.102322 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1426/5003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.761863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.762727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.787867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.788465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.788870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.794190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.798012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.800166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.842303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.842916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.853148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.855898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.861009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.862296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.864269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.866209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.018697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.062927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.067132 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54219db3-b6fb-4143-b681-2de033be4fa1 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1658 microversion: 2.1 time: 1.309331 Oct 04 18:21:04.068125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3578/5004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1658 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.084354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.101637 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdbf2af5-728a-4b4a-8a93-b6241d1f282f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.247631 Oct 04 18:21:04.106593 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1427/5005] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:04.116367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.118059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.136387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.138493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.139763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.140702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.143190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.145662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.529307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.541576 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58b072f7-8df0-494a-9713-53df0acb296d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1307 microversion: 2.1 time: 0.450574 Oct 04 18:21:04.569033 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3579/5006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.099094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.099730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.109088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.110128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.110937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.112034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.112876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.113648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.138820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.141521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.157323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.159323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.160419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.174299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.175334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.176626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.364505 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d56e75ce-a78d-4273-94ef-c90dc0e6d111 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 200 len: 1616 microversion: 2.1 time: 0.268084 Oct 04 18:21:05.368659 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1428/5007] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 1616 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.582015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.583815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.613794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.620769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.621829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.628095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.631143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.632723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.560332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.584195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.587094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.588551 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eedf7a82-cde4-419f-9733-31638b161bac tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.454626 Oct 04 18:21:06.592031 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3580/5008] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:06.597465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b535df-b326-4849-958a-907f0e3acefc", "name": "network-vif-deleted", "tag": "1cbe9f1f-eec0-484c-963a-b6d9d7e04508"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:06.627853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.628602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.632536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.645000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.648522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:06.661315 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] Creating event network-vif-deleted:1cbe9f1f-eec0-484c-963a-b6d9d7e04508 for instance f6b535df-b326-4849-958a-907f0e3acefc on n-h1-831193-17 Oct 04 18:21:06.668039 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-775ef60b-e217-4a1b-8a91-09ccd3cd4393 req-ec2874fb-6b6c-427a-b5f4-b54672c0760c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074320 Oct 04 18:21:06.668893 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3581/5009] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:06.671479 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea8f89e1-9b7b-4489-b80b-1742a789f30a tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 1.095118 Oct 04 18:21:06.675684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1429/5010] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:06.681206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.682398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: f6b535df-b326-4849-958a-907f0e3acefc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.706296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.707001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.707733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.708783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.709406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.710017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.727073 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] HTTP exception thrown: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Request method failure captured: Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc HTTP/1.1 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHlOKohztQAsFUf_I7UzNJ_UYm67GmtGCnT-QyW-HFK5pEVy0xBr033PLY6yEfISkEYBBBqA5SLujGX9ovJZKzWkrXz85aRRqcHMu9ol760MWdNM42b063wc_DPwhv-M0i9xTGZ4b5rW_ZE3SYxI9uG-Fxr2daYzo25PuCaBeoaGTXA Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1d553b249d844d55ba8784d0c19f8a55 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestServerMultinode-478352236 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestServerMultinode-478352236 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1d553b249d844d55ba8784d0c19f8a55 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestServerMultinode-478352236 Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestServerMultinode-478352236-project-admin Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a4adcd742ac4dfbad0501bebd5eaf2a Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestServerMultinode-478352236-project-admin Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'f6b535df-b326-4849-958a-907f0e3acefc'} Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:06.729254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. Oct 04 18:21:06.734189 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:06.734812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Returning 404 to user: Instance f6b535df-b326-4849-958a-907f0e3acefc could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:06.742442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f1e5147-0a7e-459c-a1b0-3a784961c28d tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc" status: 404 len: 111 microversion: 2.1 time: 0.068344 Oct 04 18:21:06.744178 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3582/5011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/f6b535df-b326-4849-958a-907f0e3acefc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:06.753939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.754702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.762271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.762804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.763240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.764009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.764602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.764946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.816157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:07.088033 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7270fe30-9fdc-4d3a-9640-c13600121ad6 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 204 len: 0 microversion: 2.1 time: 0.339653 Oct 04 18:21:07.093897 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1430/5012] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:06 2022] DELETE /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:07.108403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.109752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.124916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.129589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.130307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.131352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.132056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.134212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.626395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.627125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.630010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:07.643600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.644100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.644536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.645558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.646122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.646122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.750403 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a53c4c80-97a7-4633-8a08-e96fae6bb19c tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1656 microversion: 2.1 time: 0.651539 Oct 04 18:21:07.751580 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3583/5013] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1656 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.756202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.756829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.770736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.771300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.772134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.773389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.774648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.775204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.155757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.175833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.178159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.180057 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c2f11994-5beb-46f4-91b0-f00123510666 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.557989 Oct 04 18:21:08.181801 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1431/5014] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:08.661365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.676543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd509f8b-cdf8-42f7-8e6d-cad7a24d1e1c tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 0.923865 Oct 04 18:21:08.682990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3584/5015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.780227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4a21ba-d73f-4080-b003-e0d6750c17c1", "tag": "e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:08.786027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.787973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.809352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.809874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.810383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.820894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.821325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.830378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.830865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.831327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.838433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.918536 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] Creating event network-changed:e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3 for instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 on n-h1-831193-17 Oct 04 18:21:08.946404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6248df54-3143-4159-b3cd-d8c172f69896 req-99d0bc9d-9145-48f8-b88c-7059775afde5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179648 Oct 04 18:21:08.953910 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1432/5016] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:09.208885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.209915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.240048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.242132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.250103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.252029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.253368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.255474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.649463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.699820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.712588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.722193 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d899f2d5-739a-41c0-9b31-5b2f09f11bd7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.518320 Oct 04 18:21:10.736407 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1433/5017] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:10.756819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.758163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.776621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.780213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.783302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.784520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.785159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.787592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.873793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:11.706700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.719971 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-70a26c53-b7c9-4a4f-aad4-30700ac5b5fa tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 0.979590 Oct 04 18:21:11.720872 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1434/5018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.744567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d802f-d100-4519-836b-a9bc114d804f", "name": "network-vif-unplugged", "status": "completed", "tag": "be642809-a79e-486b-881e-3408cdb17d03"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:11.766670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.768073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.770136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.778198 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2b24b9d8-e9c3-45ba-8ee0-2624b17297fd tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1656 microversion: 2.1 time: 3.008214 Oct 04 18:21:11.790653 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] Creating event network-vif-unplugged:be642809-a79e-486b-881e-3408cdb17d03 for instance 457d802f-d100-4519-836b-a9bc114d804f on n-h2-831193-17 Oct 04 18:21:11.803274 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3585/5019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1656 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:11.803274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.803274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.827126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.828057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.829422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.830447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.831182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.832129 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8f7da1e2-61bb-4d90-847f-45b0e9c2302e req-360af575-ed1e-47a8-922c-43c63e18a67f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073598 Oct 04 18:21:11.832685 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1435/5020] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:11.832964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.848758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:12.749003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.749707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.755959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.756444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.756894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.757603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.758243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.758827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.885117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.896035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.903545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.905100 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e73ec5eb-4b9b-4fab-9598-f45de67c03b4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.112287 Oct 04 18:21:12.905847 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3586/5021] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:12.915747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.921584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.935005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.935762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.936358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.937235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.944950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.945664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.231376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.244839 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9a20037f-63c4-460c-9832-b0ef8a342fd0 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 0.500750 Oct 04 18:21:13.246066 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1436/5022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:13.644862 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-feac6047-6ffb-4d87-a3be-a16de5bfcbed tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 200 len: 1656 microversion: 2.1 time: 0.737499 Oct 04 18:21:13.645471 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3587/5023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 1656 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.865170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d802f-d100-4519-836b-a9bc114d804f", "name": "network-vif-deleted", "tag": "be642809-a79e-486b-881e-3408cdb17d03"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:13.906655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.908592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.909791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.937599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.938230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.948712 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] Creating event network-vif-deleted:be642809-a79e-486b-881e-3408cdb17d03 for instance 457d802f-d100-4519-836b-a9bc114d804f on n-h2-831193-17 Oct 04 18:21:13.951846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.952475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.957154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8c899ce7-b94a-4693-8079-5edffe7883f9 req-20992b6e-9cab-4ba2-a1d7-1fc8cd559d95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100320 Oct 04 18:21:13.957926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.958186 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1437/5024] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:13.965437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.967769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.969206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.271370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.272179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.282785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.284587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.289329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.290488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.291140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.292300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.573835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.599182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.613558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.615312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26342309-205d-460e-9888-8a36a359c1e4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.686327 Oct 04 18:21:14.616454 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3588/5025] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:14.660738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.670971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.679916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] [instance: 457d802f-d100-4519-836b-a9bc114d804f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.693725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.697517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.698146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.698393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ab8c5c4-e551-4019-8d38-45faa5404296 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 0.431126 Oct 04 18:21:14.699077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.699548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.699987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.701093 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1438/5026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:14.720101 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] HTTP exception thrown: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Request method failure captured: Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f HTTP/1.1 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHlOKohztQAsFUf_I7UzNJ_UYm67GmtGCnT-QyW-HFK5pEVy0xBr033PLY6yEfISkEYBBBqA5SLujGX9ovJZKzWkrXz85aRRqcHMu9ol760MWdNM42b063wc_DPwhv-M0i9xTGZ4b5rW_ZE3SYxI9uG-Fxr2daYzo25PuCaBeoaGTXA Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 1d553b249d844d55ba8784d0c19f8a55 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestServerMultinode-478352236 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1d553b249d844d55ba8784d0c19f8a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestServerMultinode-478352236 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 1d553b249d844d55ba8784d0c19f8a55 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestServerMultinode-478352236 Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestServerMultinode-478352236-project-admin Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0a4adcd742ac4dfbad0501bebd5eaf2a Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestServerMultinode-478352236-project-admin Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '457d802f-d100-4519-836b-a9bc114d804f'} Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:14.722076 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. Oct 04 18:21:14.727237 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:21:14.729176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] Returning 404 to user: Instance 457d802f-d100-4519-836b-a9bc114d804f could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:14.730216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1f32731-167c-46f9-95f3-b9f5edecc0f9 tempest-TestServerMultinode-478352236 tempest-TestServerMultinode-478352236-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f" status: 404 len: 111 microversion: 2.1 time: 0.063010 Oct 04 18:21:14.730959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3589/5027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/457d802f-d100-4519-836b-a9bc114d804f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:21:15.450983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4a21ba-d73f-4080-b003-e0d6750c17c1", "name": "network-vif-plugged", "status": "completed", "tag": "e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:15.467600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.471715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.472871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.499204 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] Creating event network-vif-plugged:e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3 for instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 on n-h1-831193-17 Oct 04 18:21:15.508994 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-1dc9a6bd-220d-4565-b759-56f685c30abd req-94c8f19c-2633-4948-9ae5-bea42d7daf12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061649 Oct 04 18:21:15.510244 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1439/5028] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:15.653285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.653908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.671966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.672745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.673354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.675936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.676610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.677235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.759899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.761753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.771682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.773410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.774030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.776933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.779832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.783227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.870660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.897473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.902297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.907308 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28f75d92-2ba9-42df-b72b-43a6b9168fe3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.256716 Oct 04 18:21:16.929052 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3590/5029] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:17.007305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:17.016505 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-21999356-a45f-41d7-a5ae-c61ab7b6013d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1375 microversion: 2.1 time: 1.267281 Oct 04 18:21:17.021107 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1440/5030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1375 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.946682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.947364 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.950331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=54 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:17.964823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.965354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.967756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.968724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.972543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.973236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.044893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.045511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.053057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.053552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.054912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.055972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.057264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.057895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.651428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.694075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.708076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.711348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8fab9e1b-7c7f-493b-a216-09af92254cfa tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.769888 Oct 04 18:21:18.739536 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3591/5031] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:18.879913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.892148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8fa58762-5858-4beb-a978-18bbbb3647c6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1546 microversion: 2.1 time: 0.851558 Oct 04 18:21:18.895026 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1441/5032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1546 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:18.935224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.936070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.965440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.982392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.984426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.987093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.989128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.989780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.753740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.766436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.767246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.778521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7d010d0-f7d1-4813-9821-80158551aa9d tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1546 microversion: 2.1 time: 0.859132 Oct 04 18:21:19.780073 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3592/5033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1546 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.797686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.800881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.802344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.805457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.808448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.810999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.791859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.802536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.810412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.824140 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-615a73a4-4131-4465-b2d3-81d94badf4c4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 1.063601 Oct 04 18:21:20.827568 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1442/5034] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:21:21.856120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.857406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.869483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.870914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.874860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.877709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.879461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.880800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.260151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-plugged", "status": "completed", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:22.279352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.281760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.282391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.310377 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] Creating event network-vif-plugged:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:21:22.321062 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a928097a-35f8-4c0b-8129-eaac66baa8c0 req-da688908-9c7f-4523-8604-5eb977d822a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064528 Oct 04 18:21:22.321997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1443/5035] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:22.697700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.716816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.722436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.727058 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-374fb070-f568-4bec-9516-67c46e8fbe6d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.874989 Oct 04 18:21:22.729077 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3593/5036] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:23.758158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.758870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.761946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:23.775635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.776145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.776596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.777321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.777796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.778247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.545772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.554933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.564114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.565606 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4c73d55-c36f-45e1-a22a-76a176ff98e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.812061 Oct 04 18:21:24.566636 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1444/5037] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:25.598504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.600398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.623888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.624587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.626650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.627465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.627955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.628399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.454257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.470751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.472447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.473707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0df98429-3de5-492e-bb12-937ff97d4f9e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1809 microversion: 2.20 time: 0.881615 Oct 04 18:21:26.483199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3594/5038] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1809 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:27.273776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4a21ba-d73f-4080-b003-e0d6750c17c1", "tag": "e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:27.296811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.298395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.298783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.323470 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] Creating event network-changed:e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3 for instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 on n-h1-831193-17 Oct 04 18:21:27.337396 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a7a1c33b-dca6-4e9c-82e5-d04bc1564307 req-8d2c2f2a-1735-4ca9-af7e-de004ba6fd04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067668 Oct 04 18:21:27.340049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1445/5039] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:27.503795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.504413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.518696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.519406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.519889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.520653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.521120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.521559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.421030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.436777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.438713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.444264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31f42255-101f-4060-b430-223160e67f4f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1796 microversion: 2.20 time: 0.942886 Oct 04 18:21:28.445954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3595/5040] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1796 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:43.822978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:43.841725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.849809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:43.856235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=49 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:43.872823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.876750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.877434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.880418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.881655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.882264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.977152 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c70d02b2-1e1a-4206-839d-ba3662944fd6 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1/action" status: 200 len: 24567 microversion: 2.1 time: 0.162216 Oct 04 18:21:43.986978 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1446/5041] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:43 2022] POST /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1/action => generated 24567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:51.064078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:51.067448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:51.071193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=9 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:51.076893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=54 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:51.090957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.091531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.096618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.097237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.097724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.098170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.181117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a21d613-dd58-4498-8780-c8c022e02080 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "POST /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1/action" status: 200 len: 32636 microversion: 2.1 time: 0.120743 Oct 04 18:21:51.182380 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3596/5042] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:51 2022] POST /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1/action => generated 32636 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:54.974822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.976865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.986263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:54.987258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:55.000404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.001383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.002254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.005783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.006996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.024167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.107812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:55.215218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4a21ba-d73f-4080-b003-e0d6750c17c1", "tag": "e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:55.245591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.246096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.246546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.271067 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] Creating event network-changed:e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3 for instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 on n-h1-831193-17 Oct 04 18:21:55.285142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a0253e61-7328-4fb1-9ea0-8294d7593179 req-1160600d-c9a4-4032-b538-e2d58cc6b1e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075955 Oct 04 18:21:55.288860 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3597/5043] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:55.289040 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4bd166a-da4c-4e4f-925d-1f2cc3bf6634 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 204 len: 0 microversion: 2.1 time: 0.318494 Oct 04 18:21:55.290000 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1447/5044] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:54 2022] DELETE /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:55.308043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.309908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.322488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.328866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.329789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.330714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.331370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.331967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.941761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.962242 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91763d49-30c9-4059-a231-615f1220e843 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1671 microversion: 2.1 time: 0.667588 Oct 04 18:21:55.977891 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3598/5045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1671 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.004624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.005905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.024536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.025040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.025489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.026213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.026666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.032087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.229461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.230044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.246684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.247668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.248361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.249396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.252484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.253284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.326184 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b7db824-6ec9-4c19-a034-3b58be800832 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments/b4044202-81f2-44a6-8d28-c8ec33920802" status: 200 len: 194 microversion: 2.20 time: 0.101572 Oct 04 18:21:58.327503 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3599/5046] 10.222.0.33 () {60 vars in 1454 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments/b4044202-81f2-44a6-8d28-c8ec33920802 => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:21:58.425669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.439184 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ede781a6-b4b3-4821-be52-c8e1064400ac tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1671 microversion: 2.1 time: 1.436875 Oct 04 18:21:58.440066 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1448/5047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1671 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.474317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.475724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.488545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.492311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.494429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.499892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.500591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.501166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.708534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lazy-loading 'services' on Instance uuid c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:58.790265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4a21ba-d73f-4080-b003-e0d6750c17c1", "name": "network-vif-deleted", "tag": "e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:58.818071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.834851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.837573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.880302 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f14d7c6b-eda9-442a-9348-9f8494d0f37f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments/b4044202-81f2-44a6-8d28-c8ec33920802" status: 202 len: 0 microversion: 2.20 time: 0.410194 Oct 04 18:21:58.881070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3600/5048] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 18:21:58 2022] DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments/b4044202-81f2-44a6-8d28-c8ec33920802 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:58.884692 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] Creating event network-vif-deleted:e733d3ef-9705-4e4b-9aaa-28e4eda5eaa3 for instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 on n-h1-831193-17 Oct 04 18:21:58.896390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.902032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.921412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.922994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.923923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.926057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.926842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.928315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.940552 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ad28af6c-046d-43cc-b01d-0e56ab09d874 req-c33f6d9f-6268-4d89-a650-a772ba108ece service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153219 Oct 04 18:21:58.942179 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1449/5049] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:58.988611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d41d076-f702-473f-8f40-e87084be512c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101257 Oct 04 18:21:58.989684 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3601/5050] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:21:59.470997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.473354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.514329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.515520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.518349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.524027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.524717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.528605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.649304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.652803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.653613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.654377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lazy-loading 'fault' on Instance uuid 6b4a21ba-d73f-4080-b003-e0d6750c17c1 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:59.862928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d213042530f4833b3e14427537c647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76bb87d3bc4c46ed8666e59a6a766e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.877652 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f8538783-8075-4bc6-8d2a-68e8e1af35f2 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 200 len: 1339 microversion: 2.1 time: 0.411766 Oct 04 18:21:59.881666 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1450/5051] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:00.008210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.011244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.029171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.031867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.045231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.054490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.054992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.055469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.114161 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4ed7931-ed25-4619-ba7e-affbfbdadfed tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116180 Oct 04 18:22:00.126102 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3602/5052] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:00.909916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.910558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] [instance: 6b4a21ba-d73f-4080-b003-e0d6750c17c1] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.924391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.927136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.927599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.930986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.931597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.932583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.969867 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] HTTP exception thrown: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Request method failure captured: Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 HTTP/1.1 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHjJy2SMVQwTheFcuMlaWH9--Xtt34gzT7j0k_wp6e4l4cyZp_-aiWqRI0xjFiVVS8APW3ywafYaOdzlXJn1IqKfe3FvQ6VrDcrkPpEWPF2c1RNXt-tTZZm5ftW6LEE6GXtMA5P0DpxA0Rqyk_TOsdK1mn6l1kO_rucCU4XTBLSI1V8 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76bb87d3bc4c46ed8666e59a6a766e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 76bb87d3bc4c46ed8666e59a6a766e3a Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkBasicOps-1151432528 Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8d213042530f4833b3e14427537c647f Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkBasicOps-1151432528-project Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '6b4a21ba-d73f-4080-b003-e0d6750c17c1'} Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:00.974143 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Returning 404 to user: Instance 6b4a21ba-d73f-4080-b003-e0d6750c17c1 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fb0465c9-532a-4f63-b76b-679588203f27 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1" status: 404 len: 111 microversion: 2.1 time: 0.075632 Oct 04 18:22:00.980766 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1451/5053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/6b4a21ba-d73f-4080-b003-e0d6750c17c1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:01.138644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.141969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.165344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.165865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.166316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.167059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.167558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.168341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.237365 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc25be4d-3707-4a60-a124-2f0c1488331a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103100 Oct 04 18:22:01.237982 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3603/5054] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:01.655368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be52b370-2a13-4022-9a43-594389bd5b05 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] Calling method '.version_select at 0x7f6340ededc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.698450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be52b370-2a13-4022-9a43-594389bd5b05 tempest-TestNetworkBasicOps-1151432528 tempest-TestNetworkBasicOps-1151432528-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1297486434" status: 202 len: 0 microversion: 2.1 time: 0.049251 Oct 04 18:22:01.699673 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1452/5055] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 18:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1297486434 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:02.250464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.254031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.271024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.271811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.272738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.273783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.274374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.274661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.358540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a5d70b0-61d1-4fbc-8f93-646b5981882b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112428 Oct 04 18:22:02.363181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3604/5056] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:03.379072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.396004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.425858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.426799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.427511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.430495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.442796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.444246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.574019 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57be848c-9973-4e9d-ae5c-b92788f49d97 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201920 Oct 04 18:22:03.581254 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1453/5057] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:04.600503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.606578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.635520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.637509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.644505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.646385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.649612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.651065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.789312 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6501aa4-78ba-4e5a-b577-762dfe09c9ee tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.203752 Oct 04 18:22:04.791965 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3605/5058] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:05.807063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.811383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.853169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.856101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.859826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.860864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.871796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.874485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.024591 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3faf864e-fcd6-4fea-b0cf-8dee68254a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.224413 Oct 04 18:22:06.036586 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1454/5059] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:07.050903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.059550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.136344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.157985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.158530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.161195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.161680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.162122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.321518 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42ebf1ca-dff5-4c3b-af54-d0e2c6fd3fb3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.272261 Oct 04 18:22:07.326139 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3606/5060] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:08.339242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.342278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.360581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.361722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.362819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.364401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.366653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.367384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.468171 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-89dc0dac-a016-43cf-9dbc-8371bdc1e385 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134294 Oct 04 18:22:08.471113 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1455/5061] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:09.483813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.487806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.507601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.508402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.509015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.511004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.513598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.514530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.612137 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6491546b-4a5c-4e3d-b9b3-812018c548d5 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132455 Oct 04 18:22:09.618180 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3607/5062] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:09.788628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.789216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.811168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.811902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.812615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.815587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.816886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.819271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.894583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:10.057313 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9f80166e-3671-4d40-90c2-fa766eba4b29 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 204 len: 0 microversion: 2.20 time: 0.274707 Oct 04 18:22:10.062750 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1456/5063] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:22:09 2022] DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:22:10.072849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.073758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.089118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.089652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.090110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.092542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.093256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.093816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.576795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.595376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.601397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.604169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-25e76fd8-c0b3-4690-88fe-41eb36e82d33 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 0.536797 Oct 04 18:22:10.606212 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3608/5064] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:11.635722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.636599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.673879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.694987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.696842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.698807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.702677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.711679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.093298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.106554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.111728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.116086 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3df0d1ff-235e-41fe-8940-01ae46751a5f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 1.483275 Oct 04 18:22:13.117076 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1457/5065] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:14.155546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.156817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.172464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.174230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.174795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.178773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.179464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.180237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.990326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:16.007634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.011187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.011700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.035898 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] Creating event network-vif-unplugged:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:22:16.071747 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-edbb4bf2-0ec3-44c4-be9c-4f31d7950933 req-c5fb0d59-7a52-41b7-ae5c-6b7d4351df28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075230 Oct 04 18:22:16.077477 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1458/5066] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:22:16.507690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.539611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.545801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.552317 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b7c3824-a8cd-4149-b37b-f0244eda9a05 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1724 microversion: 2.20 time: 2.398257 Oct 04 18:22:16.556811 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3609/5067] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1724 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:17.583155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.583862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.601952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.605286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.606551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.610004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.610659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.612505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.867842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.887303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.888701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.889906 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de43ff13-b263-4f80-b40a-523330484f74 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1656 microversion: 2.20 time: 0.312124 Oct 04 18:22:17.890475 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1459/5068] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1656 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:18.924489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b", "name": "network-vif-deleted", "tag": "1544f7e9-7c48-482a-9d52-d7ec9dc462f8"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:18.931976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.933385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.962861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.963953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.966915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.974335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.975861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.976869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.982458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.984153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.985907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.055928 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] Creating event network-vif-deleted:1544f7e9-7c48-482a-9d52-d7ec9dc462f8 for instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b on n-h2-831193-17 Oct 04 18:22:19.073238 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3fd2186e-5b4f-42c1-8089-29234512de6a req-a4a53336-325d-4d7f-83b7-9c84dc3b6795 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145904 Oct 04 18:22:19.077863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1460/5069] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:19.478658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:19.499754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:19.501732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:19.505972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a4aaebd-65bd-49ea-8c99-d75d37076068 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 200 len: 1367 microversion: 2.20 time: 0.587359 Oct 04 18:22:19.527070 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3610/5070] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 1367 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:20.535778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:20.537777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:20.571177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.572117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.573167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.574201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.574897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.617781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.664340 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b HTTP/1.1 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b'} Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:20.671262 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:22:20.679174 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:22:20.681750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:20.685418 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-465b1701-dcc5-48f2-bb09-08b23b69f4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 404 len: 111 microversion: 2.20 time: 0.153339 Oct 04 18:22:20.687731 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1461/5071] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:20 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:22:20.719818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-062534c5-1d32-4640-b171-b3ffd2568a2e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '.version_select at 0x7f6340311af0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:20.806016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-062534c5-1d32-4640-b171-b3ffd2568a2e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107685685" status: 204 len: 0 microversion: 2.20 time: 0.110892 Oct 04 18:22:20.813730 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3611/5072] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 18:22:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107685685 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:22:23.410860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-20864704-bce1-4ee7-8fb3-718023431812 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: .version_select at 0x7f6340eb5c10>, body: {"keypair": {"name": "tempest-keypair-230996084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXzZAz4agtR+1wPNaEBf5lrgbHs3m0iWm7qYnyTTwFVxJ/+dDpinAE2HSNVEWeeaiePIBuVWjOiQnR6hT80N27sQzt1k7VIaQjOx5Xj+rkvGO7eDjwu79kUQaSdHaTM5g=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:23.434390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-20864704-bce1-4ee7-8fb3-718023431812 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for project dce667ac90f94299aa0f3a2767614939. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:23.441123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-20864704-bce1-4ee7-8fb3-718023431812 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for user b4a7019401cf4e98a437d334a6a9de2f and project dce667ac90f94299aa0f3a2767614939. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:23.495491 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-20864704-bce1-4ee7-8fb3-718023431812 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.097145 Oct 04 18:22:23.498971 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1462/5073] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 18:22:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:22:25.772220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1390417317", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af8030e-2c85-45c4-a4fe-f17edfb54b65"}], "security_groups": [{"name": "tempest-securitygroup--1676587494"}], "key_name": "tempest-keypair-230996084", "user_data": "}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:25.791097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:26.336899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] validate_networks() for [('2af8030e-2c85-45c4-a4fe-f17edfb54b65', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:27.516157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:27.516735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:27.517488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:27.517904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:27.518316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:27.546081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.547923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.548674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.550148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.552496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.555116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.582291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:27.594764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for project dce667ac90f94299aa0f3a2767614939. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:27.606725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Getting quotas for user b4a7019401cf4e98a437d334a6a9de2f and project dce667ac90f94299aa0f3a2767614939. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:27.645785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:27.651593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:27.726584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5306a276-48ae-4b93-9a4c-f5b3dba1f0ae tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.960404 Oct 04 18:22:27.727903 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3612/5074] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 18:22:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:22:27.739853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:27.742165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:27.750798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:27.835155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.850717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.852215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.866133 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-10debc0b-9cd1-4c3d-8881-8c0129ac9e81 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1281 microversion: 2.20 time: 0.118347 Oct 04 18:22:27.867110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1463/5075] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:27 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:28.898867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.899613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.917162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.917685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.924236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.925080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.941850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.941850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.070316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.089791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.094423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.099264 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f821515-3ac2-498e-a017-813f95f2a14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1333 microversion: 2.20 time: 0.207917 Oct 04 18:22:29.101419 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3613/5076] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:30.134788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:30.135965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:30.153497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.154164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.154608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.162392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.162392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.162850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.229016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:30.302259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.310865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.317121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.320792 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a7daa296-d8bb-4205-818e-f960d37cc4f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1339 microversion: 2.20 time: 0.194383 Oct 04 18:22:30.328886 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1464/5077] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:30 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:31.363438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.364045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.397158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.405128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.405790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.406985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.408462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.410755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.549991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.567775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.581077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.586818 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8be555d3-29a3-43b6-80b1-3274ec97b1dc tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1339 microversion: 2.20 time: 0.231655 Oct 04 18:22:31.588361 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3614/5078] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:32.625419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.626990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.644908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.649680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.651608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.659317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.659833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.662330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.404092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.418480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.420443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.422101 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-14a83ba9-f4b4-4561-bb21-ba77dc30de27 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.810690 Oct 04 18:22:33.433633 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1465/5079] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:34.461766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.462964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.482504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.490925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.491498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.492278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.496637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.497500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.361197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.373898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.381300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.382524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff9660e3-4262-4548-a0fe-f553d8db5ffd tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.925829 Oct 04 18:22:35.389118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3615/5080] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:36.018072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:36.057271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.059815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.060286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.086906 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] Creating event network-changed:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:22:36.097497 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-63a6eccc-c855-41f0-a811-5ac4969d5a6c req-25e4d8cf-9ad9-40c5-b2ac-6fff549a95cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082155 Oct 04 18:22:36.099022 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1466/5081] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:36.419370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.420690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.434450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.435414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.436061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.437178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.451936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.454347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.950398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.965389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.976834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.978246 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e2ea634-5c68-4542-b01c-79962521c045 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.564964 Oct 04 18:22:36.979529 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3616/5082] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:38.006813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.007558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.010730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:38.033612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.034127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.034584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.035354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.043068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.043628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.435263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.448630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.450395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.451616 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd4b51a2-785a-43e2-aac7-06bf7cc278d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 1.450099 Oct 04 18:22:39.466141 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1467/5083] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:40.478244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.479633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.482691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:40.484622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:40.495094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.497876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.500953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.501988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.502943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.506665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.852133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.876292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.887314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.895895 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-223384c5-167f-4d9a-956e-b64afbd4c5d6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.421679 Oct 04 18:22:40.896583 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3617/5084] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:41.924706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.925954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.954123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.954883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.955621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.958526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.959800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.960413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.496557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.512286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.514077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.515455 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-87e56a40-ef2d-4878-a75a-0185f5a93f0e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.596059 Oct 04 18:22:42.520498 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1468/5085] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:43.548993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.549618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.561697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.566111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.566827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.567820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.569379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.572126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.987633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.000147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.003686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.005349 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5b368630-5ef8-4aa0-81ba-42192cec11b9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.460252 Oct 04 18:22:44.020081 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3618/5086] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:44.439011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "name": "network-vif-plugged", "status": "completed", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:44.472699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.473188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.473629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.521827 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] Creating event network-vif-plugged:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:22:44.569596 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0401c691-81cc-4d3c-9d71-d07e8be983d9 req-e13eee05-f40f-4ded-82da-5deb2e5c6729 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134872 Oct 04 18:22:44.572145 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1469/5087] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:45.034135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.035691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:45.049022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.051862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.053014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.055305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.058266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.058970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.291412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.299836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.311440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.312999 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8675fe5-eb78-4bbb-bc94-229a5585ccdf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1407 microversion: 2.20 time: 0.283148 Oct 04 18:22:45.313888 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3619/5088] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:46.342260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.343006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.355571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.357066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.360714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.361958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.362789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.363497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.623924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.645745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.652535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.655119 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b951f551-5fff-4fe3-9f19-227cbc4c0326 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1599 microversion: 2.20 time: 0.317621 Oct 04 18:22:46.658389 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1470/5089] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1599 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:46.687251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.688632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.738939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.744995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.745760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.747153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.748051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.751883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.046556 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37dd9db5-02bc-4b2f-bb42-30facd68aa04 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.363595 Oct 04 18:22:47.047632 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3620/5090] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-interface => generated 285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:49.604336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:49.629452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.635330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.636437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.670283 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] Creating event network-changed:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:22:49.684601 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-78a99054-cc88-4b33-997b-6eed43e86734 req-b65c67d9-86f4-4c26-8726-982e34ce5ef3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083821 Oct 04 18:22:49.686697 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1471/5091] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:22.434812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.436869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.445370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:22.449762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=47 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:22.479570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.483455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.484207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.485618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.487541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.490153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.561641 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc5687f3-2ad6-4c9a-96c1-7eea4e2b8da0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/ips" status: 200 len: 152 microversion: 2.20 time: 0.135742 Oct 04 18:23:22.562669 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3621/5092] 10.222.0.33 () {60 vars in 1289 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/ips => generated 152 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:23:25.956480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:25.957773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.975513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=19 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:25.976652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=35 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:25.978139 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:23:25.978453 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/action (ip 10.222.0.33) !!! Oct 04 18:23:25.980813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.981560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.987540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.988612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.989440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.990142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.062553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lazy-loading 'flavor' on Instance uuid 0f64b28b-dd20-40df-8214-267d364a05f5 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:26.528064 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26401a2c-4e4f-44f6-94d4-2a1f1eaf9676 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/action" status: 202 len: 0 microversion: 2.20 time: 0.561067 Oct 04 18:23:26.530981 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1472/5093] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:23:25 2022] POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:26.542521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.544973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.596112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.603538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.604079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.609652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.610377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.610938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.237153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.246811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.248971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.250295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-87acf0ca-1c85-4974-bc25-ecfcfc749a26 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.716192 Oct 04 18:23:27.268540 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3622/5094] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:28.283065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.283794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.299294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.306157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.306887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.307933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.308566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.309171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.735589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.746021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.757440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.759088 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22179d9f-a7dc-44d6-81db-4ec20e2f7072 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.481302 Oct 04 18:23:28.760215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1473/5095] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:29.786562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.787888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.804416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.804772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.805411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.809864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.810828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.813355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.491761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.508488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.510192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.511591 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-017d0978-92d2-4e41-823c-5e5062e2435d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.729692 Oct 04 18:23:30.512711 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3623/5096] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:31.539482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.540690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.553035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.566613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.570510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.572804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.575565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.577210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.874666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.890543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.892269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.894236 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ce0174e-5718-4293-a90d-f590826271e3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 1.360369 Oct 04 18:23:32.899945 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1474/5097] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:33.948568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.948568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:33.948568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.948568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.948568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.058209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.058209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.058209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.265088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.275484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.276960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.278165 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a49c9a18-0162-4a74-8567-8a52c486a3f9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.354274 Oct 04 18:23:34.283871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3624/5098] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:35.319880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:35.321320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.349560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.352534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.354961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.358468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.361679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.363877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.312149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.332706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.335936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.337156 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-415efb1d-2850-4da9-bdbc-e1fd47c41b07 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 1.028267 Oct 04 18:23:36.349987 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1475/5099] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:37.976640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.977996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:38.005770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.007174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.011437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.014219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.016336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.019183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.480992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.508392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.512890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.514515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a20a80d-accb-4df8-b7e4-0a25770b8d75 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1745 microversion: 2.20 time: 1.139112 Oct 04 18:23:38.518427 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3625/5100] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1745 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:39.549471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.550705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.572822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.574615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.577212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.579197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.579739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.582604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.362632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.385242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.396059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.403073 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c86c2a0f-043a-4ebf-b5a5-c393789060d9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.857924 Oct 04 18:23:40.424913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1476/5101] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:41.434216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.434858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.457993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.468303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.469017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.469961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.471665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.472473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.299947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.315989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.323900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.328675 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e0def86f-62af-4677-8aad-8b71d758ff6f tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.901002 Oct 04 18:23:42.336503 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3626/5102] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:43.363403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.364255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.373015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.375897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.381514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.382600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.384257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.384955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.793343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "name": "network-vif-plugged", "status": "completed", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:43.810780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.819891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.820675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.849717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] Creating event network-vif-plugged:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:23:43.867516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-95ece253-317b-4d81-94e0-5e738965d2ad req-7d60ebd3-790a-4f41-bb45-db743b00c945 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078169 Oct 04 18:23:43.868904 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3627/5103] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:23:44.154688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.171979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.173563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.174821 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-45c9514c-35cf-4bc8-855d-e65a28c1ca13 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.815538 Oct 04 18:23:44.204326 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1477/5104] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:45.213381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.215745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.232927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.233797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.234429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.235315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.236538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.237338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.935692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.953289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.954831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.964227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0590cf18-e070-4446-94e4-b3253fc187df tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.757873 Oct 04 18:23:45.964227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3628/5105] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:46.993697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:46.995841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:47.023099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.032521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.033249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.034204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.046491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.047398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.389924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.442598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.444111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.445347 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-53324967-8c80-498c-9006-01a299fa0718 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 1.456395 Oct 04 18:23:48.454302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1478/5106] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:46 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:49.477185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.477809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.504864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.506851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.516644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.522769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.523306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.523940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.829974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.848713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.868623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.870981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0aeb14c1-4ec3-491e-adee-b5abf9875a2b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.398957 Oct 04 18:23:49.872949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3629/5107] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:50.907518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.908083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.948673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.954723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.956514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.965581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.968395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.987610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.449572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.468407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.476493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.478154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe73fa76-f388-41f3-b1d2-069ba67f9962 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.581337 Oct 04 18:23:51.480355 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1479/5108] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:52.507588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.509046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.512132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:52.529621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.540922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.541665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.545943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.546756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.547509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.560453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=49 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:53.188307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.203143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.211063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.216854 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f718c94e-82d4-4b6f-8fea-df578200b9bf tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.714652 Oct 04 18:23:53.227721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3630/5109] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:54.250147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.250786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.279622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.280124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.280579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.281322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.281788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.296421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.729110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.740329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.752606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.753875 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-38bdd5db-ae54-4a56-a558-de15b734dd6a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.515394 Oct 04 18:23:54.754499 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1480/5110] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:55.786155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.786831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.832378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.833298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.840971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.841746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.842229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.842778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.221252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.246450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.255955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.262683 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-074de3da-aca0-48e2-b730-c5d09d4b962a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.479015 Oct 04 18:23:56.263938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3631/5111] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:57.302708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.303376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.306386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=19 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:57.318735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.325752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.326565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.327575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.331651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.332357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.345667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.027267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.044966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.052849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.059859 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-758f8867-49c3-46a0-9634-4444253f5f2c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.765912 Oct 04 18:23:58.064767 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1481/5112] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:59.093758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.094621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.115687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.116510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.121110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.125030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.128060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.128816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.548417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.561756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.567020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.572305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-10cd75b4-b1f4-47ac-bb70-f7a8515627e7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.484595 Oct 04 18:23:59.577881 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3632/5113] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:00.608105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.609826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.623496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.625273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.625900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.630183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.630866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.631616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.494854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.515935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.523053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.524586 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1ee4b236-7017-46ab-8621-0a912d0961c3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.923500 Oct 04 18:24:01.530939 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1482/5114] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:02.564294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.564922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.583455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.585392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.586671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.588213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.588701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.591532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.987539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.039926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.049498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.065494 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e709803-565b-46b6-831f-dd11940ede1c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.507345 Oct 04 18:24:03.066686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3633/5115] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:04.101725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.103126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.113892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.118333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.119059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.121072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.123368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.124085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.642913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.657804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.666737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.668324 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07e79cfa-8ca9-42bf-9b7b-8c7d004feeb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.572678 Oct 04 18:24:04.669978 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1483/5116] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:05.705817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.706851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.729107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.729786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.731275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.732439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.733204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.734930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.054324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.068162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.073439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.076717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8bab6f2c-3bb7-4054-9c52-88f752d7de36 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.377506 Oct 04 18:24:06.077313 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3634/5117] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:07.109651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:07.110835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:07.126243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.126945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.127706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.128586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.129230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.138382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.501667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.514142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.518192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.519469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-46c847ef-7cc6-43d6-a34f-569c9bc11f86 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1740 microversion: 2.20 time: 0.413766 Oct 04 18:24:07.524376 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1484/5118] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:07 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:08.553671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.554291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.567532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.568375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.569246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.585048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.585560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.586012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.120539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.131903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.133401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.134615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0f80ccb-1f4a-41a6-a550-5dbfed86863c tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1722 microversion: 2.20 time: 0.585595 Oct 04 18:24:09.150385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3635/5119] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1722 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:10.167848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.168544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.196113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.203998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.205041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.206536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.207505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.208170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.477426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.506496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.514730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.516220 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3da0d31d-f4b2-48c1-92db-afb6cd4b4f55 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1722 microversion: 2.20 time: 0.356310 Oct 04 18:24:10.525544 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1485/5120] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:10.931627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fd8d694-eb3d-49ef-bab0-9684a511d301 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Action: 'create', calling method: .version_select at 0x7f6340c26310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-898471706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIULzykHBr+q73nC/Tl1HzFK+cxkSquH7gh/euN/I/xKG1KNULlO6q/3SQvxF54hKYUXV194YjyIDeuroc31irpc+DK6cEbBQLGw68TVJNsKeU06MeDfp+UsdXQvfnASLQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:10.982269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9fd8d694-eb3d-49ef-bab0-9684a511d301 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:10.997191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-9fd8d694-eb3d-49ef-bab0-9684a511d301 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for user b530deb07e924e41bcaf37d92a4c949a and project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:11.030934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9fd8d694-eb3d-49ef-bab0-9684a511d301 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.571122 Oct 04 18:24:11.032097 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3636/5121] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:24:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:11.557454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.558138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.570978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.572562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.573248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.575960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.577467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.579682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.191111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.201256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.208248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.214307 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cd4c1368-e21f-4623-8c75-6e3ebd7e7167 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1665 microversion: 2.20 time: 0.661607 Oct 04 18:24:12.215311 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1486/5122] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1665 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:12.246271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcc23bf0-0bfe-4d5f-86ba-f65b25932267"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:12.250322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.259722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.260479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.261090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.262197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.263065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.263670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.734398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "name": "network-vif-unplugged", "status": "completed", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:12.761318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.762297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.762961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.798594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.compute.server_external_events [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] Unable to find a host for instance 0f64b28b-dd20-40df-8214-267d364a05f5. Dropping event network-vif-unplugged {{(pid=128771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:24:12.799896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-974c329b-c086-40a7-820a-3a19e277a75a req-43ea361d-a870-4442-bc41-8315f0af7506 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069604 Oct 04 18:24:12.802329 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1487/5123] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:24:12.806865 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b6a0a7e4-1b93-4928-8f08-7cc5bdd3c9e6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.567973 Oct 04 18:24:12.807554 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3637/5124] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 18:24:12 2022] POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments => generated 188 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:24:13.084586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.085500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.094382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.099767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.100560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.101578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.103153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.105047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.526862 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2f03c1bc-75a2-442e-b6a2-d4d725342aa7 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments/bcc23bf0-0bfe-4d5f-86ba-f65b25932267" status: 202 len: 0 microversion: 2.20 time: 0.447540 Oct 04 18:24:13.532020 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1488/5125] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 18:24:13 2022] DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments/bcc23bf0-0bfe-4d5f-86ba-f65b25932267 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:13.640097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:13.640816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.651649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.652160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.653164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.658963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.659499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.659955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.740177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:24:13.878565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67372b63-7780-4e1f-919d-a5a22e36bcf9 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/action" status: 202 len: 0 microversion: 2.20 time: 0.242687 Oct 04 18:24:13.878565 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3638/5126] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 18:24:13 2022] POST /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:13.887487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.888093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.904310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.906091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.909366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.909366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.909366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.910079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.319742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.333821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.341007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.344488 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c019ab20-f291-471e-862a-3ed4e5a27da1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1673 microversion: 2.20 time: 0.459200 Oct 04 18:24:14.360215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1489/5127] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1673 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:15.375867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.376475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.388360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.388769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.395892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.398921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.401021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.403753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.778295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.791976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.798856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.803794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b9a0ddd-5aa1-49a2-b3c7-fdaf9c526867 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1673 microversion: 2.20 time: 0.433062 Oct 04 18:24:15.806925 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3639/5128] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1673 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:16.840653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.841376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.856812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.857771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.858500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.859511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.860858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.865112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.526219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.539503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.546259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.549525 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2c200faf-8de5-4544-9771-a947ea091294 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.717666 Oct 04 18:24:17.565719 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1490/5129] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:18.585187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.588971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:18.618085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.625761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.626504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.627456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.628087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.628981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.041081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.054013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.057078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.062105 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21ec1ca3-7264-4d25-850c-367f1dde2265 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 1.479753 Oct 04 18:24:20.065510 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3640/5130] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:21.094226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.094978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.105869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.112680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.113480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.115405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.117313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.119056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.961644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.033018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.033018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.033018 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54d40455-9f81-4ad2-84f7-23c85d05ff51 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.900738 Oct 04 18:24:22.033018 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1491/5131] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:23.031844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.033272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.044649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:23.047868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:23.051846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.052520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.053932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.054651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.055156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.075494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.102113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:24.063147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.077059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.089260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.090661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21596090-a14a-4661-89b2-b62d12d04e70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 1.063387 Oct 04 18:24:24.100460 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3641/5132] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:25.120725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.122273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.163739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.164277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.164729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.165465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.166120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.170109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.744207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.759874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.765101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.766357 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-15de6ac0-a6ea-417b-80f5-4ca164da20a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.650120 Oct 04 18:24:25.793691 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1492/5133] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:26.065061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-204318408-access_point-230891104", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "57a9de03-cff4-4abb-876f-b63ce8e4c162"}], "key_name": "tempest-TestSecurityGroupsBasicOps-898471706", "security_groups": [{"name": "tempest-secgroup_access--903762786"}, {"name": "tempest-secgroup_general--600452740"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:26.728111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] validate_networks() for [('57a9de03-cff4-4abb-876f-b63ce8e4c162', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:26.801735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.802396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.818052 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.818540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.819002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.820083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.820902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.822400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.649866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.656850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:27.672542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.674131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.675422 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61d462ff-11b8-4af2-8f52-584239edf871 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.878391 Oct 04 18:24:27.676064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1493/5134] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:28.501994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:28.502467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:28.502879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:28.503968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:28.504474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:28.531756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.531756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.531756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.531756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.531756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.532170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.605929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:28.617408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for user b530deb07e924e41bcaf37d92a4c949a and project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:28.648864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:28.665464 n-d-831193-17 devstack@n-api.service[128770]: WARNING nova.utils [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-204318408-access_point-230891104 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-204318408-acc Oct 04 18:24:28.669070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:28.702114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.702841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.706110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=26 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:28.733442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.752291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.757685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.762192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.763082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.763763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.889546 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6c5693a-08cc-4505-9b5b-5f5af7d72944 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.827163 Oct 04 18:24:28.892512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3642/5135] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:26 2022] POST /compute/v2.1/servers => generated 456 bytes in 2833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:28.911148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35eeb1d6-a62f-47fc-80ec-1afc2b74e363 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.917901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35eeb1d6-a62f-47fc-80ec-1afc2b74e363 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:29.264989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35eeb1d6-a62f-47fc-80ec-1afc2b74e363 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.274639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35eeb1d6-a62f-47fc-80ec-1afc2b74e363 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1292 microversion: 2.1 time: 0.371996 Oct 04 18:24:29.282926 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3643/5136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1292 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:29.609695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.677308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.685430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.690134 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2a503994-f673-4d67-a2c6-97d1c7189a35 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.992277 Oct 04 18:24:29.693537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1494/5137] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:30.306510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdbb8a8d-b1bb-49ea-8b5a-917d762e0105 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.307163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bdbb8a8d-b1bb-49ea-8b5a-917d762e0105 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.572519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bdbb8a8d-b1bb-49ea-8b5a-917d762e0105 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.589984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdbb8a8d-b1bb-49ea-8b5a-917d762e0105 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1292 microversion: 2.1 time: 0.288106 Oct 04 18:24:30.603934 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3644/5138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1292 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:30.725899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.726919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.761175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.761774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.762238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.764954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.765501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.765949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.334946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:31.359553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:31.366638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:31.371808 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-21340c24-d90e-4199-b014-16f4edef6714 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.653776 Oct 04 18:24:31.378328 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1495/5139] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:31.619076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:31.619717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:31.669739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.671065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.672504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.673638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.676739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.677627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.849866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:31.862658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2449b6c5-57f5-4c41-b408-33709ed7bf04 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1352 microversion: 2.1 time: 0.249381 Oct 04 18:24:31.863842 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3645/5140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:31 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:32.406166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:32.407702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:32.425564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.427762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.429570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.431058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.432829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.434453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.888854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:32.889707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:32.909467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.915914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.916562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.917416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.922175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.923976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.194077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.214927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.223192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.229232 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a57d9abb-5f9e-454c-be67-a228da50e59b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.825248 Oct 04 18:24:33.245365 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1496/5141] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:32 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:34.056064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.077031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1093a68f-2e4f-43d2-8144-b9256c89f522 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 1.192123 Oct 04 18:24:34.093075 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3646/5142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:32 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:34.263341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:34.266045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:34.283797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.288520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.289331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.290255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.292529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.294618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.104105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:35.111546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:35.132769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.133820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.134693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.135758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.136572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.137285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.462385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.481056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.487985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.492721 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-47ecf08b-8ba0-4ca4-96ba-c1755931205d tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 1.234188 Oct 04 18:24:35.495586 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1497/5143] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:34 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:35.886669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.898491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-02238ccd-4aae-4c5e-b0f3-31c35f867a73 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.798564 Oct 04 18:24:35.902206 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3647/5144] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:35 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:36.531885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.533177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.569111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.569834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.570469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.571398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.573433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.574306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.924306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.924928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.931952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.946449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.947870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.952870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.953109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.955582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.444197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.453879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.471180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.473548 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5232424b-126d-499d-ae90-a380e146eaa2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.949932 Oct 04 18:24:37.474144 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1498/5145] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:37.715058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.730645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd096df0-95c9-4c54-9800-a1d8d5fc7d50 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.809761 Oct 04 18:24:37.733906 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3648/5146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:37.869205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeed249-985f-428e-87b2-8b10a3932516", "tag": "c2eca3b5-53f7-494f-b389-97deb25b9566"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:37.908351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.912368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.912994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.949584 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] Creating event network-changed:c2eca3b5-53f7-494f-b389-97deb25b9566 for instance fdeed249-985f-428e-87b2-8b10a3932516 on n-h1-831193-17 Oct 04 18:24:37.961643 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8358bebc-9f2e-4624-a88c-bac815d0bcf0 req-5fd6f2d6-0305-4084-95bd-0c0cb3b8eb29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485042 Oct 04 18:24:37.975363 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1499/5147] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:38.502965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.504264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.516005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.516507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.516950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.517681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.518124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.518552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.574712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:38.761663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.762373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.770465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.771198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.771805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.772647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.773239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.774255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.793260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.801508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.802973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.804199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7470006f-dbca-4865-9b12-1b76e42c4cb1 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.305535 Oct 04 18:24:38.808504 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3649/5148] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:38.978706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.993807 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07e073a8-504b-4818-a404-a3d86a051b5f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.240072 Oct 04 18:24:38.994385 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1500/5149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:39.829880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.831388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:39.843413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.849954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.851476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.855610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.856527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.858678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.019154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:40.020153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:40.039312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.044102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.046974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.047914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.048513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.049113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.249890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.266085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.267831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.269184 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba29ddbd-870a-41f0-9e2b-60f4b4a807ce tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.443250 Oct 04 18:24:40.293641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3650/5150] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:40.397988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.416385 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3f5f4a5e-ae86-45d6-8611-b30d17d42aea tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.402714 Oct 04 18:24:40.422691 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1501/5151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:40 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:41.305078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.306554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:41.309989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:41.323906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.328554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.329182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.329939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.330408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.330845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.444570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.445764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:41.457859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.460180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.461001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.462195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.464656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.465270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.652762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.661697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.668382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.669626 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79f2ebf1-a51d-4a54-8fe9-9a000dbb26d4 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.369128 Oct 04 18:24:41.683917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3651/5152] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:41.912069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.920629 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-085ea832-d732-4d19-bb02-bddc9e226edd tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.482563 Oct 04 18:24:41.932110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1502/5153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:42.259314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeed249-985f-428e-87b2-8b10a3932516", "name": "network-vif-plugged", "status": "completed", "tag": "c2eca3b5-53f7-494f-b389-97deb25b9566"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:42.270239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.271154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.271741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.299287 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] Creating event network-vif-plugged:c2eca3b5-53f7-494f-b389-97deb25b9566 for instance fdeed249-985f-428e-87b2-8b10a3932516 on n-h1-831193-17 Oct 04 18:24:42.313311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-975da219-e0b6-40bc-ba78-80537a890f03 req-e83bd387-9fc3-49ae-ad91-5896f1b8318a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059696 Oct 04 18:24:42.316250 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3652/5154] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:42.700513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.701260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.714883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.715408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.715854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.716578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.720954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.721724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.950260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.951844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.962704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.968146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.968594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.969441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.969908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.970394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.251304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.261584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.266049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.267813 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3dd2aa7a-ee48-4904-9ceb-3bcbb482fe90 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.571908 Oct 04 18:24:43.268998 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1503/5155] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:43.414810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.430355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c62b0650-bf48-4c07-8ddf-e8f3008bc0f5 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1468 microversion: 2.1 time: 0.485214 Oct 04 18:24:43.433257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3653/5156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1468 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:44.298446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.299088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.314600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.315590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.316433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.317387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.317979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.318453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.350206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "name": "network-vif-plugged", "status": "completed", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:44.370936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.371839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.372470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.388756 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] Creating event network-vif-plugged:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:24:44.406382 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8de59eff-9472-4783-8fdd-7bf1f4ec1b03 req-78c8f039-a336-46f4-b2a1-c7f45d17996b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061422 Oct 04 18:24:44.408380 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3654/5157] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:44.457858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.458856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.466530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.467259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.467923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.469716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.498153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.500146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.585816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.602243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.608695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.611125 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6cd89ec-6d3b-4ba8-8400-a240016ae109 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.317248 Oct 04 18:24:44.613795 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1504/5158] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:44.858957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.874181 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-811e0046-605c-4a13-902d-98b683e0a737 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1640 microversion: 2.1 time: 0.423799 Oct 04 18:24:44.875505 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3655/5159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1640 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:44.906988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.908234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.916459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.917597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.918492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.919453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.920162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.920787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.156324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:45.164801 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c94e1fa-d4b8-4cf2-8a78-960ae9f532cf tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1640 microversion: 2.1 time: 0.263352 Oct 04 18:24:45.165906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1505/5160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1640 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:45.188392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:45.189424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:45.208246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.208909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.211586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.212599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.213289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.214032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.643839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:45.644860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:45.693373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.694674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.698619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.699671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.701042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.701922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.077548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.091282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.093041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.094286 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-740ec4bf-1a84-4210-8fa5-0d26e9e45b82 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.459105 Oct 04 18:24:46.107248 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9ea6cc9-a162-4b47-9415-1b33624abf10 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1793 microversion: 2.1 time: 0.921435 Oct 04 18:24:46.108467 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1506/5161] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:45 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:46.111714 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3656/5162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:45 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1793 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:47.123080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.124204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.144583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.145117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.149863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.151752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.153252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.153717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.617787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.628545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.634397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.639819 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-869efd8d-ce9f-4137-ace3-2dd9e974b0ab tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1731 microversion: 2.20 time: 0.521430 Oct 04 18:24:47.640423 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1507/5163] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1731 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:48.674652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.675433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.692347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.693453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.696196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.697045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.699583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.700307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.101287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.114021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.121775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.124593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-93834641-57b4-410f-95e9-f96a40a80762 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1718 microversion: 2.20 time: 0.456149 Oct 04 18:24:49.128985 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3657/5164] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1718 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:49.834246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeed249-985f-428e-87b2-8b10a3932516", "tag": "c2eca3b5-53f7-494f-b389-97deb25b9566"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:49.849723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.855093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.860221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.877020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] Creating event network-changed:c2eca3b5-53f7-494f-b389-97deb25b9566 for instance fdeed249-985f-428e-87b2-8b10a3932516 on n-h1-831193-17 Oct 04 18:24:49.901298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a7409b81-2e7c-4099-8d5c-13e32ecea411 req-43239c43-58c7-499b-9ae3-00613e033c91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070779 Oct 04 18:24:49.902576 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1508/5165] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:18.754200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:18.755909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=77 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:18.761620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:18.765440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:18.783605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.784818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.787787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.788717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.789318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.789888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.887160 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e003760d-5323-4d52-bdf4-7524970dcca0 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.134772 Oct 04 18:25:18.889108 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3658/5166] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 18:25:18 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:18.994456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=29 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:18.995759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=83 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:18.996698 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:25:18.997181 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 (ip 10.222.0.33) !!! Oct 04 18:25:19.013004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:19.013798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.037369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.038994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.046436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.052911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.053513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.054084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.104855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:19.206677 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d0172867-31e2-471a-8a1b-82510aaf84a6 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 204 len: 0 microversion: 2.20 time: 0.214032 Oct 04 18:25:19.208226 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1509/5167] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:25:18 2022] DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:25:19.216408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:19.217031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.228937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.229448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.229890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.236073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.236574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.237023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.532050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.541209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.542886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.544279 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f67b6bac-11a6-4803-9fe0-eb4d38a1c95e tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.331824 Oct 04 18:25:19.545024 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3659/5168] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:19 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:20.573753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:20.574533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:20.601200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.601898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.602567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.604719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.605531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.606270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.162449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.176739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.178182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.179412 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b36c79da-3e3a-46b2-aa49-c64f0485b14a tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1724 microversion: 2.20 time: 0.610878 Oct 04 18:25:21.191680 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1510/5169] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:20 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1724 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:22.205019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:22.205641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:22.215772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.216517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.217176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.218107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.219947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.220590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.421842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.443583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.443583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.460387 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e39a4a3-3068-4aad-86ff-8a7e157e3773 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1656 microversion: 2.20 time: 0.259353 Oct 04 18:25:22.461265 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3660/5170] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:22 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1656 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:23.491659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:23.492436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:23.520779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.521625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.522297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.523322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.524002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.524664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.603083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.603939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.604625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.605335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lazy-loading 'fault' on Instance uuid 0f64b28b-dd20-40df-8214-267d364a05f5 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:23.722993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:23.733686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:23.740252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4a7019401cf4e98a437d334a6a9de2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce667ac90f94299aa0f3a2767614939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:23.741679 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7b40e0dc-ad2f-4d0c-802f-49814741eb70 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 200 len: 1371 microversion: 2.20 time: 0.254218 Oct 04 18:25:23.748080 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3661/5171] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:23 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:23.824964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f64b28b-dd20-40df-8214-267d364a05f5", "name": "network-vif-deleted", "tag": "6c7dfe35-5baf-45f8-a9be-f6b1edfae134"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:23.862882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.863770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.864450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.900122 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] Creating event network-vif-deleted:6c7dfe35-5baf-45f8-a9be-f6b1edfae134 for instance 0f64b28b-dd20-40df-8214-267d364a05f5 on n-h2-831193-17 Oct 04 18:25:23.918809 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0119accd-8ef1-4b30-943c-fb3265ec4125 req-60c99083-fbcf-4eb1-a2d9-c270f95dc881 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579994 Oct 04 18:25:23.921413 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1511/5172] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:24.775387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.777133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:24.794212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.803968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.804664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.807962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.809160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.810064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.881275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 HTTP/1.1 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f64b28b-dd20-40df-8214-267d364a05f5'} Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:24.903724 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:24.908214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:24.910706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:24.911835 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-216546bb-916e-4f0e-83e0-b27d6efe66d3 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 404 len: 111 microversion: 2.20 time: 0.140780 Oct 04 18:25:24.918578 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3662/5173] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:24.925044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6c42f798-1c8a-4c0f-a3b6-065e42a5bd34 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '.version_select at 0x7f6340fb81f0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.965204 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6c42f798-1c8a-4c0f-a3b6-065e42a5bd34 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230996084" status: 204 len: 0 microversion: 2.20 time: 0.044633 Oct 04 18:25:24.969033 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1512/5174] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 18:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230996084 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:25:29.944136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1934558710", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1e360dc4-564b-430f-b38b-eb36f7ba808f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-898471706", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fdeed249-985f-428e-87b2-8b10a3932516"]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:30.042460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] validate_networks() for [('1e360dc4-564b-430f-b38b-eb36f7ba808f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:25:31.989409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:25:31.990575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:25:31.991231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:25:31.991789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:25:31.992352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:25:32.036439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.036935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.042460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.046034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.046697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.047338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.104014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:32.128096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Getting quotas for user b530deb07e924e41bcaf37d92a4c949a and project fe0db8e0240d4b6b81c1ec9cc8d5ce02. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:32.169903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:25:32.172623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:32.305359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-969a6a2d-bb6f-42b5-8ca3-ef8b11d69e6d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.365667 Oct 04 18:25:32.306976 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3663/5175] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:25:29 2022] POST /compute/v2.1/servers => generated 361 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:25:32.318016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ce79f16-b2c2-4f31-868e-6e6e41123aa7 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.320886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ce79f16-b2c2-4f31-868e-6e6e41123aa7 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.461744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.464193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.481037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.484015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.488136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.533028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.533739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.536642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.595283 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 HTTP/1.1 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f64b28b-dd20-40df-8214-267d364a05f5'} Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:32.601698 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.605010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:32.606536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6b16298-7259-435d-bf29-172849d040a2 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 404 len: 111 microversion: 2.20 time: 0.153857 Oct 04 18:25:32.608896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3664/5176] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:25:32 2022] DELETE /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:25:32.624893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.626278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: 0f64b28b-dd20-40df-8214-267d364a05f5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.646795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.648623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.650116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.652729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.655697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.656227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.715294 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 HTTP/1.1 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0f64b28b-dd20-40df-8214-267d364a05f5'} Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.722325 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.725801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance 0f64b28b-dd20-40df-8214-267d364a05f5 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:32.728011 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a2de8641-3325-4f31-bbac-f5dcae3333ff tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5" status: 404 len: 111 microversion: 2.20 time: 0.115814 Oct 04 18:25:32.737963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3665/5177] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/0f64b28b-dd20-40df-8214-267d364a05f5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:32.971387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ce79f16-b2c2-4f31-868e-6e6e41123aa7 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.987723 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ce79f16-b2c2-4f31-868e-6e6e41123aa7 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1241 microversion: 2.1 time: 0.670814 Oct 04 18:25:32.989846 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1513/5178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1241 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:34.012882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:34.013628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:34.026574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.031309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.031906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.033800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.035569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.037526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.467130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.479657 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26808230-c50f-4708-bbd4-7249ff7226a3 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1293 microversion: 2.1 time: 0.472076 Oct 04 18:25:34.480863 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3666/5179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:34 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:35.504518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:35.505143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:35.508692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:35.553426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.553938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.554386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.562699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.566809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.567496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.778396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:35.790100 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31539486-5873-4df3-a308-e578a02e8c28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.290290 Oct 04 18:25:35.803338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1514/5180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:35 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.864423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.019070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:37.029667 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e81461be-ae86-473c-8c88-3f67ecee7d83 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.216336 Oct 04 18:25:37.039299 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3667/5181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:36 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:38.095636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:38.099694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:38.135488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.136075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.136751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.137528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.138016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.138415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.943892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:38.953979 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4fc0a22-ad15-480f-be54-c98830381e35 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.886755 Oct 04 18:25:38.958065 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1515/5182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:38 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:39.981448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:39.982825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:39.996560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.997349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.000721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.001704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.002511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.003188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.448393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:40.459462 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f0c4e5ae-7e69-4ad1-a028-05d9f261c714 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.481822 Oct 04 18:25:40.460652 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3668/5183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:39 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.991770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.992271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.008298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.008802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.016989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.017913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.022277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.022784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.047530 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b HTTP/1.1 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b'} Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:41.049824 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.054157 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.055879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:41.056935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c65518e9-fee4-437b-9a79-7db17b2fd28b tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 404 len: 111 microversion: 2.20 time: 0.069710 Oct 04 18:25:41.057676 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1516/5184] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 18:25:40 2022] DELETE /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:41.066055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:41.066962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] [instance: c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.079338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.082986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.086999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.088918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.094480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.095242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.154149 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] HTTP exception thrown: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Request method failure captured: Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b HTTP/1.1 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHj7UrYCEZ_Uh1Y6sTLYEVsSe-RIFhX761hY96m1ffVT0jniL17PQ3I0fWIU3pJfzNTQxdR0p2036G4acsTs5Dbc7_SJB5HIYmCJtgbnMzN9EFmhQ2I7SuH3CLfsN_L-bLSb8_FpifgEkzxfl-FiQuDv62Sjak_T4KXeTHGDTa33ZWA Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dce667ac90f94299aa0f3a2767614939"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dce667ac90f94299aa0f3a2767614939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: dce667ac90f94299aa0f3a2767614939 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-729181293 Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b4a7019401cf4e98a437d334a6a9de2f Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-AttachVolumeShelveTestJSON-729181293-project Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b'} Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.156254 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. Oct 04 18:25:41.161292 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:25:41.171124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] Returning 404 to user: Instance c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:41.172979 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4b574d3-1e88-436c-80a6-32448a4a1086 tempest-AttachVolumeShelveTestJSON-729181293 tempest-AttachVolumeShelveTestJSON-729181293-project] 10.222.0.33 "GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b" status: 404 len: 111 microversion: 2.20 time: 0.110557 Oct 04 18:25:41.174122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3669/5185] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:41 2022] GET /compute/v2.1/servers/c571bbf7-fe6d-4b4a-88a8-b96d4f365d2b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:41.510304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:41.510856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.542292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.547514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.548000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.557763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.558270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.558754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.626263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73b0e05-a455-46ff-b1ba-0cccb59df36a", "tag": "6855c487-af06-4c80-8c65-a3193cfde29e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:41.642942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.644015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.644461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.703899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] Creating event network-changed:6855c487-af06-4c80-8c65-a3193cfde29e for instance d73b0e05-a455-46ff-b1ba-0cccb59df36a on n-h2-831193-17 Oct 04 18:25:41.711175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-387d0cd8-d8fd-43b5-889f-79527523fb80 req-a586d181-4bc8-4347-8c54-d25244b70105 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088409 Oct 04 18:25:41.714161 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3670/5186] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:41.920834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:41.932227 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5a3877fc-89ad-466a-897a-831783b950c2 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.426253 Oct 04 18:25:41.933211 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1517/5187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:41 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:42.960737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:42.961599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:42.988918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:42.999890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:43.021359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.027286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.032527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.038330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.038956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.039950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.357779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.381517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6219e162-3992-400d-aa2d-ad36855e62c0 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.425554 Oct 04 18:25:43.410543 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3671/5188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:42 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:44.417205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.417712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.420762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:44.436141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.436659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.437107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.439916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.440422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.440857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.048087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:45.067313 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-65550fc5-027a-4ae5-a800-f707d7e2c5fc tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.654099 Oct 04 18:25:45.068577 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1518/5189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:46.100840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.114482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:46.134669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.135367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.135949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.136833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.137775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.138350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.654416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:46.668248 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8655661-7a5f-436e-a45c-4cba9bbfaf62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.573459 Oct 04 18:25:46.670226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3672/5190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:46 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:47.692706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:47.696025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:47.715563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.716566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.717236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.720362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.721171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.722381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.108485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:48.117994 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b857e08e-51c1-4ba3-b042-b6553f642653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.429311 Oct 04 18:25:48.123261 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1519/5191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:47 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:49.145487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:49.146260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:49.148977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:49.163734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.164603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.165267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.166251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.166935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.167624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.181048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=69 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:49.487411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:49.506991 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d511692d-681f-4fab-b480-0bf6892c0f33 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.365313 Oct 04 18:25:49.510633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3673/5192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:49 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:49.531471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73b0e05-a455-46ff-b1ba-0cccb59df36a", "name": "network-vif-plugged", "status": "completed", "tag": "6855c487-af06-4c80-8c65-a3193cfde29e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:49.552053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:49.584161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.585249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.586234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.615254 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] Creating event network-vif-plugged:6855c487-af06-4c80-8c65-a3193cfde29e for instance d73b0e05-a455-46ff-b1ba-0cccb59df36a on n-h2-831193-17 Oct 04 18:25:49.626335 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-223aec1b-7bf0-4505-93c4-1e06f0457e02 req-c7066a9c-1787-44c6-a0db-729c78990131 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369160 Oct 04 18:25:49.627266 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1520/5193] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:50.536295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.536922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.546103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.546612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.547074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.557030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.558109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.558892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.739739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:50.749771 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4792232-ec90-42ec-9e7f-f26418f409b9 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1299 microversion: 2.1 time: 0.217813 Oct 04 18:25:50.767192 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3674/5194] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:51.785813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.787258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.796081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.798158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.798843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.801460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.802270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.802924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.959579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.971150 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f5125c5f-c755-4a67-ab56-f74f66814ae4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1472 microversion: 2.1 time: 0.189361 Oct 04 18:25:51.973025 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1521/5195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.017898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.021918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.037018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.037937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.063408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.066575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.069452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.072199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.259781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:52.275329 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb1f0918-81be-49db-be25-3438635d9088 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1472 microversion: 2.1 time: 0.279492 Oct 04 18:25:52.289365 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3675/5196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.300436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.301158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.312704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.313206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.313654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.314365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.315689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.316134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.480023 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a114a55-81ac-4fa9-9bd0-ded1f11b0ec9 tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1625 microversion: 2.1 time: 0.183679 Oct 04 18:25:52.483655 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1522/5197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1625 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.505125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.506147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.519205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.520236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.521063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.521870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.522338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.522766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.884368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fba18d3-5d14-45aa-b976-43cee4cb82aa tempest-TestSecurityGroupsBasicOps-24229705 tempest-TestSecurityGroupsBasicOps-24229705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1912 microversion: 2.1 time: 0.383384 Oct 04 18:25:52.907465 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3676/5198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1912 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:53.045024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.046102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.078554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.079165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.089987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.090860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.091379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.091815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.203492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:53.418287 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5472b779-de49-40b0-b523-d6b3b739328c tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 204 len: 0 microversion: 2.1 time: 0.378425 Oct 04 18:25:53.419480 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1523/5199] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:53 2022] DELETE /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:53.429434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.430653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.442529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.443435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.445850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.447020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.457558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.458533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.667095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:53.685259 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ef4d74f-2b0b-4e91-99ff-74ec63490ed4 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1478 microversion: 2.1 time: 0.261269 Oct 04 18:25:53.688639 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3677/5200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:53 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1478 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:54.714254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:54.715097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:54.724682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.725282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.725792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.726615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.734501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.736466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.662782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:55.673670 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26a6f2d5-dc6d-4d5f-9cee-0338df37ba9d tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1478 microversion: 2.1 time: 0.965374 Oct 04 18:25:55.682825 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1524/5201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:54 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1478 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:56.706003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:56.706620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:56.729034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.729539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.730334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.733693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.734376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.742156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.022259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:57.037325 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f720c5e5-3cd0-4ef3-9712-b026ca00472f tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1478 microversion: 2.1 time: 0.335263 Oct 04 18:25:57.039253 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3678/5202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:56 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:57.228316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73b0e05-a455-46ff-b1ba-0cccb59df36a", "name": "network-vif-deleted", "tag": "6855c487-af06-4c80-8c65-a3193cfde29e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:57.254751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.263573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.264284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.304631 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] Creating event network-vif-deleted:6855c487-af06-4c80-8c65-a3193cfde29e for instance d73b0e05-a455-46ff-b1ba-0cccb59df36a on n-h2-831193-17 Oct 04 18:25:57.324799 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-45d8d6fc-bb2f-43ea-a13d-d7206f3a5a85 req-13f18b55-6039-4c4c-ac15-afb315d7d46e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100260 Oct 04 18:25:57.326040 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1525/5203] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:58.063945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.064571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.079501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.086652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.087160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.087928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.092864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.098011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.253443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.254137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.254733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.255553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lazy-loading 'fault' on Instance uuid d73b0e05-a455-46ff-b1ba-0cccb59df36a {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:58.391457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:58.399235 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5130c646-ab7b-4af9-bc28-32b5f959e653 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 200 len: 1331 microversion: 2.1 time: 0.341124 Oct 04 18:25:58.404292 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3679/5204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 1331 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:59.426845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:59.428818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: d73b0e05-a455-46ff-b1ba-0cccb59df36a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:59.436969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.437878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.438246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.440551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.443472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.444090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.476926 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] HTTP exception thrown: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Request method failure captured: Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a HTTP/1.1 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHpIXjOwr4nNmS_FVO4W76NbZ5fhrJR7OEKyZhLLaHBDlyp-eeEi23ioZ6h56FnB2qJlMvJQp1NdYyRzAni1lOWqwdCoXnkkmJSO5FUEMjUjClnXe66GHirhFFGtk2s0nC252MfUX-oTI_SrMFsvNVGgePKE-MclzZboPaHlVuSSm88 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: fe0db8e0240d4b6b81c1ec9cc8d5ce02 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: fe0db8e0240d4b6b81c1ec9cc8d5ce02 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestSecurityGroupsBasicOps-204318408-project Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b530deb07e924e41bcaf37d92a4c949a Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestSecurityGroupsBasicOps-204318408-project Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'd73b0e05-a455-46ff-b1ba-0cccb59df36a'} Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:59.478904 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Returning 404 to user: Instance d73b0e05-a455-46ff-b1ba-0cccb59df36a could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c89fa60f-1886-42c2-b20a-8c3f8dfa904e tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a" status: 404 len: 111 microversion: 2.1 time: 0.061977 Oct 04 18:25:59.482689 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1526/5205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:59 2022] GET /compute/v2.1/servers/d73b0e05-a455-46ff-b1ba-0cccb59df36a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:12.418420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.430157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.447728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:12.453180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=43 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:12.457345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.464401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.466253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.469319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.470059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.470800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.495861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeed249-985f-428e-87b2-8b10a3932516", "tag": "c2eca3b5-53f7-494f-b389-97deb25b9566"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:12.519711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:12.531862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:12.564027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.571705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.572407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.632336 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] Creating event network-changed:c2eca3b5-53f7-494f-b389-97deb25b9566 for instance fdeed249-985f-428e-87b2-8b10a3932516 on n-h1-831193-17 Oct 04 18:26:12.649149 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9774114c-ed12-4391-9857-da49f2e2f282 req-fdc80fe7-8c1e-411a-b315-142f9d7783e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156974 Oct 04 18:26:12.650492 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1527/5206] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:12.665472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:12.943612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db6478e2-dd1e-4e8a-8380-3e0928468c65 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 204 len: 0 microversion: 2.1 time: 0.530521 Oct 04 18:26:12.946806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3680/5207] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:12 2022] DELETE /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:26:12.956814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.958453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.979943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.980801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.981564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.982548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.983001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.983480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.385190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.399752 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd7c436c-be7b-454a-8b46-22bee042dc62 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1765 microversion: 2.1 time: 0.448091 Oct 04 18:26:13.403977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1528/5208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:12 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1765 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:14.431737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:14.437191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:14.454419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.465147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.467927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.469287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.475898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.480579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.904076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.914915 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c63bb3a6-c02e-42da-b4fb-0f8be6975352 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1765 microversion: 2.1 time: 0.491174 Oct 04 18:26:14.920044 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3681/5209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:14 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1765 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:15.948604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:15.949261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:15.965234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.965737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.966189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.966911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.967447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.968063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.108583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeed249-985f-428e-87b2-8b10a3932516", "name": "network-vif-deleted", "tag": "c2eca3b5-53f7-494f-b389-97deb25b9566"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:16.136597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.140223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.140877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.197511 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] Creating event network-vif-deleted:c2eca3b5-53f7-494f-b389-97deb25b9566 for instance fdeed249-985f-428e-87b2-8b10a3932516 on n-h1-831193-17 Oct 04 18:26:16.202908 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2bb10a5f-a16e-4bde-b7a1-75a2d1862fbb req-b5b5ddc6-8fcd-4a8b-bd7a-921c4497773b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101210 Oct 04 18:26:16.207877 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3682/5210] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:16.563663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b530deb07e924e41bcaf37d92a4c949a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0db8e0240d4b6b81c1ec9cc8d5ce02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.578840 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-551aa2f7-983b-4360-b63a-fd59862c0e2b tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 200 len: 1647 microversion: 2.1 time: 0.635619 Oct 04 18:26:16.579480 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1529/5211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:15 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 1647 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:16.960267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e4a6f30-e64f-455e-a11d-8cc0bf0b248f tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Action: 'create', calling method: .version_select at 0x7f634017e5e0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1872529390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl5DiHBRhXfUvjXKG8wKPrPYlh39ts2wxOpaxXZRvBQ9fJ98asR29/Wbw8ElQ5PmLvsibb6sSL19r9+sRNrRCLEiLA5/kQ2rIuRK0WedTRzYjJatDGmN3NZEDCMMQL7BA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:17.005067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7e4a6f30-e64f-455e-a11d-8cc0bf0b248f tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Getting quotas for project 652b2baeb5b04d6ba8ad8bd403db7307. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:17.016748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7e4a6f30-e64f-455e-a11d-8cc0bf0b248f tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Getting quotas for user 35cb64b3a03f4052a558692e48107fd1 and project 652b2baeb5b04d6ba8ad8bd403db7307. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:17.083044 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e4a6f30-e64f-455e-a11d-8cc0bf0b248f tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.127799 Oct 04 18:26:17.083690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3683/5212] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:26:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:17.609556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:17.610240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] [instance: fdeed249-985f-428e-87b2-8b10a3932516] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:17.630214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.632346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.634724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.635828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.638331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.639059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.682395 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] HTTP exception thrown: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Request method failure captured: Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 HTTP/1.1 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHpIXjOwr4nNmS_FVO4W76NbZ5fhrJR7OEKyZhLLaHBDlyp-eeEi23ioZ6h56FnB2qJlMvJQp1NdYyRzAni1lOWqwdCoXnkkmJSO5FUEMjUjClnXe66GHirhFFGtk2s0nC252MfUX-oTI_SrMFsvNVGgePKE-MclzZboPaHlVuSSm88 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: fe0db8e0240d4b6b81c1ec9cc8d5ce02 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe0db8e0240d4b6b81c1ec9cc8d5ce02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: fe0db8e0240d4b6b81c1ec9cc8d5ce02 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-204318408 Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestSecurityGroupsBasicOps-204318408-project Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b530deb07e924e41bcaf37d92a4c949a Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestSecurityGroupsBasicOps-204318408-project Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'fdeed249-985f-428e-87b2-8b10a3932516'} Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:17.691865 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Returning 404 to user: Instance fdeed249-985f-428e-87b2-8b10a3932516 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:17.696507 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6bea4f2f-3f7e-4aeb-981e-3ce322bdcf6a tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516" status: 404 len: 111 microversion: 2.1 time: 0.091288 Oct 04 18:26:17.698578 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1530/5213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:17 2022] GET /compute/v2.1/servers/fdeed249-985f-428e-87b2-8b10a3932516 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:20.957608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1932632594", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e3175ef1-e855-4ec0-af22-cacefc6e0f86", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1872529390", "security_groups": [{"name": "tempest-secgroup-smoke-252555811"}], "networks": [{"uuid": "afa8685f-1945-4865-a3ed-6ce1c4d3938f"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:21.367138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] validate_networks() for [('afa8685f-1945-4865-a3ed-6ce1c4d3938f', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:23.615572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:23.616224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:23.616949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:23.617619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:23.618383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:23.640052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.643701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.646884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.649153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.651912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.653878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.708874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Getting quotas for project 652b2baeb5b04d6ba8ad8bd403db7307. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:23.722395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Getting quotas for user 35cb64b3a03f4052a558692e48107fd1 and project 652b2baeb5b04d6ba8ad8bd403db7307. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:23.868236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:23.879356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3175ef1-e855-4ec0-af22-cacefc6e0f86',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:24.218322 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f013d10-a0a7-424d-8df6-ccdfb6541ff1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.275556 Oct 04 18:26:24.242253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c06144d4-d898-4f9f-b1a9-81b8b6787cb4 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:24.243777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c06144d4-d898-4f9f-b1a9-81b8b6787cb4 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:24.248749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3684/5214] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 3307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:26:24.470273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c06144d4-d898-4f9f-b1a9-81b8b6787cb4 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.485417 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c06144d4-d898-4f9f-b1a9-81b8b6787cb4 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1099 microversion: 2.1 time: 0.254020 Oct 04 18:26:24.487243 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1531/5215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:24 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1099 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:25.511722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:25.512341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:25.528003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.528796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.529422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.530163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.530625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.537468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.749734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.774234 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-367f4e79-596a-481f-8fe2-312ff87b2ec6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1149 microversion: 2.1 time: 0.260269 Oct 04 18:26:25.776361 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3685/5216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:25 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1149 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:26.808130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:26.809507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:26.839450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.842519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.843233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.844136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.844754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.845560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.235877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.254861 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c779c7e6-c2e3-401f-ab6c-4862a7dd6cf0 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1215 microversion: 2.1 time: 0.459463 Oct 04 18:26:27.274049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1532/5217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:26 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:28.281843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:28.282457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:28.293568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.303859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.305800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.308340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.309002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.309766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.561185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.572439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f576332-d4fd-45ec-8e5a-62c30625fcf5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1215 microversion: 2.1 time: 0.294538 Oct 04 18:26:28.577991 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3686/5218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:28 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1215 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:29.075358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e5797c5-42bb-4970-b2c2-73499165ac28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] Calling method '.version_select at 0x7f634178c700>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.126879 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e5797c5-42bb-4970-b2c2-73499165ac28 tempest-TestSecurityGroupsBasicOps-204318408 tempest-TestSecurityGroupsBasicOps-204318408-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-898471706" status: 202 len: 0 microversion: 2.1 time: 0.055525 Oct 04 18:26:29.127854 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1533/5219] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-898471706 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:29.601050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.601818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:29.625247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.626136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.629586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.630497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.631140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.636318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.719644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.738578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7babf0b2-118c-4b46-97c1-b1aaee6c0088 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 1.142189 Oct 04 18:26:30.739865 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3687/5220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:31.764245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.768765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.784116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.786908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.787554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.792714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.793397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.794155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.149689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.182800 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6776b5a1-f533-4549-8cf4-be688fb87cb5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.421379 Oct 04 18:26:32.184337 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1534/5221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:32.542932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:32.588896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.604437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.616455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.654468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] Creating event network-changed:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:26:32.666624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f62a7369-033e-4aa1-b84e-b2ebace4f2cd req-8b6f1955-1f0e-463b-b1e0-0468c40dd102 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129235 Oct 04 18:26:32.672391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3688/5222] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:33.225999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:33.227785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:33.260254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.262423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.263355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.264818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.266523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.269530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.667502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.676318 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83ba639e-580b-45b9-bd11-4c608b8625be tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.473332 Oct 04 18:26:33.684355 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1535/5223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:33 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:34.714269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.715400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.718290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:34.720182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:34.737373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.746284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.746921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.747880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.748511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.749149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.053041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.061186 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5faab7e-c7c9-46b2-885b-429f78c6dd87 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.350950 Oct 04 18:26:35.062726 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3689/5224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:34 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:36.088474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.089012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.101540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:36.108263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.110753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.110753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.113473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.115505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.117019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.978389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:36.992688 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f17859d5-c119-416f-a58c-405efbb100fc tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.908145 Oct 04 18:26:36.993291 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1536/5225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:38.022238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.023430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.034394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.042491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.043287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.044204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.044825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.045409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.381854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.411556 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-85c702c8-b056-40ee-a3b2-c9b0855828b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.393417 Oct 04 18:26:38.412922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3690/5226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:39.434185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.434858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.446301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.448056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.448910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.449836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.450551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.451212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.485686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.504952 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-054ffe35-702d-4db6-93f9-1e8d8d5305ee tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 1.074673 Oct 04 18:26:40.508217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1537/5227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:41.534350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:41.534908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:41.566718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.574363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.575121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.576074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.583658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.584304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.045430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.056128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b78520ad-1a63-486f-883f-9fedac17b0b1 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1282 microversion: 2.1 time: 0.527471 Oct 04 18:26:42.071476 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3691/5228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:41 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1282 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:43.086577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.088273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.091435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:43.115653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.116686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.117362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.119172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.120085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.120776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.183246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=47 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:43.804175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.815858 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-01f4c97a-a498-4e07-8ded-4753febf2515 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 0.732589 Oct 04 18:26:43.816628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1538/5229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:44.846813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:44.847484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:44.851166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:44.866771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.873598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.874413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.875743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.876624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.881134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.897360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:45.765094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.784059 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fddd3133-6fe6-43ef-ba2b-74e127753ec3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 0.941865 Oct 04 18:26:45.799679 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3692/5230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:46.809215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:46.810070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:46.829852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.831865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.832329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.833153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.833540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.833966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.519264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:47.538106 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2140d085-2b42-4a72-8836-ed4122690329 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 0.728866 Oct 04 18:26:47.554993 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1539/5231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:46 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:48.565318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:48.565978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:48.617020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.622813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.624578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.629305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.631422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.634433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.163919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:49.182832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eaa6378f-8806-4029-9866-cd5a21a41caa tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 0.621101 Oct 04 18:26:49.187434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3693/5232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:48 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:50.213874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.214744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.236972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.237436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.237879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.238608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.239092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.258775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.386362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.397965 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2c4a198-02cd-40cb-8702-92aa5b130bac tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 1.194609 Oct 04 18:26:51.402212 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1540/5233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:52.427785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:52.429378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:52.443999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.450303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.451229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.452250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.452960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.453655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.474696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.489671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8c5e274-d156-4fde-908c-1294b74ae3fb tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 1.067569 Oct 04 18:26:53.507142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3694/5234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:52 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:54.514003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.514633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.526605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.529591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.530212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.534773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.535890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.536978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.773535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:55.782052 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c2c537f2-242f-4fe4-9a8d-dfa41597845b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 1.272044 Oct 04 18:26:55.801698 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1541/5235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.070818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "name": "network-vif-plugged", "status": "completed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:56.092410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.093433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.094064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.121719 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] Creating event network-vif-plugged:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:26:56.136232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5b3a16de-c050-453a-812d-77ec92b7a607 req-69fa79be-65f0-4886-a2ce-15644ccb759d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070358 Oct 04 18:26:56.144142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3695/5236] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:56.806289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.807682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.831610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.832387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.832970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.833848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.834434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.834984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.572866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.589177 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-57213d79-830f-485e-979b-ac373cca7886 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1270 microversion: 2.1 time: 0.784781 Oct 04 18:26:57.595182 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1542/5237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1270 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:58.621936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:58.622659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:58.636237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.636763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.637213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.642513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.643079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.643551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.109394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:59.127540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66bcc22e-dc46-4d7d-935b-c1dc59387630 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1459 microversion: 2.1 time: 0.507298 Oct 04 18:26:59.128390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3696/5238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1459 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:59.156012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.156728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:59.160274 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:26:59.160446 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed (ip 10.222.0.33) !!! Oct 04 18:26:59.207071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.209104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.209699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.213175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.214378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.214844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.919016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:59.931863 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7baea38-7450-4cc6-810d-23fec22638cf tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1459 microversion: 2.1 time: 0.780281 Oct 04 18:26:59.936917 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1543/5239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:59 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1459 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:05.109010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:05.146173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.146674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.147143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.196522 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] Creating event network-changed:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:27:05.237360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f8a7a294-0dfc-4faa-acb3-182f35e44447 req-45d5b37e-d38c-4095-bc8c-8ffb95075fa3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105288 Oct 04 18:27:05.245689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3697/5240] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:07.649951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ac5163b4-c7b3-470c-9a60-70693777d8e9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Action: 'create', calling method: .version_select at 0x7f634185ca60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-321301216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYsGNrCrBU9xaW/TZ3crAD6ePsFCJtJwxdJR5BM5nwPUuuBiOCDFemN9liojp77D5tE3C5FnVawasc7AaUWmZOJF0Vi13N6CS15CMX/qczMbCP18xpWmuL9AyD5IiO0Rg=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:07.690505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ac5163b4-c7b3-470c-9a60-70693777d8e9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:07.711896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ac5163b4-c7b3-470c-9a60-70693777d8e9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for user 20eb47ef4df541e880698ead286e9c8a and project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:07.785632 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ac5163b4-c7b3-470c-9a60-70693777d8e9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.557615 Oct 04 18:27:07.797613 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1544/5241] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:27:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:10.049391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:10.075913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.079254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.086559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.105868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] Creating event network-changed:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:27:10.123992 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2a47c4fd-e9ae-41f8-83e3-dc5afa27c100 req-e9eb938d-3464-4607-b474-f2c501abb364 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079999 Oct 04 18:27:10.130576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3698/5242] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:12.390153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:12.411323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=35 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:12.415172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.417078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.417863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.433325 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] Creating event network-changed:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:27:12.446499 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-44c5a131-a45a-423a-8de5-51cdbe340fd2 req-c5811489-95e5-4905-994e-09af451d17fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057236 Oct 04 18:27:12.447845 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1545/5243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:13.709730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-533088867", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-321301216", "security_groups": [{"name": "tempest-secgroup-smoke-1105745062"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4d59d6e3-f720-43c9-8da2-016947dc85c4"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:14.392892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] validate_networks() for [('4d59d6e3-f720-43c9-8da2-016947dc85c4', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:27:15.228389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=16 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:16.554248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:16.581066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for user 20eb47ef4df541e880698ead286e9c8a and project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: dict_keys(['metadata_items']) {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:16.618170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:27:16.619815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:27:16.622217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:27:16.624014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:27:16.636037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:27:16.665509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.666182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.666884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.667805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.669498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.671446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.695150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=30 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:16.719845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:16.738865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Getting quotas for user 20eb47ef4df541e880698ead286e9c8a and project 0d8e56786b584dbc8b38aeb768d1d2ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:16.773681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:27:16.793835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:27:16.951594 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed8cfbd4-26f6-4bb5-9ab3-c7d763553866 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.247515 Oct 04 18:27:16.960905 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3699/5244] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:27:16.966218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2de9a29e-e7cd-4a59-b0b3-824510f2df13 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:16.971426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2de9a29e-e7cd-4a59-b0b3-824510f2df13 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:16.975361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:17.116582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2de9a29e-e7cd-4a59-b0b3-824510f2df13 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.128776 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2de9a29e-e7cd-4a59-b0b3-824510f2df13 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1301 microversion: 2.1 time: 0.167731 Oct 04 18:27:17.129755 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1546/5245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:16 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:18.153538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.154884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.171015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.172004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.172879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.174744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.175505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.176278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.335187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.343415 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91b150a0-f19d-4a08-80b6-793c16f36a16 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1305 microversion: 2.1 time: 0.194669 Oct 04 18:27:18.351503 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3700/5246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1305 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:19.380965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.382115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:19.397100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.398157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.398954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.400413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.401318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.402115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.613406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.626393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e7ac0ab2-196e-4714-b1d1-abb5587cf7b2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1359 microversion: 2.1 time: 0.250520 Oct 04 18:27:19.626510 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1547/5247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:20.662973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:20.663964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:20.672208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.672752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.673384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.674114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.674615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.675263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.828665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:20.840919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05d82095-1433-4adc-8608-574d5cd94d0f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1359 microversion: 2.1 time: 0.182946 Oct 04 18:27:20.846818 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3701/5248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:20 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:21.890545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:21.891949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:21.903994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.912774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.915657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.924505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.925498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.927193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.329202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.337832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2e9ae12c-251b-4d89-8caa-4a2ca993f42d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1359 microversion: 2.1 time: 0.451690 Oct 04 18:27:22.338499 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1548/5249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:21 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:23.368367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:23.369156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:23.382684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.384607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.385394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.386435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.389138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.391594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.772292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:23.802443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5b41df8-d2cd-4ad0-a732-352841eea13b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.438182 Oct 04 18:27:23.803951 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3702/5250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:23 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:24.842240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.843701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.851929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.853327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.853327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.854350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.855344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.856065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.582026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:25.590404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b260ff4-e3c4-4b8a-8b00-289226902ec6 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.754429 Oct 04 18:27:25.596398 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1549/5251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:26.621807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:26.623291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.641381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.642641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.643133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.643897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.644371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.644813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.705103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:26.760260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:26.915745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0", "tag": "0583745f-fcd1-44e5-b55f-f32fed5c1e72"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:26.948923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.949406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.951489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.996272 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] Creating event network-changed:0583745f-fcd1-44e5-b55f-f32fed5c1e72 for instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 on n-h1-831193-17 Oct 04 18:27:27.009257 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-30811562-4776-4f80-bc50-c1edbce8dce4 req-ea349929-d25e-41a2-a917-112e47dce063 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097854 Oct 04 18:27:27.012502 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1550/5252] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:27.926693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:27.937752 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-15462d34-9f6e-44ef-9467-8c2e35303fe2 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 1.320032 Oct 04 18:27:27.939686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3703/5253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:26 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:28.961915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:28.969075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:28.972441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:28.982777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.983802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.984403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.994775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.995553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.996812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.825800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:29.837069 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-730edcae-c537-463f-9345-b84d9a22eb1a tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.876017 Oct 04 18:27:29.842236 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1551/5254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:28 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:30.868350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:30.869001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:30.884033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.885772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.886621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.889688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.895247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.901997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.742508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:31.772945 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf61ffaf-26a1-4483-9501-7026a0c2e494 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.909765 Oct 04 18:27:31.774825 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3704/5255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:30 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:32.804131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:32.805411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:32.845714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.848965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.851925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.853087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.854501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.854981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.153529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:33.164904 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7868ac7-accb-4caa-bc11-c484fd97dbda tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.364696 Oct 04 18:27:33.169678 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1552/5256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:32 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:34.194167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:34.194815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:34.217529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.219457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.220678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.223076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.226415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.229645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.678343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.698327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69d1f545-9528-4651-9a32-5cff42881747 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.507615 Oct 04 18:27:34.703298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3705/5257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:34 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:35.574514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0", "name": "network-vif-plugged", "status": "completed", "tag": "0583745f-fcd1-44e5-b55f-f32fed5c1e72"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:35.615575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.621389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.624306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.658629 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] Creating event network-vif-plugged:0583745f-fcd1-44e5-b55f-f32fed5c1e72 for instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 on n-h1-831193-17 Oct 04 18:27:35.676342 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-486e1e6e-c35b-48f1-9280-f1968e6ce9a7 req-156b5fb5-f345-4864-b52e-64239d4da777 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113222 Oct 04 18:27:35.678354 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1553/5258] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:35.760875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:35.768317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.802761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.805075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.805756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.806685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.811249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.812143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.381705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.403490 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80bfffd3-6390-404f-b199-aa6657b0c08b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1427 microversion: 2.1 time: 0.663090 Oct 04 18:27:36.404698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3706/5259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:35 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1427 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:37.434656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:37.435666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.460747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.471010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.475226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.478066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.481446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.482857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:38.093071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.107913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2cda04d-44a0-4bbf-9141-74741b86e91b tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1606 microversion: 2.1 time: 0.679122 Oct 04 18:27:38.108859 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1554/5260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:37 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1606 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:38.132233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:38.132946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:38.144601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:38.147531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:38.148061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:38.148829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:38.154601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:38.155212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.125656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:39.138015 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5b7a767c-ca30-4b12-90a2-230263d10019 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1606 microversion: 2.1 time: 1.010279 Oct 04 18:27:39.139750 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3707/5261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:38 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1606 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:39.163089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:39.164340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:39.172547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.174422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.175062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.175945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.176563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.177173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.807887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:39.817515 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee793c8a-4a08-4514-9609-137bddd7e038 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1606 microversion: 2.1 time: 0.658347 Oct 04 18:27:39.820935 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1555/5262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:39 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1606 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:40.569465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d60168b5-c7f3-4dfc-9fe2-5527580c78d2 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1678035369", "availability_zone": "foo_zone"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:40.583960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.aggregate [None req-d60168b5-c7f3-4dfc-9fe2-5527580c78d2 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Generated uuid 15128c51-9466-4534-84f8-a07604a51a7b for aggregate {{(pid=128770) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:27:40.645566 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d60168b5-c7f3-4dfc-9fe2-5527580c78d2 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.434499 Oct 04 18:27:40.647200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3708/5263] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 18:27:40 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:40.662185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a1ac0e20-057c-401e-a4ca-3ba34a53fb5d tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:40.781003 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a1ac0e20-057c-401e-a4ca-3ba34a53fb5d tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.123630 Oct 04 18:27:40.784241 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1556/5264] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 18:27:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:40.797500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:40.809321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.810726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.812054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:40.813823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.814547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.831726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:40.916869 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c335f31-c311-4693-854b-e26997f78a30 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.125286 Oct 04 18:27:40.922765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3709/5265] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 18:27:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:40.941889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-92aed03b-dfa1-49dc-8292-8e3abcab09ad tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:40.972653 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-92aed03b-dfa1-49dc-8292-8e3abcab09ad tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.029239 Oct 04 18:27:40.983863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1557/5266] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 18:27:40 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:40.996144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce7efc06-13ee-47f8-8f7e-7b8a7ef065c1 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-831193-17"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.028879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7efc06-13ee-47f8-8f7e-7b8a7ef065c1 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.029415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7efc06-13ee-47f8-8f7e-7b8a7ef065c1 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.029864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce7efc06-13ee-47f8-8f7e-7b8a7ef065c1 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.552561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce7efc06-13ee-47f8-8f7e-7b8a7ef065c1 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.558228 Oct 04 18:27:41.560165 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3710/5267] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 18:27:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:41.572708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-07dbb7a6-abc9-4dc7-ae5a-6840a1e223f4 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:41.601461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-07dbb7a6-abc9-4dc7-ae5a-6840a1e223f4 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.028162 Oct 04 18:27:41.602457 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1558/5268] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:27:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:41.615625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ee2245b-6a49-4034-8db4-31d77b941cdf tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1854016069", "availability_zone": "foo_zone"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.792138 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ee2245b-6a49-4034-8db4-31d77b941cdf tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.181456 Oct 04 18:27:41.799220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3711/5269] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 18:27:41 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:41.808704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb0e27d9-5fff-4011-a3ae-3e7de04bfa72 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.831233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:41.831233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:41.842489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.843344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.843960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.845799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.846496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.847159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.889511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:27:41.904459 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb0e27d9-5fff-4011-a3ae-3e7de04bfa72 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.093881 Oct 04 18:27:41.905761 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1559/5270] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 18:27:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:41.925271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.960885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.963159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.963762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.000774 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] Creating event network-changed:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:27:42.023798 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-579a22ed-e827-4885-b377-c3ec67716acf req-a5174bc6-5787-4c43-9177-8d8938ef4a48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108958 Oct 04 18:27:42.027350 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1560/5271] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:42.063003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f2e163f-6814-4dc0-90cb-7059a8195a0c tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.093143 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f2e163f-6814-4dc0-90cb-7059a8195a0c tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.051385 Oct 04 18:27:42.111390 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1561/5272] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 18:27:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:42.123164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7bc2b308-cb47-4b4c-a8a2-8768a23bb463 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-831193-17"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:42.130677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ca36ba4-1cd6-452d-93b6-70e024bbabc7 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 204 len: 0 microversion: 2.1 time: 0.310519 Oct 04 18:27:42.134199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3712/5273] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:41 2022] DELETE /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:27:42.136287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc2b308-cb47-4b4c-a8a2-8768a23bb463 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.136982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc2b308-cb47-4b4c-a8a2-8768a23bb463 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.137946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7bc2b308-cb47-4b4c-a8a2-8768a23bb463 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.154564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.158847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:42.186893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.187630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.188093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.192473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.194871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.196376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.494626 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7bc2b308-cb47-4b4c-a8a2-8768a23bb463 tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.379050 Oct 04 18:27:42.511454 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1562/5274] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 18:27:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:42.518566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c1fce323-7668-4a6a-82fa-9c2a25902c0d tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.586748 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c1fce323-7668-4a6a-82fa-9c2a25902c0d tempest-TestAggregatesBasicOps-196921784 tempest-TestAggregatesBasicOps-196921784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.073451 Oct 04 18:27:42.587942 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1563/5275] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:42 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:27:42.729483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:42.741782 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e465c57-3868-4799-b7e6-2bfae62b1f15 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1587 microversion: 2.1 time: 0.601690 Oct 04 18:27:42.744033 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3713/5276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:42 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1587 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:43.775964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:43.776761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:43.822001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.822895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.823581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.824508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.825127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.849897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.857257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=55 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:45.023186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.049027 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4274b0b8-8e97-4f45-a6b9-b936393486f6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1583 microversion: 2.1 time: 1.280029 Oct 04 18:27:45.064970 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1564/5277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:43 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1583 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:46.075628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:46.076843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:46.079739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.103906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.104437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.104899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.105644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.108406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.111255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.229111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ded77f5-058f-4fe7-bd79-46cfbd8e60ed", "name": "network-vif-deleted", "tag": "38fa072f-2578-4442-85f8-a3ef88e672c5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:47.246605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:47.278228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.281019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.284821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.317265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:47.319658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:47.340859 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dffcadff-f5e0-4f6e-99c8-a935cdd1cfb3 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1583 microversion: 2.1 time: 1.265338 Oct 04 18:27:47.345586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3714/5278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1583 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:47.348330 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] Creating event network-vif-deleted:38fa072f-2578-4442-85f8-a3ef88e672c5 for instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed on n-h2-831193-17 Oct 04 18:27:47.377096 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8c2e356c-6160-41d0-b38f-9a1c7ccc18b4 req-544bf436-030d-4d52-b57a-6f588e582dbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152277 Oct 04 18:27:47.384099 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1565/5279] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:48.371716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.372914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:48.394772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.397300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.399486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.401311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.404549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.405238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.616640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:48.631133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7f73e54-f104-4560-92e8-2c08b2b23971 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1230 microversion: 2.1 time: 0.265752 Oct 04 18:27:48.633515 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3715/5280] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1230 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:49.661656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.663713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:49.689646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.691264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.691723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.695174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.707832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.708654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.906059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0", "tag": "0583745f-fcd1-44e5-b55f-f32fed5c1e72"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.968543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.974300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.975864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.019559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] Creating event network-changed:0583745f-fcd1-44e5-b55f-f32fed5c1e72 for instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 on n-h1-831193-17 Oct 04 18:27:50.032921 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-05d10f80-ca6b-4015-9da7-7848ee4c980d req-4b14190f-10f4-449c-9a4b-c57ecc273c49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128619 Oct 04 18:27:50.034310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3716/5281] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:50.106410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:50.128296 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1c0344c0-8294-4e5a-b4c4-2baab4c5ebda tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1230 microversion: 2.1 time: 0.469387 Oct 04 18:27:50.130899 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1566/5282] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1230 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:51.159608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:51.166470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.167848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.183062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.184782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.187841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.188938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.191185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.192386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.340145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.354242 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bc9b2db6-d9c5-4b41-b4d2-b4fc18b3db13 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1230 microversion: 2.1 time: 0.195469 Oct 04 18:27:51.371061 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3717/5283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1230 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:52.385339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.386101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:52.397657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.398167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.398617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.406029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.406678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.407873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.588147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.603213 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de5fb1b0-15d9-4fb3-9af4-d804ae2795e8 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1230 microversion: 2.1 time: 0.222130 Oct 04 18:27:52.614312 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1567/5284] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1230 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.638157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.638674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.655847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.657997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.659711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.662859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.666929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.667601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.866584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.881762 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61747cdf-7508-44cf-9905-e0cef267aab5 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1230 microversion: 2.1 time: 0.248377 Oct 04 18:27:53.884114 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3718/5285] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1230 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:54.906022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.908071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.936227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.937318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.943168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.945396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.946119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.946971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.029039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.029828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.030385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.030951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lazy-loading 'fault' on Instance uuid 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:27:55.127302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cb64b3a03f4052a558692e48107fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '652b2baeb5b04d6ba8ad8bd403db7307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.137269 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d758543e-3cce-494b-aa15-5c2efc15e24b tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 200 len: 1235 microversion: 2.1 time: 0.236548 Oct 04 18:27:55.143907 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1568/5286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 1235 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.172481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.177718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] [instance: 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:56.192606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.194627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.195777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.198378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.198940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.200214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.244360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] HTTP exception thrown: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Request method failure captured: Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed HTTP/1.1 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHnMxWZpr6G1xUk25h-BvhlAkPjZPUKoP3FEqPD-8_cT70xRXwuupFsVCZo1fzfwWNYEw2uJIKinwA9ycclsbdFlmixc84P0jpp8Oqd-y5ePfG3Eay9LxuIiUSF72ldnnRh9qTi1TDu0Cb4Vks1AKil3RpAF0XwUQ2qJ0C9u03POpTw Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 652b2baeb5b04d6ba8ad8bd403db7307 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBackupRestore-775053982 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/652b2baeb5b04d6ba8ad8bd403db7307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_652b2baeb5b04d6ba8ad8bd403db7307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/652b2baeb5b04d6ba8ad8bd403db7307"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/652b2baeb5b04d6ba8ad8bd403db7307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBackupRestore-775053982 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 652b2baeb5b04d6ba8ad8bd403db7307 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBackupRestore-775053982 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBackupRestore-775053982-project Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 35cb64b3a03f4052a558692e48107fd1 Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBackupRestore-775053982-project Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '4ded77f5-058f-4fe7-bd79-46cfbd8e60ed'} Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:56.249285 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. Oct 04 18:27:56.255763 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:27:56.257928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Returning 404 to user: Instance 4ded77f5-058f-4fe7-bd79-46cfbd8e60ed could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:56.259616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9fdae43c-3a8c-4af8-bcd2-7fb0d87c7bf6 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed" status: 404 len: 111 microversion: 2.1 time: 0.092876 Oct 04 18:27:56.282516 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3719/5287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/servers/4ded77f5-058f-4fe7-bd79-46cfbd8e60ed => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:56.520093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4cdb7386-27a9-4be5-8a94-c948365b7c01 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] Calling method '.version_select at 0x7f6341a27c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.561213 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4cdb7386-27a9-4be5-8a94-c948365b7c01 tempest-TestVolumeBackupRestore-775053982 tempest-TestVolumeBackupRestore-775053982-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1872529390" status: 202 len: 0 microversion: 2.1 time: 0.039390 Oct 04 18:27:56.562771 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1569/5288] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 18:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1872529390 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:16.071660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.072791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.087207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=11 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:16.092149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=23 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:16.093973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.097187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.098849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.101127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.104106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.104814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.176794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37f34c1d-720d-4b68-a3d2-dc2d241d150c tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.109365 Oct 04 18:28:16.183513 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3720/5289] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0/os-server-password => generated 116 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:12.706332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=27 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:12.707104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:12.712529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-267491375", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1e4c0432-d186-46b7-9645-d8a2265c1ca3"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:12.781440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] validate_networks() for [('1e4c0432-d186-46b7-9645-d8a2265c1ca3', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:13.545496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:13.546149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:13.546860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:13.547723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:13.548494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:13.560068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.560556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.561007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.561966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.562731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.563346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.587491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Getting quotas for project 37d50c0176ac4cd9b90c09a768b730f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:13.596386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Getting quotas for user fe64706585194ec1a743552852ed58b8 and project 37d50c0176ac4cd9b90c09a768b730f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:13.620465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:13.624843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:13.684914 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-236a8e59-8a43-47ef-921a-adc151a00524 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980996 Oct 04 18:29:13.686438 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1570/5290] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:13.704356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55d31d04-8dc8-4e52-9e47-2a0e3a75cb9c tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.705655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55d31d04-8dc8-4e52-9e47-2a0e3a75cb9c tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.711524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:13.713147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:13.961639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55d31d04-8dc8-4e52-9e47-2a0e3a75cb9c tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:13.974481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55d31d04-8dc8-4e52-9e47-2a0e3a75cb9c tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1213 microversion: 2.1 time: 0.279414 Oct 04 18:29:13.975807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3721/5291] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1213 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:14.999964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:15.000570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:15.008422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.009508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.010225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.011073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.011607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.012489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.091460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:15.101251 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-85cd7039-b970-4456-9454-10df3ad28422 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1265 microversion: 2.1 time: 0.106960 Oct 04 18:29:15.115649 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1571/5292] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:14 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:16.130148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.131440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:16.141286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.141916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.142815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.143644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.144459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.145098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.450032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:16.467275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40de718e-1d20-4496-b8a3-0afbabba85f6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.340545 Oct 04 18:29:16.468871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3722/5293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:17.491006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.491657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.499533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.500396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.500868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.501847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.502418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.502902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.848775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:17.857811 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba11aae7-143a-492b-9cd6-36e8d1c270ab tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.371259 Oct 04 18:29:17.858402 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1572/5294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:18.280037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c502626d-0ded-4b43-9a89-e4d10762e778", "tag": "5201c263-9d73-4b88-b782-e56a91dde380"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:18.297173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.297660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.298095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.310842 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] Creating event network-changed:5201c263-9d73-4b88-b782-e56a91dde380 for instance c502626d-0ded-4b43-9a89-e4d10762e778 on n-h2-831193-17 Oct 04 18:29:18.324084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bf4f4d97-6a9e-4f01-b9b9-7ec4966a3326 req-3fb01d9e-4767-48bd-b945-5ce6d23fe129 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048173 Oct 04 18:29:18.325596 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3723/5295] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:18.881779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.882498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:18.889832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.890966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.891774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.892698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.896282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.896852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.122157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.130451 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e1809f22-bf6e-481b-b3fe-72b315e7ddf2 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.252734 Oct 04 18:29:19.131064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1573/5296] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:20.157091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:20.158805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:20.166625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.167582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.168529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.169482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.170242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.170797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.395049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:20.404489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72e6ea02-30e5-46da-89ff-8ab708e32fa0 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.254243 Oct 04 18:29:20.421316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3724/5297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:20 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:21.429371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.430785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.439314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.440027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.440480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.441222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.441874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.442319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.722971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:21.738944 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8f91dd3f-20b2-447a-8b4c-96affbbf3ea5 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.310227 Oct 04 18:29:21.739798 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1574/5298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:22.765121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.765837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.778599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.779431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.780356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.781722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.782809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.783521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.953691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.962569 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-02998360-0ca6-492d-b74f-25e0c9ca0c95 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.202629 Oct 04 18:29:22.963415 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3725/5299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:23.763566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c502626d-0ded-4b43-9a89-e4d10762e778", "name": "network-vif-plugged", "status": "completed", "tag": "5201c263-9d73-4b88-b782-e56a91dde380"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:23.769443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:23.770049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:23.792589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.793089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.793535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.806142 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] Creating event network-vif-plugged:5201c263-9d73-4b88-b782-e56a91dde380 for instance c502626d-0ded-4b43-9a89-e4d10762e778 on n-h2-831193-17 Oct 04 18:29:23.812039 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-29db95a1-a6fd-4e36-bb97-32934c4c917e req-aa06366a-ab70-46d8-ab54-bb0ba79cc299 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052386 Oct 04 18:29:23.813302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1575/5300] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:23.989266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:23.991376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:23.996303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:24.002794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.003448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.003977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.004904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.005478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.005993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.154606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.163763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c19f65a0-dc16-4500-aff2-9a2911a505f4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1313 microversion: 2.1 time: 0.181413 Oct 04 18:29:24.164653 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3726/5301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:23 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.195912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.198623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.205639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.206393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.206939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.207771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.208478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.209198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.354830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:25.363519 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d80b71e5-1578-4e99-83e9-d6e96477e5be tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1497 microversion: 2.1 time: 0.181113 Oct 04 18:29:25.379061 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1576/5302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.840981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.842495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.852595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.853148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.853801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.854682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.855458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.855904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.883804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:25.978600 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63cd88a8-c7e6-49ed-b37d-a920f3cfc729 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 204 len: 0 microversion: 2.1 time: 0.144763 Oct 04 18:29:25.979592 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3727/5303] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:25 2022] DELETE /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:25.989278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.990180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.999862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.000616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.001233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.002183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.002851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.003824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.161571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.170346 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-873286df-300a-4a0d-a55c-25286c3f5235 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1503 microversion: 2.1 time: 0.185172 Oct 04 18:29:26.170947 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1577/5304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.194450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.195800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.206254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.206753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.207404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.208376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.208743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.209172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.507023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.521468 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-64351151-eac8-41db-a542-99a8c1a2673a tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 200 len: 1503 microversion: 2.1 time: 0.331697 Oct 04 18:29:27.538239 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3728/5305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.818062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c502626d-0ded-4b43-9a89-e4d10762e778", "name": "network-vif-deleted", "tag": "5201c263-9d73-4b88-b782-e56a91dde380"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:27.833185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.834159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.834780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.868034 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] Creating event network-vif-deleted:5201c263-9d73-4b88-b782-e56a91dde380 for instance c502626d-0ded-4b43-9a89-e4d10762e778 on n-h2-831193-17 Oct 04 18:29:27.873637 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-d87dbc34-258c-48e1-8aa1-1ceddc25d0b4 req-28fc2250-3c3e-499c-8042-626563a57530 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060288 Oct 04 18:29:27.875528 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1578/5306] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.548258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.549588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: c502626d-0ded-4b43-9a89-e4d10762e778] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.557320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.558153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.558884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.559622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.560109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.560542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.576995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] HTTP exception thrown: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Request method failure captured: Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 HTTP/1.1 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHt2KDgrwkiwnngaxRLzJhMl8GedXqCGQXzLt6JhSeKF1pWoF5rwHVfD7ZPRl_bfp7u5T0vugIYNiaEG3YLwsk-emKMUhZnbFTR8rI33o9_SBB7xA-VtydqrwLSgVPsPWCE5SNJ7fieqfId75QpMBUk-eDqdMTaXkO3tU4revZ6nSEA Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 37d50c0176ac4cd9b90c09a768b730f6 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-VolumesActionsTest-450729671 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-VolumesActionsTest-450729671 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 37d50c0176ac4cd9b90c09a768b730f6 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-VolumesActionsTest-450729671 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-VolumesActionsTest-450729671-project Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: fe64706585194ec1a743552852ed58b8 Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-VolumesActionsTest-450729671-project Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c502626d-0ded-4b43-9a89-e4d10762e778'} Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:28.579157 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Returning 404 to user: Instance c502626d-0ded-4b43-9a89-e4d10762e778 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-671c4a35-2551-4699-8146-501993d97c47 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778" status: 404 len: 111 microversion: 2.1 time: 0.037764 Oct 04 18:29:28.595894 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3729/5307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/c502626d-0ded-4b43-9a89-e4d10762e778 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:28.722814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1689455894", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1e4c0432-d186-46b7-9645-d8a2265c1ca3"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:28.789607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] validate_networks() for [('1e4c0432-d186-46b7-9645-d8a2265c1ca3', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:29.191918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:29.192499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:29.193055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:29.193811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:29.194297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:29.211249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.212521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.213359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.214292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.214944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.215738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.239396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Getting quotas for project 37d50c0176ac4cd9b90c09a768b730f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:29.246424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Getting quotas for user fe64706585194ec1a743552852ed58b8 and project 37d50c0176ac4cd9b90c09a768b730f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:29.263334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:29.266524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:29.317560 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c20fcf1e-98c3-4f6b-bca5-d188603c267b tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599342 Oct 04 18:29:29.318423 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1579/5308] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:29:29.329146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c171fd5-14c3-4db2-8e05-580d4f067352 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.330012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c171fd5-14c3-4db2-8e05-580d4f067352 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.398982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c171fd5-14c3-4db2-8e05-580d4f067352 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.408676 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c171fd5-14c3-4db2-8e05-580d4f067352 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1214 microversion: 2.1 time: 0.083302 Oct 04 18:29:29.410109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3730/5309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:30.434060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.434703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.443934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.444714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.445320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.446195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.446831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.447516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.551596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:30.561120 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f5bee1d-2cd2-4147-a007-331c27c7ed30 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1266 microversion: 2.1 time: 0.131707 Oct 04 18:29:30.562845 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1580/5310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.589412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.589868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.597805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.598574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.599238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.600126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.600753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.601389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.931997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.941484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc1ca3b4-16a6-4ad6-8b74-b37f9529f0b4 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.356907 Oct 04 18:29:31.942892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3731/5311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:32.400565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29908770-294a-4a65-b720-685646fa3d42", "tag": "c224c074-6555-4cde-be30-a95c3f660a83"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:32.436401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.439239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.440125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.456790 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] Creating event network-changed:c224c074-6555-4cde-be30-a95c3f660a83 for instance 29908770-294a-4a65-b720-685646fa3d42 on n-h2-831193-17 Oct 04 18:29:32.462762 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c7492842-9272-402b-abf2-aa1e3ebc4798 req-533ffc55-b552-4c40-8685-961a95292877 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066600 Oct 04 18:29:32.464153 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1581/5312] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:32.965443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.966071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.973749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.974248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.974693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.975437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.975901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.976362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.177251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:33.198465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-72003041-2ab2-4db0-874a-4353338caa7e tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.236935 Oct 04 18:29:33.217084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3732/5313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:34.226732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:34.227667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:34.237612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.238497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.246206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.252643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.253439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.254278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.424716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:34.439781 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-768d9228-86d0-471a-9da3-37a19ed56851 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.218066 Oct 04 18:29:34.452722 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1582/5314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:34 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:35.465393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:35.466651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:35.475790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.476527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.477138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.478179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.479100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.479940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.694348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:35.706990 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-822272e4-affa-4c64-ba63-766749800c25 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.243028 Oct 04 18:29:35.710283 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3733/5315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:35 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:36.732756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.734642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:36.743082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.743955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.744706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.746694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.747196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.747862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.954157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:36.964196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f82bbda4-1a2b-4ad5-94bf-1ead9fa94d4f tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.235214 Oct 04 18:29:36.980045 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1583/5316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:37.994133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.994909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.008165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.008663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.009260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.010590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.011788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.012509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.138607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29908770-294a-4a65-b720-685646fa3d42", "name": "network-vif-plugged", "status": "completed", "tag": "c224c074-6555-4cde-be30-a95c3f660a83"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:38.152126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.152586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.153372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.172786 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] Creating event network-vif-plugged:c224c074-6555-4cde-be30-a95c3f660a83 for instance 29908770-294a-4a65-b720-685646fa3d42 on n-h2-831193-17 Oct 04 18:29:38.184208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3c07a6e1-2b89-477d-8416-843c2ffa24e4 req-1128b7e2-25ae-4af2-8f3b-aa53c7a4e0a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049898 Oct 04 18:29:38.200394 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1584/5317] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:38.406921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:38.419538 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34918de8-93eb-453b-8f07-3d82ee80be6d tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.431659 Oct 04 18:29:38.420526 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3734/5318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.464114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.465524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:39.472740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:39.474118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:39.475815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.476314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.476760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.477474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.478257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.478858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.649649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:39.659791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-52476821-9e63-49e2-92fc-f47999195ca3 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1314 microversion: 2.1 time: 0.204861 Oct 04 18:29:39.660987 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1585/5319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:40.688731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.689137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.705231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:40.706875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.707463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.707848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.708619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.709048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.709483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.987626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:41.001174 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ca8374d-770b-4acd-b126-760a796a1788 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1499 microversion: 2.1 time: 0.316691 Oct 04 18:29:41.017736 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3735/5320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1499 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:41.810723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.814855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.820722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.821393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.822246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.825595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.826352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.828091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.862725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:41.968728 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee9ca1ad-c9cd-4794-bf0f-8b993bb1aea6 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 204 len: 0 microversion: 2.1 time: 0.161817 Oct 04 18:29:41.970006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1586/5321] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:41 2022] DELETE /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:41.978244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.979583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.987684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.988489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.989098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.989970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.990428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.991021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.197390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.205306 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a233bb0-9b6e-4b66-8b30-0282c9701473 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1505 microversion: 2.1 time: 0.230867 Oct 04 18:29:42.206449 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3736/5322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.232309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.233647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.236912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:43.242859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.243684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.244633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.245550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.246177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.246825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.267523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:43.556663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64706585194ec1a743552852ed58b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d50c0176ac4cd9b90c09a768b730f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.566196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82dcade4-487c-45ee-a37a-3ad2c47e7412 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 200 len: 1505 microversion: 2.1 time: 0.338285 Oct 04 18:29:43.566882 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1587/5323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:44.093229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29908770-294a-4a65-b720-685646fa3d42", "name": "network-vif-deleted", "tag": "c224c074-6555-4cde-be30-a95c3f660a83"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:44.101256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:44.105523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.106164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.106706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.112293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:44.121886 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] Creating event network-vif-deleted:c224c074-6555-4cde-be30-a95c3f660a83 for instance 29908770-294a-4a65-b720-685646fa3d42 on n-h2-831193-17 Oct 04 18:29:44.128472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ce7c3602-35e5-46d5-b0c1-84460c58d365 req-f2ba5284-f2bb-4c0e-897f-8b0bb491ee2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039214 Oct 04 18:29:44.129281 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3737/5324] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:44.590810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.592035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] [instance: 29908770-294a-4a65-b720-685646fa3d42] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.599582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.600214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.600869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.601587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.602044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.602470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.617662 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] HTTP exception thrown: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Request method failure captured: Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 HTTP/1.1 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHt2KDgrwkiwnngaxRLzJhMl8GedXqCGQXzLt6JhSeKF1pWoF5rwHVfD7ZPRl_bfp7u5T0vugIYNiaEG3YLwsk-emKMUhZnbFTR8rI33o9_SBB7xA-VtydqrwLSgVPsPWCE5SNJ7fieqfId75QpMBUk-eDqdMTaXkO3tU4revZ6nSEA Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 37d50c0176ac4cd9b90c09a768b730f6 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesActionsTest-450729671 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37d50c0176ac4cd9b90c09a768b730f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesActionsTest-450729671 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 37d50c0176ac4cd9b90c09a768b730f6 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesActionsTest-450729671 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesActionsTest-450729671-project Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: fe64706585194ec1a743552852ed58b8 Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesActionsTest-450729671-project Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '29908770-294a-4a65-b720-685646fa3d42'} Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:44.619807 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] Returning 404 to user: Instance 29908770-294a-4a65-b720-685646fa3d42 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-107ad943-2e70-4364-80df-674d0f08bf33 tempest-VolumesActionsTest-450729671 tempest-VolumesActionsTest-450729671-project] 10.222.0.33 "GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42" status: 404 len: 111 microversion: 2.1 time: 0.035043 Oct 04 18:29:44.625273 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1588/5325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/29908770-294a-4a65-b720-685646fa3d42 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:27.701052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.947660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: .version_select at 0x7f633bfc2670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-166549797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT5Eo+X2BfkGQiQrbgNEZ8COqsGUe/zT3Q2W3e3AseTt2fTpH0EBNWHm9il809vq5vUp7PHMx+sm+UqYK4ZfBw8vD4vEsyovWWZlmRKgV6BajKnWJ8Y00C75vIhdoRLxA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:27.972082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:27.982858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:28.006648 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:30:29.019528 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 52432. Oct 04 18:30:29.043295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-102e1f1f-70bd-4291-ad8a-3593c356c500 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.361919 Oct 04 18:30:29.044023 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3738/5326] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:30:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:38.408431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1735716310", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "eedbb677-4921-44a7-85d4-6394e001557b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-166549797", "security_groups": [{"name": "tempest-secgroup-smoke-273093159"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:38.429545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:38.431002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:39.118826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] validate_networks() for [('eedbb677-4921-44a7-85d4-6394e001557b', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:39.997207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:39.997767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:39.998711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:39.999173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:39.999770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:40.017286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.022806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.023609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.024739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.025475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.026153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.080763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:40.090179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:40.122943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:40.128572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:40.226322 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b9d7a1e-02e7-42cc-b5b7-2d3c08a496ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.826163 Oct 04 18:30:40.230165 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1589/5327] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:40.238710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:40.240070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:40.241435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:40.245463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-141cef95-ecba-4fa4-8146-d125f794cc89 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.246224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-141cef95-ecba-4fa4-8146-d125f794cc89 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.364690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-141cef95-ecba-4fa4-8146-d125f794cc89 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.379141 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-141cef95-ecba-4fa4-8146-d125f794cc89 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1266 microversion: 2.1 time: 0.141904 Oct 04 18:30:40.380321 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3739/5328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:41.408575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:41.409273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:41.424121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.424121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.424487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.454772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.455490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.456927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.620375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.632950 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8736340d-c0d1-4ef7-b398-5b825b600f9c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1318 microversion: 2.1 time: 0.233839 Oct 04 18:30:41.652200 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1590/5329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:41 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.659455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.660035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.677235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.682897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.687761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.688697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.691275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.696788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.920441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.928527 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8976b128-f374-4462-b38a-38e3c5923e95 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1324 microversion: 2.1 time: 0.274515 Oct 04 18:30:42.929331 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3740/5330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.959168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.960840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.968853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.969746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.970414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.971416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.972891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.973962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.272507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.284414 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-25227cba-4f6e-496e-928a-beaf88cdab75 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.329444 Oct 04 18:30:44.284414 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1591/5331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.307221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.308686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.322668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.323210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.323654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.337664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.338173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.338627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.760882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:45.785254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.795310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.796279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.820999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.824777 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] Creating event network-changed:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h2-831193-17 Oct 04 18:30:45.835812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6a8734f-311f-4e29-92a5-e5fccf34822e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.533023 Oct 04 18:30:45.838945 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3741/5332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.839697 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-238b61df-f49e-4d79-aa7e-7f4fd57eb0e8 req-1b6c429f-f654-486d-ae85-49a9f992c0e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.431217 Oct 04 18:30:45.842301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1592/5333] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:46.861203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.861931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.869292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.870005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.870442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.871180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.871638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.872065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.120845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.129828 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0755985-6626-4351-a5f0-13013854a23a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.272772 Oct 04 18:30:47.130761 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3742/5334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.155909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.156769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.163387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.164191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.164743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.165572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.166141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.166667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.396864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.406613 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8bb89411-ceaf-4629-a59b-755e4bcc598f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.256445 Oct 04 18:30:48.407736 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1593/5335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.432504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.433140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.442279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.442696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.443175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.444120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.444588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.445028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.642003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.650175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7bcdf5d1-ca5e-4f05-adbc-6741b84b458f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.222750 Oct 04 18:30:49.650858 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3743/5336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.674295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.675463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.678552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:50.679483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:50.685750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.686462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.687114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.687842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.688344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.688787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.853096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.864444 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bfeb5a34-d562-4c93-a874-f55b796ee085 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.193903 Oct 04 18:30:50.865014 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1594/5337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:51.889663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.890444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.897109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:51.899948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.900625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.901063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.901767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.902395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.902690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.063959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.073843 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18b9ab5a-420f-4017-94b5-d0225dd1c931 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.188766 Oct 04 18:30:52.089345 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3744/5338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.297443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "name": "network-vif-plugged", "status": "completed", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:52.309615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.310195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.310996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.323982 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] Creating event network-vif-plugged:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h2-831193-17 Oct 04 18:30:52.329382 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2f9fa156-bd3a-44ea-99f6-f73abaec80bd req-78d5c459-5bef-4691-b604-8a1ccde1a16c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244765 Oct 04 18:30:52.330037 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1595/5339] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:53.098674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.099454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.106929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.107539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.108060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.108834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.109395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.109891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.269328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.279465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c6c6fa8e-5110-4a1f-bbad-8428f499bdd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1391 microversion: 2.1 time: 0.184366 Oct 04 18:30:53.280829 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3745/5340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.303811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.305164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.311888 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:30:54.312341 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b (ip 10.222.0.33) !!! Oct 04 18:30:54.319493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.320272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.321118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.322038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.322677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.323199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.489008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.511295 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-95677837-546e-4a30-99c2-d73f4bdb884f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1563 microversion: 2.1 time: 0.211502 Oct 04 18:30:54.511906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1596/5341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.537314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.537877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.540564 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:30:54.540720 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 18:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b (ip 10.222.0.33) !!! Oct 04 18:30:54.557148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.559419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.561226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.564970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.565799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.566621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.792536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.807184 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-53bc81ac-281a-459c-b0f8-9b0730acdddc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1563 microversion: 2.1 time: 0.273419 Oct 04 18:30:54.809467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3746/5342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1563 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.056917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.057631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.069668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.070239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.071062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.071511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.071990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.072555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.208738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:57.220737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.221386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.221609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.222054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.230821 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0450d3a6-4068-4d8e-9668-f244a25c9eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1563 microversion: 2.1 time: 0.178192 Oct 04 18:30:57.231436 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1597/5343] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:57 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.238885 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] Creating event network-changed:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h2-831193-17 Oct 04 18:30:57.244128 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-625546c2-8a1f-42b1-be24-0a580a4cf78c req-285e7d7e-352d-47cc-bf72-c025f0d45a41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188179 Oct 04 18:30:57.245074 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3747/5344] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:18.524283 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:18.526772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.529747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:18.530673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=42 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:18.538498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.539096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.539751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.540474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.540937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.541386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.607964 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e9830da6-3852-4488-90e3-df118a8b9288 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.087839 Oct 04 18:31:18.610044 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1598/5345] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:18 2022] POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action => generated 24573 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:24.974233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.975016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.978331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=20 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:24.979108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=44 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:24.984783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.985545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.986195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.987108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.987733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.988333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.242109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3487ca4d-10f0-4e50-966b-e4bcb49d24e4 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1835 microversion: 2.1 time: 0.274313 Oct 04 18:31:25.242710 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3748/5346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1835 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.266507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.267273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.275122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.275915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.276428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.277149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.277614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.278053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.439535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.451013 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c94e58e3-848f-47a7-87fd-70a8171e13f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1682 microversion: 2.1 time: 0.189397 Oct 04 18:31:25.451997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1599/5347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.553488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.555777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.562527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.563058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.563502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.564227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.564686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.565122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.616424 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50837eaf-a8c5-40c8-b9c8-aacb250adf77 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action" status: 200 len: 32642 microversion: 2.1 time: 0.066614 Oct 04 18:31:25.617122 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3749/5348] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action => generated 32642 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:25.715698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1777742248", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.773602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:25.823375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.825208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.832690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.833258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.833762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.834538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.835084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.835517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.016107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0169195eb2394144851032de2c74896b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c83570f6a24e46bc548138e7f66182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.016896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] flavor_id is None. Assuming migration. {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:31:26.017598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:31:26.079524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:26.079950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:26.080421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:26.080829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:26.081237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:26.092134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.092829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.093344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.094210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.094818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.095403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.115600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Getting quotas for project a9ce0ad7b1f343eea8f613013b904a65. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:26.122214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Getting quotas for user bc86f273cd944bfaa6998e1ab5819ad4 and project a9ce0ad7b1f343eea8f613013b904a65. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:26.136313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:26.138651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:26.143358 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8725cfbb-39fa-4bc0-acfc-c54bff661643 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action" status: 202 len: 0 microversion: 2.1 time: 0.324919 Oct 04 18:31:26.147504 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3750/5349] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:26.153291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.153963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.161953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.161953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.162294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.162954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.163435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.163864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.192203 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee20ce2a-0c04-433c-85e9-485bcdebfb05 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480754 Oct 04 18:31:26.192865 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1600/5350] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:26.204514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-48d2c123-e802-4005-9ae6-d65c637adc5b tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.205636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-48d2c123-e802-4005-9ae6-d65c637adc5b tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.293341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48d2c123-e802-4005-9ae6-d65c637adc5b tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.301441 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-48d2c123-e802-4005-9ae6-d65c637adc5b tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1215 microversion: 2.1 time: 0.101116 Oct 04 18:31:26.302025 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1601/5351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.360570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.371878 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea1c89c4-e91e-46cb-9771-d112ec1803b5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1691 microversion: 2.1 time: 0.223053 Oct 04 18:31:26.386291 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3751/5352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:27.328685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.329310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.340420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.341011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.341577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.342197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.342771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.343235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.396902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.398048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.407936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.409016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.409454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.410416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.410986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.412304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.421481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.422109 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54d4d740-c9bd-4ca8-83c8-4b0c02e2d6e3 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1267 microversion: 2.1 time: 0.097652 Oct 04 18:31:27.423020 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1602/5353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:27.596174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.605299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fff18058-6c12-422e-ae7b-0a598a5bf6c2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1691 microversion: 2.1 time: 0.212666 Oct 04 18:31:27.623987 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3752/5354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:28.445720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.446306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.454315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.454762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.455243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.455963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.456424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.456854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.540181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.549355 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e2dc602-6d3c-4f87-9a49-be72a95fb475 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1273 microversion: 2.1 time: 0.107853 Oct 04 18:31:28.549948 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1603/5355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.635334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.635964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.643446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.643935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.644370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.645079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.645537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.645963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.982385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.993300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-93542afa-aa42-4601-85b4-b02e69c5e002 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1691 microversion: 2.1 time: 0.361504 Oct 04 18:31:28.994214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3753/5356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1691 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:29.574671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.576262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.583467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.583971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.584500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.585229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.585655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.586086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.786517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.795010 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ceed934c-ab19-4df5-80f9-192613829c48 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.224865 Oct 04 18:31:29.795916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1604/5357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.824777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb6b4033-f230-45be-bb03-3e789201cc1c", "tag": "87d66c5c-8910-4c2a-b11b-ce358cea23af"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:29.835852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.836332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.836766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.853118 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] Creating event network-changed:87d66c5c-8910-4c2a-b11b-ce358cea23af for instance bb6b4033-f230-45be-bb03-3e789201cc1c on n-h2-831193-17 Oct 04 18:31:29.860901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e5bac37f-0fc6-4f00-99e5-f20e9e12c71f req-0b8e26e6-a096-4ff9-b3e9-0dd6da1526bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040370 Oct 04 18:31:29.861930 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3754/5358] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.018048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.018741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.025147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.025665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.026088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.026801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.027308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.027743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.243228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.251818 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2aafa4c-c4a4-461f-9241-c00bc406d005 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.237680 Oct 04 18:31:30.252405 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1605/5359] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.818635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.819371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.826403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.826976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.827340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.828050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.828502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.828924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.970499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.978318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06b7eaa8-e7b0-4896-b999-874e77d28a76 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.163884 Oct 04 18:31:30.978897 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3755/5360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:31.276754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.278309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.285398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.286011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.286554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.287330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.287921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.288348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.503444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.512523 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6e924480-eb03-4873-acb9-554d93dc73d5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.239652 Oct 04 18:31:31.513116 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1606/5361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.002758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.003573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.011428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.012579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.013193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.013941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.014416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.014979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.161998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.169969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dbeb9b3c-289e-401e-b9d2-6dd3b5af83e4 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.171886 Oct 04 18:31:32.170550 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3756/5362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.537583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.538205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.545623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.546112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.546552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.547297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.547752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.548183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.685035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.693292 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16fd203c-0ba2-4163-b15c-54106143c2a0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.159619 Oct 04 18:31:32.693868 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1607/5363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.192475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.193101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.200804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.201320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.201741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.202456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.202916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.203379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.337984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.347928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f059b671-b486-4bff-b529-fe99f14d409e tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.159371 Oct 04 18:31:33.348648 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3757/5364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.721199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.721869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.728927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.729440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.729867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.730561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.731208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.731643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.872618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.880501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-357634a6-a267-4536-b783-e1f428fc6707 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.163327 Oct 04 18:31:33.881078 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1608/5365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:34.373096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.373711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.380623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.381112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.381577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.382292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.382752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.383225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.519696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.527617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-074a5db1-0d9c-4414-8b76-118536d420b8 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.158989 Oct 04 18:31:34.535732 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3758/5366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:34.904337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.905142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.912177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.912666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.913106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.913853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.914315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.914746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.061258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.070048 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9cf1ac8-2aec-4954-9694-44c78741c3b4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.170133 Oct 04 18:31:35.070877 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1609/5367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.551350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.552033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.559916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.560418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.560860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.561571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.562032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.562464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.700769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.708658 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-551637f7-99cc-496c-9499-f6998861057f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.161290 Oct 04 18:31:35.709246 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3759/5368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:36.094314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.094866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.102160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.102651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.103376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.104221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.104730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.105260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.106467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:36.257585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.262242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6b4033-f230-45be-bb03-3e789201cc1c", "name": "network-vif-plugged", "status": "completed", "tag": "87d66c5c-8910-4c2a-b11b-ce358cea23af"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:36.266278 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-670b9a03-5133-4bb8-a16e-e3154307fb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.176326 Oct 04 18:31:36.266858 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1610/5369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.276176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.276654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.277277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.289166 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] Creating event network-vif-plugged:87d66c5c-8910-4c2a-b11b-ce358cea23af for instance bb6b4033-f230-45be-bb03-3e789201cc1c on n-h2-831193-17 Oct 04 18:31:36.294823 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a47ed5ef-bcfc-48ca-b7b0-09db8fd6111e req-3a06c89f-6a95-4ba0-8115-3782deb408c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037443 Oct 04 18:31:36.295538 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3760/5370] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:36.731082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.731701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.733578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:36.739281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.739771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.740297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.740930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.741379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.741808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.922925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.933937 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a0edcdf4-45bb-4f0a-8f76-75b8c3871ea0 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1315 microversion: 2.1 time: 0.206498 Oct 04 18:31:36.934664 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1611/5371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.299482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.300190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.309822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.310325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.310771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.311529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.311990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.312420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.456639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.464877 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ed2a07fe-87e3-4ec3-bcac-23a7d327d172 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.170395 Oct 04 18:31:37.465475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3761/5372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.957543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.958255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.965802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.966293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.966738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.967471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.967933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.968390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.107451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.115783 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4082355e-e95d-4260-8d6c-a7ad077a2116 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1465 microversion: 2.1 time: 0.162326 Oct 04 18:31:38.116368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1612/5373] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.165528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.166065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.173021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.173651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.174257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.175282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.175981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.176490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.207735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:38.264864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:38.295405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43f52e24-a8ae-45bc-9906-ead5827212ec tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 204 len: 0 microversion: 2.1 time: 0.134663 Oct 04 18:31:38.296165 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3762/5374] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:38 2022] DELETE /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:38.304989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.305627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.312892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.313379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.313852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.314551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.315002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.315455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.450835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.458963 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd60ad89-90d7-4e5c-965a-1438489a5aab tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.157927 Oct 04 18:31:38.459503 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1613/5375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.489197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.490140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.497864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.498355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.498786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.499533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.499988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.500413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.637695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.646778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5cab03b9-5ce3-4aac-afdb-132482480117 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.161833 Oct 04 18:31:38.647612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3763/5376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.484768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.485548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.493742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.494231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.494740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.495689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.496181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.496628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.639670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.654586 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-73dc89d8-4c3d-47c9-9c93-f2e6c53d9945 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.174298 Oct 04 18:31:39.655919 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1614/5377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.671714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.672571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.679133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.679646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.680129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.680837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.681315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.681733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.877270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.885446 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35577a72-349c-49f2-98f1-da095cf9940f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.219257 Oct 04 18:31:39.886086 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3764/5378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.682055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.682666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.690768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.691295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.691743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.692480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.692941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.693375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.915476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.917229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.920557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.925156 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-38e0e9f6-31e4-4945-88cb-12db4282aece tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1471 microversion: 2.1 time: 0.247014 Oct 04 18:31:40.926073 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1615/5379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.934942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.936640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.936640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.936640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.937137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.937355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.212892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.222117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2e48d33-d085-41fa-aefc-59d83619ffb0 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1696 microversion: 2.1 time: 0.315490 Oct 04 18:31:41.235697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3765/5380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1696 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.510795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb6b4033-f230-45be-bb03-3e789201cc1c", "name": "network-vif-deleted", "tag": "87d66c5c-8910-4c2a-b11b-ce358cea23af"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:41.528083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.530059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.532387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.558562 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] Creating event network-vif-deleted:87d66c5c-8910-4c2a-b11b-ce358cea23af for instance bb6b4033-f230-45be-bb03-3e789201cc1c on n-h2-831193-17 Oct 04 18:31:41.565570 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f813c3fe-c4fd-4a9d-b631-6b411cadfd8f req-1d7a9faf-2573-4c21-9d51-dc5423948591 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058353 Oct 04 18:31:41.566171 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1616/5381] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:41.937825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "name": "network-vif-unplugged", "status": "completed", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:41.950976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.951975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.960166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.960826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.961355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.967469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.967976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.968424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.969146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.969612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.970050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.977679 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Creating event network-vif-unplugged:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h1-831193-17 Oct 04 18:31:41.984766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] Instance 257763be-66c8-4bb7-b603-d4eaf049db3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:31:41.999324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c7c156a5-efae-470e-9fe9-31feeb6ff824 req-13c275f1-b1c0-484b-808c-925d91e1caa4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065647 Oct 04 18:31:42.000641 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3766/5382] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:42.004176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:42.023820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.024523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.025070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.025636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lazy-loading 'fault' on Instance uuid bb6b4033-f230-45be-bb03-3e789201cc1c {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:42.078568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc86f273cd944bfaa6998e1ab5819ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ce0ad7b1f343eea8f613013b904a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.088651 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd6d3d85-6d0c-41b3-9be1-a11ccaf8015f tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 200 len: 1305 microversion: 2.1 time: 0.144008 Oct 04 18:31:42.089248 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1617/5383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:42.250249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.251071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.257512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.258010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.258460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.259251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.259700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.260164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.397707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.406779 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd678609-1dee-47b7-b461-8dba9a2c9170 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1695 microversion: 2.1 time: 0.161602 Oct 04 18:31:42.407394 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3767/5384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.113706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.114265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] [instance: bb6b4033-f230-45be-bb03-3e789201cc1c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.121659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.122739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.123176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.123887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.124347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.124778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.140175 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] HTTP exception thrown: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Request method failure captured: Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c HTTP/1.1 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHv8EIxng-kPvAxdAgfhbKsRkfzmg0xYYsX4IxbF9kOA5ByApcP_R2sLE-uRSxhFx1oGWwASA_d6qOPUZwXy56Wq-gd0odeLS9MOvDV6RrdLSsCvLlBHZL6mFPEHfMEwZkb0sR9FzQuUzvE-biNf2PhvO-1AzrjD82HjODXP58_b5mc Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: a9ce0ad7b1f343eea8f613013b904a65 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-VolumesNegativeTest-575822689 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9ce0ad7b1f343eea8f613013b904a65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9ce0ad7b1f343eea8f613013b904a65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9ce0ad7b1f343eea8f613013b904a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9ce0ad7b1f343eea8f613013b904a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-VolumesNegativeTest-575822689 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: a9ce0ad7b1f343eea8f613013b904a65 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-VolumesNegativeTest-575822689 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-VolumesNegativeTest-575822689-project Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: bc86f273cd944bfaa6998e1ab5819ad4 Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-VolumesNegativeTest-575822689-project Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'bb6b4033-f230-45be-bb03-3e789201cc1c'} Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:43.141936 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] Returning 404 to user: Instance bb6b4033-f230-45be-bb03-3e789201cc1c could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee022d3a-50ca-43dc-a951-23d5872d4245 tempest-VolumesNegativeTest-575822689 tempest-VolumesNegativeTest-575822689-project] 10.222.0.33 "GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c" status: 404 len: 111 microversion: 2.1 time: 0.033757 Oct 04 18:31:43.147999 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1618/5385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/bb6b4033-f230-45be-bb03-3e789201cc1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:43.431795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.433023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.440705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.441191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.441637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.442348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.442801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.443399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.618202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.627434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3a8b19f4-f33e-4bfc-805f-3f042e8e920e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1693 microversion: 2.1 time: 0.199914 Oct 04 18:31:43.628367 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3768/5386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1693 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.046133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:44.055628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.056106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.056540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.069558 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Creating event network-changed:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h1-831193-17 Oct 04 18:31:44.077684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] Instance 257763be-66c8-4bb7-b603-d4eaf049db3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:31:44.089368 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-84942b73-2d6e-418c-8bec-91554def6e27 req-d0df8a0d-a619-4414-ba9a-211c6b617c96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046865 Oct 04 18:31:44.090223 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1619/5387] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:44.658762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.659548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.667860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.668754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.670226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.671169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.671801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.672403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.856086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.871232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f18c0b3a-95a2-45e5-84f8-619bf947944d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1690 microversion: 2.1 time: 0.216711 Oct 04 18:31:44.871834 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3769/5388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.894689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:44.895573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.904340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.905251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.905728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.906532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.907107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.907656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.984919 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1df9d6e3-9f11-45e4-b7b3-5194f0a7d6e1 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action" status: 204 len: 0 microversion: 2.1 time: 0.094261 Oct 04 18:31:44.985569 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1620/5389] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:44 2022] POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:31:44.995640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.996666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.003981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.004566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.005282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.006144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.006776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.007339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.283564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:45.299942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f170602a-54dc-4b60-8ced-8f7f3c03d7ec tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1690 microversion: 2.1 time: 0.303911 Oct 04 18:31:45.300691 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3770/5390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1690 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.331759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.334084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.346495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.347404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.348081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.349652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.350707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.352175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.514187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.522939 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40743761-d808-43b3-aee5-888221489c13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1690 microversion: 2.1 time: 0.198685 Oct 04 18:31:46.523674 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1621/5391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.547236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.547800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.554608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.555118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.555558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.556251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.556703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.557127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.717352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.726205 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-901693a1-5872-477b-977d-09b39bdfb14f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1682 microversion: 2.1 time: 0.182728 Oct 04 18:31:47.726781 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3771/5392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.782917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "name": "network-vif-plugged", "status": "completed", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:47.793713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.794593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.795664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.815873 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] Creating event network-vif-plugged:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h1-831193-17 Oct 04 18:31:47.825308 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c15dd11f-47b8-4455-a6e9-5347095f6ae4 req-f5105e47-eaed-4fd9-a27d-68ff0cd67333 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046068 Oct 04 18:31:47.826885 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1622/5393] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:09.962005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:09.964238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.967540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:09.968211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=52 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:09.974702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.975230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.975679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.976380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.976837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.977270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.031558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39be761c-5eef-4f8d-83d1-599a49cb1af9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action" status: 200 len: 24581 microversion: 2.1 time: 0.073294 Oct 04 18:32:10.032147 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3772/5394] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:09 2022] POST /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b/action => generated 24581 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:16.221303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.222059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.226284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.227002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.236763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.237258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.237696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.238404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.238860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.239323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.371079 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d9edf32-cc54-48a5-94eb-d228cdf1494c tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1835 microversion: 2.1 time: 0.152008 Oct 04 18:32:16.371657 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1623/5395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1835 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.562750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:17.564661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.565361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.572997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.573493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.574201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.574455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.574756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.574919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.575456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.575654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.575894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.599382 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] Creating event network-changed:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h1-831193-17 Oct 04 18:32:17.611111 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ce96ef4d-080b-4fa4-9a4a-01bef5286923 req-92010a09-e9b0-482e-9f54-5b77e8c57ccb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052327 Oct 04 18:32:17.612084 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1624/5396] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:17.613432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:17.725481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5cd5e88-d778-4c9f-955b-b2dfafd781db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 204 len: 0 microversion: 2.1 time: 0.167902 Oct 04 18:32:17.726649 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3773/5397] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:17 2022] DELETE /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:17.742257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.743802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.755868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.757196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.758307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.759925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.761408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.762774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.946883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.960281 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df8ab532-bd83-43bb-a10d-229c59762832 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1688 microversion: 2.1 time: 0.227849 Oct 04 18:32:17.961440 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1625/5398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.985414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.986119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:18.994208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.994709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.995177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.995892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.996356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.996791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.145678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.155484 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00080c43-7d1a-4367-9522-f29842ff3436 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 200 len: 1688 microversion: 2.1 time: 0.174231 Oct 04 18:32:19.156084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3774/5399] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.630766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257763be-66c8-4bb7-b603-d4eaf049db3b", "name": "network-vif-deleted", "tag": "033041e1-da9b-41f2-8090-988c31a915c0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:19.643824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.644650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.645429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.659599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] Creating event network-vif-deleted:033041e1-da9b-41f2-8090-988c31a915c0 for instance 257763be-66c8-4bb7-b603-d4eaf049db3b on n-h1-831193-17 Oct 04 18:32:19.665102 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8ca7b810-38c8-4d03-900f-924542d4da9d req-912bf3a1-cb8e-4374-82f4-754109aa0498 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038081 Oct 04 18:32:19.666338 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3775/5400] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:19.910752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.911306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.917694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.918261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.918741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.919626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.920089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.920526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.951093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:20.035228 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41223c95-6ea4-491b-9552-2c67ba3d1c83 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 204 len: 0 microversion: 2.1 time: 0.445068 Oct 04 18:32:20.035856 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1626/5401] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:19 2022] DELETE /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:32:20.044794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.045492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.052424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.052912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.053349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.054082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.054538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.054966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.186984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.187802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 257763be-66c8-4bb7-b603-d4eaf049db3b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.194014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.194511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.194950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.195777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.196320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.196686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.201028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.210134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cc98f8d-c7bd-4f37-ae96-8eb2cb0f0689 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1730 microversion: 2.1 time: 0.169495 Oct 04 18:32:20.211176 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3776/5402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.211624 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] HTTP exception thrown: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Request method failure captured: Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b HTTP/1.1 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHvC0sDYotRCNSl5y7B5VEJzrL_XzHLt-vDiLnZriasYgd6E0aNo2Yq-bBHpYSoVqox4DGd9pVVZp5ltSwg9mATka_4fu5j8qn871nnfzQOo2eJhk_vnFL9mzcmv3qXEt3d4kcvFscKf25VWnTVnV2zpkv_CwsjE1-aF5psHdcwbDaw Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: d08b5214fa914274895bcbd0267ad03a Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '257763be-66c8-4bb7-b603-d4eaf049db3b'} Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.213425 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Returning 404 to user: Instance 257763be-66c8-4bb7-b603-d4eaf049db3b could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5cd6d30a-dce7-44b5-bd2e-d53ec4ebba1b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b" status: 404 len: 111 microversion: 2.1 time: 0.032672 Oct 04 18:32:20.223440 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1627/5403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/257763be-66c8-4bb7-b603-d4eaf049db3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:21.242541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.243259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.250610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.251301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.251719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.253353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.253816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.254246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.493501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.503800 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f39b58e8-044c-473c-9c44-2828ec642ac9 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1730 microversion: 2.1 time: 0.265330 Oct 04 18:32:21.520276 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3777/5404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.318574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0", "name": "network-vif-deleted", "tag": "0583745f-fcd1-44e5-b55f-f32fed5c1e72"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:22.388411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.389301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.390105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.444908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] Creating event network-vif-deleted:0583745f-fcd1-44e5-b55f-f32fed5c1e72 for instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 on n-h1-831193-17 Oct 04 18:32:22.461767 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-29b40915-85eb-4886-818f-b6289e1b54a9 req-054fa3a8-20cc-43b1-be00-319157034388 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152828 Oct 04 18:32:22.463603 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1628/5405] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:22.535973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.537553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.575492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.576863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.578615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.580004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.580921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.582505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.705552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.707179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.708340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.709106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lazy-loading 'fault' on Instance uuid 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:22.814457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eb47ef4df541e880698ead286e9c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8e56786b584dbc8b38aeb768d1d2ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.886226 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13736015-ebc5-47b3-8346-99e3cc31828d tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 200 len: 1387 microversion: 2.1 time: 0.354697 Oct 04 18:32:22.893805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3778/5406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 1387 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.920563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.921361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.936108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.936991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.937781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.938618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.939260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.939886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.977621 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] HTTP exception thrown: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Request method failure captured: Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 HTTP/1.1 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHrqWkdQfpsl4zr8XFOJhlIlY7f6JoUZqzEI3E60IIabL2GyiW_7OQYXTC9vXLj_IEsb2g7t09HfQ4nzKxfra6YtYIbK2RERMoAcsPJMTA8rL_4pvS46UXmPzdRjbNnxxVz9EV-plpnmK1V2Z1limujjbfkNI0SlAi3LUGfCEvnzfjo Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestServerBasicOps-603480887 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 20eb47ef4df541e880698ead286e9c8a Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0'} Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:23.979557 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Returning 404 to user: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2bb0c0c0-c134-4e21-95e9-1b451badd01e tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 404 len: 111 microversion: 2.1 time: 0.064945 Oct 04 18:32:23.984975 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1629/5407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.582312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.582851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.590139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.591445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.591723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.592624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.593107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.593508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.612460 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] HTTP exception thrown: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Request method failure captured: Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 HTTP/1.1 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHrqWkdQfpsl4zr8XFOJhlIlY7f6JoUZqzEI3E60IIabL2GyiW_7OQYXTC9vXLj_IEsb2g7t09HfQ4nzKxfra6YtYIbK2RERMoAcsPJMTA8rL_4pvS46UXmPzdRjbNnxxVz9EV-plpnmK1V2Z1limujjbfkNI0SlAi3LUGfCEvnzfjo Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 20eb47ef4df541e880698ead286e9c8a Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0'} Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.614144 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.619358 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.621438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Returning 404 to user: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.622525 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c3ee68b-53aa-45b9-8085-97fbad67013f tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 404 len: 111 microversion: 2.1 time: 0.044932 Oct 04 18:32:24.623612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3779/5408] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.633991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.634616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] [instance: 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.641403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.641939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.642345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.643135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.643785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.644252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.661174 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] HTTP exception thrown: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Request method failure captured: Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 HTTP/1.1 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHrqWkdQfpsl4zr8XFOJhlIlY7f6JoUZqzEI3E60IIabL2GyiW_7OQYXTC9vXLj_IEsb2g7t09HfQ4nzKxfra6YtYIbK2RERMoAcsPJMTA8rL_4pvS46UXmPzdRjbNnxxVz9EV-plpnmK1V2Z1limujjbfkNI0SlAi3LUGfCEvnzfjo Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d8e56786b584dbc8b38aeb768d1d2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 0d8e56786b584dbc8b38aeb768d1d2ee Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestServerBasicOps-603480887 Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 20eb47ef4df541e880698ead286e9c8a Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestServerBasicOps-603480887-project Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0'} Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.662908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Returning 404 to user: Instance 63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ab87027d-20e4-4a65-9ca0-4d503b00ec73 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0" status: 404 len: 111 microversion: 2.1 time: 0.034739 Oct 04 18:32:24.675002 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1630/5409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/63255c8c-c5a5-4ebf-aa38-1f6d653f4ad0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:24.733612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4ad8ad62-4000-4a0d-9b6e-bf99f5b35e1a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '.version_select at 0x7f63400bc550>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.765561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4ad8ad62-4000-4a0d-9b6e-bf99f5b35e1a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-166549797" status: 202 len: 0 microversion: 2.1 time: 0.036212 Oct 04 18:32:24.770170 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3780/5410] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-166549797 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:24.797536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d4926b7-9860-4356-8df9-cc9ea2d0881e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: .version_select at 0x7f63419dc040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1538522057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdKW07gw0zkK1cmE+vldrsPq0DTG79+H/2H1q//e/GKZ5XrZl8j9ctr263HNBv5ShnyMldmmDOkLgVPhf7v6eJhdZ+N4WAGUqHIV2yrm9DjJufCRWTzjVs21jwheqOymg=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:24.824530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9d4926b7-9860-4356-8df9-cc9ea2d0881e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:24.833409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9d4926b7-9860-4356-8df9-cc9ea2d0881e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:24.866824 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d4926b7-9860-4356-8df9-cc9ea2d0881e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.073218 Oct 04 18:32:24.867869 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1631/5411] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:24.932648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-790125e5-76e2-422b-9ea2-c95d38c80e38 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] Calling method '.version_select at 0x7f633bfabd30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.959611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-790125e5-76e2-422b-9ea2-c95d38c80e38 tempest-TestServerBasicOps-603480887 tempest-TestServerBasicOps-603480887-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-321301216" status: 202 len: 0 microversion: 2.1 time: 0.030794 Oct 04 18:32:24.960523 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3781/5412] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-321301216 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:33.577660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1736620246", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "d16e5f2e-1b2f-45be-a4a4-2c5b798f5343"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1538522057", "security_groups": [{"name": "tempest-secgroup-smoke-304580221"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:34.375075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] validate_networks() for [('d16e5f2e-1b2f-45be-a4a4-2c5b798f5343', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:34.650629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:34.842829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:35.277745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:35.278551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:35.279615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:35.280274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:35.281059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:35.308272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.309703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.310324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.311848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.312530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.313240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.338392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:35.344391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:35.360236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:35.362695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:35.453378 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a7ffb216-2bd4-46c8-9fcc-f8a25e3b6927 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.881835 Oct 04 18:32:35.461154 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1632/5413] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:35.466443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8f4362ab-8224-4e69-bdaf-e1271a393e59 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.469042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8f4362ab-8224-4e69-bdaf-e1271a393e59 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.475293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:35.479898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:35.591867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8f4362ab-8224-4e69-bdaf-e1271a393e59 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.602729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8f4362ab-8224-4e69-bdaf-e1271a393e59 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1267 microversion: 2.1 time: 0.140072 Oct 04 18:32:35.603623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3782/5414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.626490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.627243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.634427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.634922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.635397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.636102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.636804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.638546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.730155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.743344 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd0651d1-7fa4-4f94-b81f-e0946be7b3a6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1319 microversion: 2.1 time: 0.119845 Oct 04 18:32:36.743977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1633/5415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1319 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.774927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.776800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.789469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.790102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.790980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.791957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.792728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.793757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.112273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.122854 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31deace1-517e-47a6-a65d-bb44475e201a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.354386 Oct 04 18:32:38.147901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3783/5416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.776528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:38.795944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.801489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.802272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.833583 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] Creating event network-changed:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:32:38.849175 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-dc789e2f-40e1-453f-82e5-92eb3514b175 req-1a68e7ef-913d-4e4b-9994-864058e934c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075535 Oct 04 18:32:38.852215 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1634/5417] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:39.160794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.162328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:39.175487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.176537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.177224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.179348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.180321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.181259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.522384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.531785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8237720b-8f75-4562-bf07-45bd0aaa6343 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.376579 Oct 04 18:32:39.532391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3784/5418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.583295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.586765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.605295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.608325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.609391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.614357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.615169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.618012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.988681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:41.004902 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-461e5396-c8c5-4ac5-b4e8-8eb5df8e845d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.441354 Oct 04 18:32:41.019087 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1635/5419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:42.031162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.032683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.042195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.043462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.044194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.045127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.046015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.046667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.256265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:42.268877 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-889a7790-a65f-469c-a614-f6c01117d77f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.241982 Oct 04 18:32:42.279081 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3785/5420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.294434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.295258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:43.302746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.303260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.303690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.304611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.305333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.306180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.500816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.514540 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e53543f-da34-44dd-b0d1-e58d99c1b242 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.223917 Oct 04 18:32:43.515332 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1636/5421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:44.553130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.554067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:44.565120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.568473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.569306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.570284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.571007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.571751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.651735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-plugged", "status": "completed", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:44.692470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.693564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.696070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.731540 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] Creating event network-vif-plugged:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:32:44.755392 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ad500844-79e6-4dfa-9a24-90aa9b34dfd9 req-7e9528fd-4e82-496b-b87b-29ca26609c73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113854 Oct 04 18:32:44.756915 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1637/5422] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:44.937439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:44.947405 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df47f40a-1fb2-4889-8924-d8f248d1bd44 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.400659 Oct 04 18:32:44.948656 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3786/5423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.978893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.981275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.988781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:45.989849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:45.994693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.995963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.997056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.998543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.999632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.000914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.239567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.255779 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-383339c9-ab7b-40d6-9f8d-38a83c503d88 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1392 microversion: 2.1 time: 0.283051 Oct 04 18:32:46.257584 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1638/5424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1392 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.291425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.292052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.299628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:47.310453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.311308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.313292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.316573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.317758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.318649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.593253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.612659 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32eb5b29-a2a1-45b9-834e-b4018cb569e2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1563 microversion: 2.1 time: 0.325150 Oct 04 18:32:47.628201 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3787/5425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1563 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.657342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.658124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.660884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:47.682327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.683721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.684500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.686535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.687359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.692657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.033915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.045560 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4171e348-9a4a-46ae-9dfc-124792b6dc97 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1563 microversion: 2.1 time: 0.396062 Oct 04 18:32:48.046802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1639/5426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1563 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:51.924858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.926089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:51.939640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:51.959307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.960213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.961013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.962305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.963159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.963925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.970831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.974410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.978744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.999326 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] Creating event network-changed:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:32:52.008547 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0181dfff-3086-49a0-a906-2bf6b6f34c61 req-ebe188e6-744b-4a77-94ee-2836ce752adc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075747 Oct 04 18:32:52.010767 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1640/5427] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:52.314265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:52.329085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa2dbdc8-a1fd-4418-885e-428e12053374 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1563 microversion: 2.1 time: 0.411913 Oct 04 18:32:52.329686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3788/5428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:51 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1563 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:54.253554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1781982874", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7ae31f95-6fac-4ae3-94c8-26f5df72d5f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.331486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:54.834523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:54.834995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:54.835897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:54.836599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:54.837232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:54.851095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.851638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.852122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.852873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.853389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.853862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.879520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:54.888324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:54.970648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:54.973216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ae31f95-6fac-4ae3-94c8-26f5df72d5f5',volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:55.187438 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-563cef21-5cc2-4cf5-9c47-10e15068acd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945712 Oct 04 18:32:55.188110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1641/5429] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:55.204705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8367b1e9-63ef-42c8-ba63-3ba09aeec881 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.206081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8367b1e9-63ef-42c8-ba63-3ba09aeec881 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.278778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8367b1e9-63ef-42c8-ba63-3ba09aeec881 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:55.293091 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8367b1e9-63ef-42c8-ba63-3ba09aeec881 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1057 microversion: 2.1 time: 0.091283 Oct 04 18:32:55.294508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3789/5430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1057 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:56.323167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.324781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.331971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.332761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.333286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.334550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.335498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.336174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.434330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.445791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6eb664a2-f8d1-4eb2-8f94-7f8048721e34 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1163 microversion: 2.1 time: 0.127738 Oct 04 18:32:56.446579 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1642/5431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.487936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.489034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.519118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.519900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.520640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.521512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.522105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.522767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.732661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.741334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb3b54ae-b15a-4105-80a2-9290674ef086 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1215 microversion: 2.1 time: 0.260299 Oct 04 18:32:57.742254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3790/5432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1215 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.277733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94834482-5b82-45db-9a49-2eed3c87a728", "tag": "170133fe-bc0f-453f-81bc-a732b5e02315"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:58.305170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.306436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.307552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.331404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] Creating event network-changed:170133fe-bc0f-453f-81bc-a732b5e02315 for instance 94834482-5b82-45db-9a49-2eed3c87a728 on n-h1-831193-17 Oct 04 18:32:58.352315 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-24eede3b-e4ab-4fdb-9e03-6ee9a366776c req-be994ddb-f2a0-4145-9768-55577397fe7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070191 Oct 04 18:32:58.355501 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1643/5433] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:58.782142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.784281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.792289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.793300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.793935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.794656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.795212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.796040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.008506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.020420 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fd19d0e7-e35e-4a58-8332-d4b35719b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1215 microversion: 2.1 time: 0.250062 Oct 04 18:32:59.021065 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3791/5434] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.053692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.055120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.066559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.067454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.068225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.069732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.070574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.071389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.255807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.265469 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-470537db-3407-46b6-9868-ec58a2bb4f4f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1215 microversion: 2.1 time: 0.221652 Oct 04 18:33:00.266083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1644/5435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.299045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.299873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.308462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.308969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.309411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.310122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.310579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.311010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.467375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.477336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f20127e8-7d44-4e09-9a20-598e9e6bdaac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1215 microversion: 2.1 time: 0.185722 Oct 04 18:33:01.478010 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3792/5436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.508484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.509271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.517759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.518313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.518955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.519777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.520243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.520738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.666008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.681393 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a768918-bcd8-47a5-b08f-b0981b8f0e31 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.176914 Oct 04 18:33:02.682212 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1645/5437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.716369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.717216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.732113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.734155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.734807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.736175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.737198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.738260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.885317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.893847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-48958abb-43a4-4ba9-b9f9-0c2263f97e99 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.184366 Oct 04 18:33:03.894453 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3793/5438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.916377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.917058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.920455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:04.921296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:04.927090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.927583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.928020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.928723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.929179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.929606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.933116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=61 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:05.103265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.113484 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6cf98d4f-0ec2-4a74-a3c6-6282a1bdaaa8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.201017 Oct 04 18:33:05.114094 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1646/5439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.138718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.139445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.142386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:06.143344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=29 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:06.150430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.150931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.152057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.152787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.153274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.153683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.156851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=61 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:06.293376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.301410 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa55aebd-65ab-4f90-a1dd-f1b6588b569d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.167207 Oct 04 18:33:06.301990 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3794/5440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:07.324753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.325585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.333038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.333524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.333962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.334668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.335148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.335587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.482890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.490922 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c48228ab-cefe-41ee-8afd-dd377dd73b3a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.170291 Oct 04 18:33:07.491611 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1647/5441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:08.514521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.515243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.522867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.523393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.523838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.524557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.525022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.525456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.676687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.686432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc820b2a-0e30-40a4-b000-40cf5bd3a000 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.176264 Oct 04 18:33:08.687226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3795/5442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:09.710145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.710709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.717964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.718459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.718900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.719642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.720102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.720531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.887705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.896130 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7c5404d2-2756-4290-a605-fa010b8db0e6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.189942 Oct 04 18:33:09.896826 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1648/5443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.733930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:10.736311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.743924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.744408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.744917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.746254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.746709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.747167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.804355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59a9b066-3401-4bb4-aa4b-11c29d8380ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action" status: 200 len: 24569 microversion: 2.1 time: 0.074153 Oct 04 18:33:10.805385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3796/5444] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:10 2022] POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:10.920896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.921615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.928767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.929288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.929706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.930423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.931005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.931469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.092133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.100751 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6368610f-9e73-415d-91e3-efcb90e172f8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.184283 Oct 04 18:33:11.101350 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1649/5445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.124502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.125305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.133647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.134175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.134761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.135710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.136267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.136713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.330778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.345481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6802c24c-8dae-4488-a074-9f2a91eadbba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.225696 Oct 04 18:33:12.346084 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3797/5446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:13.370877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.371519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.378551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.379056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.379546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.380266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.380728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.381165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.517099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.526623 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b56de200-3bda-4399-9990-af4716063ef1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.160205 Oct 04 18:33:13.527224 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1650/5447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.216103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94834482-5b82-45db-9a49-2eed3c87a728", "name": "network-vif-plugged", "status": "completed", "tag": "170133fe-bc0f-453f-81bc-a732b5e02315"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:14.233644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.233644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.234294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.250432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] Creating event network-vif-plugged:170133fe-bc0f-453f-81bc-a732b5e02315 for instance 94834482-5b82-45db-9a49-2eed3c87a728 on n-h1-831193-17 Oct 04 18:33:14.255678 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d7f72f75-9e8c-4890-9301-a2a846ccbd72 req-c57d9ecd-9da3-415a-95ef-81a0908e0612 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043299 Oct 04 18:33:14.256434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3798/5448] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:14.549890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.550503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.558606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.559231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.559790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.560589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.561111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.561664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.002265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.010581 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-46a20500-6a34-4af6-8c00-ee846ae3cf88 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1203 microversion: 2.1 time: 0.464552 Oct 04 18:33:15.011204 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1651/5449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1203 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.037977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.039271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.051110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.052069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.052814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.053813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.054548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.055264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.209499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.218240 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7cd530db-11f1-4ee3-b28b-b23c25597127 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1391 microversion: 2.1 time: 0.187427 Oct 04 18:33:16.219717 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3799/5450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.244540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.245466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.252834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.253335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.253774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.254708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.255238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.255683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.410843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.425131 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ebedbd8-af4b-4765-bfc2-6fe3326ff619 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1391 microversion: 2.1 time: 0.184938 Oct 04 18:33:16.426198 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1652/5451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.448598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.449241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.456360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.456869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.457396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.458036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.458650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.458962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.622656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.631098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5331d846-ef19-42a8-ae6e-a23d2f39780a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1391 microversion: 2.1 time: 0.186795 Oct 04 18:33:16.632009 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3800/5452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:16.662762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.663360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.672032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.672535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.672980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.674786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.675843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.676306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.706939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:16.802325 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-45812b04-5810-4dd6-b73c-c9edbf16b77a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 204 len: 0 microversion: 2.1 time: 0.150806 Oct 04 18:33:16.803058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1653/5453] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:16 2022] DELETE /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:33:16.811920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.812715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.821138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.822029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.822506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.823853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.824314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.824747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.985363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.994027 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11bd90f4-d6f2-4077-ae3e-6faa1d6de150 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1397 microversion: 2.1 time: 0.186511 Oct 04 18:33:16.994754 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3801/5454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1397 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.028307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.029758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.037833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:18.044324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.045057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.045757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.046920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.047517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.048010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.214756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.224003 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7e917289-e960-45a9-b158-1adda0cafe11 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1397 microversion: 2.1 time: 0.204313 Oct 04 18:33:18.224695 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1654/5455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1397 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.858660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94834482-5b82-45db-9a49-2eed3c87a728", "name": "network-vif-deleted", "tag": "170133fe-bc0f-453f-81bc-a732b5e02315"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:18.881626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.882505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.883388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.907870 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] Creating event network-vif-deleted:170133fe-bc0f-453f-81bc-a732b5e02315 for instance 94834482-5b82-45db-9a49-2eed3c87a728 on n-h1-831193-17 Oct 04 18:33:18.915084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4d748dfb-2283-4440-9c20-95c615d1e43e req-f271a470-63b6-43ad-a3cf-41c0f22a0be1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061182 Oct 04 18:33:18.915722 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3802/5456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:19.252811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.253512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.262090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.262599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.263023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.263754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.264215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.264644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.334157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.343838 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b14c070f-7ba1-4d73-8a4e-1b8d50848016 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1188 microversion: 2.1 time: 0.097548 Oct 04 18:33:19.344942 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1655/5457] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:20.373571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.374380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.388543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.389466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.390280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.391520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.391993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.392435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.467839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.476188 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55100f88-c594-4aac-8594-aef9ed63ddbf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1188 microversion: 2.1 time: 0.110451 Oct 04 18:33:20.477116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3803/5458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.514144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.514874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.522634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.523352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.523934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.524717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.525244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.526270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.615620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.629170 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7ce7d9a8-9b53-4442-9006-9ad04c3032c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1188 microversion: 2.1 time: 0.118891 Oct 04 18:33:21.630161 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1656/5459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.837262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.838068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.848283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.848779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.849220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.849929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.850390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.850813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.059167 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-152cee14-3cff-4c9c-8bb3-e401eef4c130 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1835 microversion: 2.1 time: 0.224921 Oct 04 18:33:22.060182 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3804/5460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1835 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.085464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.086176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.094382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.095784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.096609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.098075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.099006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.099677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.276455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.285949 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3186c98c-d9e4-415e-95cc-08cf4216c511 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1682 microversion: 2.1 time: 0.204470 Oct 04 18:33:22.286802 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1657/5461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.398513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.400862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.407863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.408368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.408844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.409573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.410044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.410500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.468202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4aeca94c-a932-4dad-9a41-67851947e30f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action" status: 200 len: 32635 microversion: 2.1 time: 0.072927 Oct 04 18:33:22.469706 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3805/5462] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action => generated 32635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:22.656588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.657524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.672592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.679721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.680431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.681066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.685798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.686081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.686202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.686202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.694532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.695446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.696174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.697380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.698258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.698992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.752260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0169195eb2394144851032de2c74896b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c83570f6a24e46bc548138e7f66182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.752989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] flavor_id is None. Assuming migration. {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:33:22.753297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:33:22.789621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.804150 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-34021d32-76cb-45a4-ad4d-4ce9539f1952 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1188 microversion: 2.1 time: 0.154385 Oct 04 18:33:22.805213 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1658/5463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.105581 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6661764a-5dcc-43b7-bfc5-abe3654c9317 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action" status: 202 len: 0 microversion: 2.1 time: 0.440876 Oct 04 18:33:23.106663 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3806/5464] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:23.116338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.117159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.128706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.130075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.131137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.132482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.133636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.134540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.363201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.379576 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2372806f-4178-4264-88fd-7a100e1127e5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1691 microversion: 2.1 time: 0.267618 Oct 04 18:33:23.381038 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1659/5465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.835049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.835710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.842907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.843448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.843922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.844617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.845080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.845510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.889040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.889957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.890677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.891357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lazy-loading 'fault' on Instance uuid 94834482-5b82-45db-9a49-2eed3c87a728 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:23.960736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.974906 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83b1b291-8550-4ddb-ba62-8cb2fb77beef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 200 len: 1193 microversion: 2.1 time: 0.145014 Oct 04 18:33:23.989462 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3807/5466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 1193 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.410124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.411563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.420419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.421293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.421919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.422700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.423182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.423809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.681271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.696335 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d46b0601-1e8d-431d-a50d-24e072ae1e4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1691 microversion: 2.1 time: 0.290447 Oct 04 18:33:24.697926 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1660/5467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.999936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.000918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 94834482-5b82-45db-9a49-2eed3c87a728] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.012944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.013438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.013876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.015118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.015899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.016655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.033188 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 HTTP/1.1 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '94834482-5b82-45db-9a49-2eed3c87a728'} Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.034910 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 94834482-5b82-45db-9a49-2eed3c87a728 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb8d0c81-bcf0-470c-9feb-e7e74de4dd07 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728" status: 404 len: 111 microversion: 2.1 time: 0.041203 Oct 04 18:33:25.041621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3808/5468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/94834482-5b82-45db-9a49-2eed3c87a728 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:25.727087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.728068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.741609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.742424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.743204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.744274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.745303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.746238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.775425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:25.945796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.954540 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44e30760-b7a9-4e62-b483-3b12e17e26f5 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.233681 Oct 04 18:33:25.955290 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1661/5469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.983343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.984338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.996709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.997465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.998225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.999474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.000279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.001030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.198505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.208957 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9f163a0-1bfc-492f-95ad-dff03ace5fe8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.233508 Oct 04 18:33:27.209681 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3809/5470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.233819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.234821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.243496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.243983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.244958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.245685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.246235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.246660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.424436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.440471 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-152da691-3c50-4e54-bcd3-6997d5976f6c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.210653 Oct 04 18:33:28.441165 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1662/5471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:29.466974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.468143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.477729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.478476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.479291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.480487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.481167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.481895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.650015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.665742 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-efbda5e2-a028-4eb2-bd70-57ed13b091ab tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.203643 Oct 04 18:33:29.666663 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3810/5472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:30.292662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1315300059", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4949a7b8-8bbf-44de-9ff1-75b4b8f10125", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:30.371760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:30.695327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.696267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.714014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.714634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.715115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.715857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.716320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.716749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.733165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:30.844522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:30.845205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:30.845787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:30.846305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:30.847004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:30.858819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.859489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.860316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.862432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.862895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.863704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.893309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:30.904330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:30.924387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.934223 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-079c1d16-c24c-4ba6-b795-3e6457b64f13 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.242454 Oct 04 18:33:30.935187 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3811/5473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:31.002868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:31.006563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4949a7b8-8bbf-44de-9ff1-75b4b8f10125',volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:31.174205 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-34009a7b-eb32-4508-a286-6af7fa3ab16b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886256 Oct 04 18:33:31.175132 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1663/5474] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:31.194603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f95b6320-dbf5-4875-a617-13e6db552630 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.195730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f95b6320-dbf5-4875-a617-13e6db552630 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.267274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f95b6320-dbf5-4875-a617-13e6db552630 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.276031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f95b6320-dbf5-4875-a617-13e6db552630 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1057 microversion: 2.1 time: 0.088013 Oct 04 18:33:31.276784 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3812/5475] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1057 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:31.963685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.964337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.971329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.972032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.972454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.973136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.973641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.974235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.149855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.159184 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-646477b8-5545-4d08-9e6e-a85693ae1c6d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.201885 Oct 04 18:33:32.159780 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1664/5476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:32.306870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.307562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.318346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.319124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.320165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.320671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.321242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.321803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.405636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.416359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bab99dd-69c0-41d2-9ea6-f2dbd2306dee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1163 microversion: 2.1 time: 0.119435 Oct 04 18:33:32.416996 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3813/5477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1163 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.184613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.185812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.198294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.199281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.199952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.201027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.201494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.201932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.448960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.451277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.452050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.464818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.466661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.466825 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60ed51dd-ad17-4f4e-b235-fa50ab000955 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.286451 Oct 04 18:33:33.467799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.470673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.471177 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1665/5478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.471857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.472617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.683977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.695813 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0d816021-a224-4f60-bb34-a47048299853 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1215 microversion: 2.1 time: 0.255185 Oct 04 18:33:33.697536 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3814/5479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:34.503677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.504803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.518325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.519333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.520113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.521362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.522197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.522991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.717384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.728198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-853648f8-c2bb-4946-b773-b7e0939e87cd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.232687 Oct 04 18:33:34.728754 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1666/5480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:34.729778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.730927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.746072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.747449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.748525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.749675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.750678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.751486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.788758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d1ed43-a1bb-4187-84d6-4dff94e2d6fe", "tag": "474e8323-c68e-45a5-9dcc-7eafaf665df0"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:34.825564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.831076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.831550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.859799 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] Creating event network-changed:474e8323-c68e-45a5-9dcc-7eafaf665df0 for instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe on n-h1-831193-17 Oct 04 18:33:34.875127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b41569b6-5bd1-4976-8e5a-6eda1cd188a2 req-0e014cba-eb93-482c-9e43-4230c350fd40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094246 Oct 04 18:33:34.875751 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1667/5481] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:34.941227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.953180 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0a031bce-50dc-4d93-a44d-ae42bb888ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1215 microversion: 2.1 time: 0.228481 Oct 04 18:33:34.953765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3815/5482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.754939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.755810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.763238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.763731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.764172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.764884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.765347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.765777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.969375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.979698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.985288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.999849 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04180a31-bfb3-4ef3-8aa7-38e24587c4dc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.248923 Oct 04 18:33:36.000873 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1668/5483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.015585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.017122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.019692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.021475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.023381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.024602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.210410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.220227 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-98b2332a-33ae-4516-ba69-3c52e3ea50fc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1215 microversion: 2.1 time: 0.245860 Oct 04 18:33:36.220841 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3816/5484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.040850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.041518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.050848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.051428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.051946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.052691 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.053155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.053580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.251403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.252210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.256248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=52 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:37.261459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.261961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.262407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.263290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.263811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.264439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.265060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.275836 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ea4ccf89-0026-4e34-a159-d7d344f87035 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1696 microversion: 2.1 time: 0.238747 Oct 04 18:33:37.277503 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1669/5485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1696 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.488177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.503660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52d250ed-50b1-4b96-a764-133c1f026211 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1215 microversion: 2.1 time: 0.257126 Oct 04 18:33:37.504833 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3817/5486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:38.322900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-unplugged", "status": "completed", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:38.325163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.327089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.341473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.342577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.343454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.344787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.345692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.358258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.390074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.391019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.391667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.407977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Creating event network-vif-unplugged:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h1-831193-17 Oct 04 18:33:38.416287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:38.440140 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e99337fc-ec80-4b62-9dcf-0c2b8179c987 req-73506098-16d9-4297-ade4-309a5a0e113e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127605 Oct 04 18:33:38.442034 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1670/5487] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:38.540704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.542424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.555184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.556849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.557421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.558506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.559175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.559726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.610535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.624057 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3d93199-ea47-4a8d-80d5-25f3c1bafa3c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1695 microversion: 2.1 time: 0.309781 Oct 04 18:33:38.625404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3818/5488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1695 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.770302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.786968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c314f293-c0b8-422e-a83e-6aa0884e2882 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1215 microversion: 2.1 time: 0.261360 Oct 04 18:33:38.788074 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1671/5489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.651843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.653135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.661331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.661880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.662425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.663215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.664074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.664854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.814349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.815234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.835097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.835739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.835964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.836910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.837444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.838401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.867480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.881319 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc55568f-d339-424e-b63d-420c5bc490bb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1695 microversion: 2.1 time: 0.233473 Oct 04 18:33:39.899010 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3819/5490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.989376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.000255 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-93d2d146-7ff9-425e-99a1-9f858007d7d7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.192710 Oct 04 18:33:40.001049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1672/5491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:40.463815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:40.477020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.477570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.478609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.493171 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Creating event network-changed:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h1-831193-17 Oct 04 18:33:40.500067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:40.514998 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-517b0781-546c-4658-80c2-56765fd7a7b0 req-d3037d22-4917-41ed-904b-69d237f4d9db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055957 Oct 04 18:33:40.516039 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3820/5492] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:40.917652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.918975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.927703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:40.928790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:40.930801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.931872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.932695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.933719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.934185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.934999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.031602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.032739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.041653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.042439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.043202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.044088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.044862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.045539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.272678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:41.335523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.350732 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2841026f-5434-4f46-95f4-ce569ba55ddb tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1693 microversion: 2.1 time: 0.438596 Oct 04 18:33:41.364591 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1673/5493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1693 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.384894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.394133 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e778052c-3d4e-4dcc-ad8c-97afab07597a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.372320 Oct 04 18:33:41.394889 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3821/5494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.391190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.392592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.401899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.402402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.402856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.403877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.404351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.404794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.420538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.421535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.435355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.436115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.436720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.437790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.438405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.439061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.675076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.688031 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a317c31f-00e4-4e22-ab08-535a67042294 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1690 microversion: 2.1 time: 0.301606 Oct 04 18:33:42.689206 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1674/5495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1690 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.690919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.707313 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad3a7137-82e4-428a-9da6-4d67b83faf9a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.292635 Oct 04 18:33:42.708434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3822/5496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.717752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:42.718532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.727829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.728703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.729155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.729877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.730346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.730786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.880955 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-33007788-3dfd-4c79-a5ab-a81818555813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action" status: 202 len: 0 microversion: 2.1 time: 0.167128 Oct 04 18:33:42.887200 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1675/5497] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:42 2022] POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:42.896714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.896714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.902099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.902634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.903068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.904380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.904860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.905556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.095598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.104946 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-048e59af-c64b-4c0a-ae7a-0ca0ca954663 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.215913 Oct 04 18:33:43.105895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3823/5498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.750332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.751280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.761008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.761770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.762445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.763610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.764314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.765000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.921257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.930349 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c7f904b5-e752-4de2-b7ea-7327d9f14636 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.187729 Oct 04 18:33:43.931696 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1676/5499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.145167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.145798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.153510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.154476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.154951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.155750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.156245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.156980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.338139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.351582 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8211ae5c-461e-4603-b114-bbda0dfe0684 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.210067 Oct 04 18:33:44.352764 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3824/5500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.577254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-plugged", "status": "completed", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:44.588908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.589468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.589819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.606331 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Creating event network-vif-plugged:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h1-831193-17 Oct 04 18:33:44.611678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:44.617461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:44.630409 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-dc000831-6e8b-42df-a826-bf8dc1c795ef req-b1a5164e-6bf1-4bbe-ab3c-9259ee03b5be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057756 Oct 04 18:33:44.631071 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1677/5501] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:44.965600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.966249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.972784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.973301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.973740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.974438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.974894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.975381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.131655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.141603 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b49d3619-a24c-4fa7-8358-702ac1411c52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.179897 Oct 04 18:33:45.142586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3825/5502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.399407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.400133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.409524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.410031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.410469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.411578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.413647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.414235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.604055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.612452 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7e4c92e-08a9-490b-afc4-69cdeeaac4db tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.225926 Oct 04 18:33:45.613127 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1678/5503] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.166620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.167216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.174505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.175093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.175477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.176275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.176678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.177389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.641562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.642587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.653947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.654536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.655224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.655981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.656444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.656874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.706624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.718411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d97cf0e-b8f3-4c50-bec0-215ff354c3ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.556118 Oct 04 18:33:46.719633 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3826/5504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:46.960987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.973669 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63d2f93e-9be9-45b2-b42e-d6658a316903 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.338408 Oct 04 18:33:46.974691 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1679/5505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:47.081616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-unplugged", "status": "completed", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:47.093546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.094038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.094482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.110150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Creating event network-vif-unplugged:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:33:47.121065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:47.142585 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-eb31e10e-d743-4f22-9af4-7b6613f96aa8 req-a2e1b1c1-8610-41da-b151-701a6c08cf28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065061 Oct 04 18:33:47.143852 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3827/5506] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:47.748275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.749769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.763345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.764294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.765089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.766565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.767432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.768199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.002916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.004827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.012897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.013395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.013838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.014587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.015063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.015506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.045174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.055098 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0bce6bce-e16a-4fb2-be0c-e8d19052448a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.314374 Oct 04 18:33:48.056628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1680/5507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.269693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.281438 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-da25b8c1-4e75-4bda-aaf2-ac86c0c73dd6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.285006 Oct 04 18:33:48.282713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3828/5508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.078452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.079001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.081841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:49.090729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.091671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.092515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.093268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.093981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.094813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.194310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:49.205534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.206139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.206579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.219874 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Creating event network-changed:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:33:49.225893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:49.238416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9187cd54-989f-4a68-99c7-a498e7a0fd23 req-0788b4c6-7ecf-4fc3-bfe6-8904e7bbe333 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048573 Oct 04 18:33:49.239142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3829/5509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:49.295510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.308190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83bb0a49-c06c-4881-abfd-c274ef97b4b6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.233549 Oct 04 18:33:49.309247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1681/5510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.316434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.317745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.327402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.328107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.328734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.329406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.330123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.330917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.335735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:49.536208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.545521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-060d6f0f-3663-4cc6-bdd3-1694ef56199b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1689 microversion: 2.1 time: 0.240426 Oct 04 18:33:49.546115 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3830/5511] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:50.334285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.335708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.344427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.345224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.346024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.346742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.347413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.347860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.529505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.538940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d1ed43-a1bb-4187-84d6-4dff94e2d6fe", "name": "network-vif-plugged", "status": "completed", "tag": "474e8323-c68e-45a5-9dcc-7eafaf665df0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:50.540249 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-634115bf-a129-4ef6-a13c-364513b0aa2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.211789 Oct 04 18:33:50.540852 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1682/5512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:50.552119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.552781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.553636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.573759 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] Creating event network-vif-plugged:474e8323-c68e-45a5-9dcc-7eafaf665df0 for instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe on n-h1-831193-17 Oct 04 18:33:50.575624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.576248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.583481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3a63984b-828f-4323-aaf2-c53fc0f9ffd9 req-595a7ba4-e01e-4459-82ad-057a4ac61827 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046298 Oct 04 18:33:50.583481 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3831/5513] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:50.586978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.588071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.590064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.591537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.592588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.593998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.801709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.810483 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-780a81e2-9df6-44e1-956c-850ed00ca010 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1682 microversion: 2.1 time: 0.239739 Oct 04 18:33:50.811176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1683/5514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.575550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.576238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.586093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.586701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.587396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.588427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.589122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.589857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.783529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.793923 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5dcbda5d-704e-4a6d-beb9-93086b82a5ef tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1203 microversion: 2.1 time: 0.227713 Oct 04 18:33:51.804563 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3832/5515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:52.826130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.827063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.836391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.837709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.838167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.839299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.840138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.840246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.020155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.031725 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-48d8cc47-e344-44cb-a0df-88b1f526bbb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1391 microversion: 2.1 time: 0.211528 Oct 04 18:33:53.032338 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1684/5516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.048449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-plugged", "status": "completed", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:53.067117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.068094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.068919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.070817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.072110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.082898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.083997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.085037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.086509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.087950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.088689 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] Creating event network-vif-plugged:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:33:53.088882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.095847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c5b71ada-90df-4933-92c1-4a7e51482cab req-325b0d07-7ab9-4856-b697-5fb93f005cb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056085 Oct 04 18:33:53.097120 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3833/5517] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:53.268503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.278161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-39aacae1-1024-4fb8-a207-9697548b5fc7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1391 microversion: 2.1 time: 0.215699 Oct 04 18:33:53.279172 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1685/5518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.306346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.306932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.313372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.313869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.314305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.315006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.315493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.315915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.469413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.478670 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cbdc90c3-ada4-443c-b6f5-a776dc7ab114 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1391 microversion: 2.1 time: 0.179262 Oct 04 18:33:53.479309 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3834/5519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.504164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.504957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.514372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.515221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.515901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.516904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.517601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.518084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.552355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:53.657891 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7b73bc5c-cedf-45a7-aae9-32303b39f3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 204 len: 0 microversion: 2.1 time: 0.159493 Oct 04 18:33:53.658391 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1686/5520] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:53 2022] DELETE /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:53.668494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.669186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.676162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.676728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.677266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.679333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.679760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.680225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.836225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.846925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-36466a6c-a680-48aa-8dd7-5da836e1e16c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1397 microversion: 2.1 time: 0.183233 Oct 04 18:33:53.847556 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3835/5521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1397 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:54.872450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.873177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.880535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.881010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.881452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.882167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.882623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.883127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.038859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.048002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ffab7278-7256-44c6-95ec-36a5af45b0ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1397 microversion: 2.1 time: 0.180570 Oct 04 18:33:55.048772 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1687/5522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1397 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.725689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d1ed43-a1bb-4187-84d6-4dff94e2d6fe", "name": "network-vif-deleted", "tag": "474e8323-c68e-45a5-9dcc-7eafaf665df0"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:55.747444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.748366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.749126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.769110 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] Creating event network-vif-deleted:474e8323-c68e-45a5-9dcc-7eafaf665df0 for instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe on n-h1-831193-17 Oct 04 18:33:55.775952 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2fec7fa6-5f62-483d-8ba0-0a6411c2b20a req-ad803cd8-c5ff-4d0e-9ebe-41ded3b31ba6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053964 Oct 04 18:33:55.776672 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3836/5523] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:56.073912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.075571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.084331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.085197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.085907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.086909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.087685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.088494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.199337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.207770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da196cae-8194-4583-82de-dafebdc772ac tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1188 microversion: 2.1 time: 0.138547 Oct 04 18:33:56.208357 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1688/5524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1188 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:57.248216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.249026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.255868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.256372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.256863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.257600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.258059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.258484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.364635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.379917 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f52b081-c4f9-456b-879e-2068d72fb70b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1188 microversion: 2.1 time: 0.136604 Oct 04 18:33:57.380946 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3837/5525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.419009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.430140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.439793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.440345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.440731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.441449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.441902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.442375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.535754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.546953 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-096c8a74-c2af-4ace-84dd-3da1e9bfc92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1188 microversion: 2.1 time: 0.143624 Oct 04 18:33:58.547753 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1689/5526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1188 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:59.582235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.583729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.592468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.593274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.593816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.594592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.595223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.595801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.686620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.697023 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a799c7f-44d7-4aee-aa53-c50aa775a8b9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1188 microversion: 2.1 time: 0.118511 Oct 04 18:33:59.697806 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3838/5527] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.726368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.727428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.735504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.736182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.736831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.737551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.738101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.738570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.773940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.775180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.775674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.776188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lazy-loading 'fault' on Instance uuid 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:00.826938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.842245 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-64ba58d1-28ae-4d38-98c1-a82c45b4ee82 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 200 len: 1193 microversion: 2.1 time: 0.119927 Oct 04 18:34:00.843381 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1690/5528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.877637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.878436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.890038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.890867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.891646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.892785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.893585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.894368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.911797 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe HTTP/1.1 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '69d1ed43-a1bb-4187-84d6-4dff94e2d6fe'} Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:01.913818 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 69d1ed43-a1bb-4187-84d6-4dff94e2d6fe could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4d61345-b7d7-468d-af30-b8fbcac4fea1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe" status: 404 len: 111 microversion: 2.1 time: 0.042019 Oct 04 18:34:01.919805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3839/5529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/69d1ed43-a1bb-4187-84d6-4dff94e2d6fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:15.067131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:15.069889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.073944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:15.074616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:15.081866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.082366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.083109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.083827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.084280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.084709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.161981 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b3f4802-310c-4d83-9617-acdba522d43e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action" status: 200 len: 63210 microversion: 2.1 time: 0.100685 Oct 04 18:34:15.162817 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1691/5530] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:15 2022] POST /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26/action => generated 63210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:21.635534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=45 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:21.636887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=43 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:21.642189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.642873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.650466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.650956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.651423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.652136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.652595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.653052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.911220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-90eaf962-be19-4f32-8d1d-ce040e5e9a78 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1835 microversion: 2.1 time: 0.277056 Oct 04 18:34:21.912069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3840/5531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1835 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:23.147442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:23.156635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.157659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.177375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.178012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.179284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.180421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.180701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.181599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.181965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.182238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.182757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.205655 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] Creating event network-changed:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:34:23.220963 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d2f6c9ea-98b6-461a-8c12-fd6b7ef382e0 req-ec354561-430a-4dd2-8fd2-2e863a09304d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077152 Oct 04 18:34:23.222871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3841/5532] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:23.241581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:23.386398 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e784761-3dd2-425d-bf33-7c0b16ce4f96 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 204 len: 0 microversion: 2.1 time: 0.245427 Oct 04 18:34:23.387307 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1692/5533] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:23 2022] DELETE /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:23.401090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.402687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.412934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.415148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.416430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.417888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.420326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.421748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.613018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.623301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-05e3efbb-4a7b-4a78-85e0-b9304c48c8aa tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1688 microversion: 2.1 time: 0.230270 Oct 04 18:34:23.623997 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3842/5534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:24.654833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.656213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.668322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.669504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.670523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.672752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.673819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.674580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.112672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.125095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a87f9f92-4049-4a70-ac0e-675c4f1cc82e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1688 microversion: 2.1 time: 0.480974 Oct 04 18:34:25.126107 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1693/5535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1688 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:25.851199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44343073-1c2b-42d1-8bb7-6c9d4e86dd26", "name": "network-vif-deleted", "tag": "ed668efe-d214-4b4d-8ff2-88f244a4bd75"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:25.873378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.874483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.875454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.900559 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] Creating event network-vif-deleted:ed668efe-d214-4b4d-8ff2-88f244a4bd75 for instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 on n-h2-831193-17 Oct 04 18:34:25.910380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-953f57ea-a0a9-4074-9ff1-91b471f1993b req-de9680b4-fa34-4ea8-b655-95dc2a81f352 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068822 Oct 04 18:34:25.912298 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3843/5536] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:26.149856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.150651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.159355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.160010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.160575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.161398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.161976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.162502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.207744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.208248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.208704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.209249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lazy-loading 'fault' on Instance uuid 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:26.323792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.341774 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-25936fcf-93ae-4574-8d56-155ab5f5f73d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 200 len: 1357 microversion: 2.1 time: 0.196219 Oct 04 18:34:26.342463 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1694/5537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.086383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1266545027", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b176f5ab-5197-4e2a-b136-d4fa5f223a05", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:27.375610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:27.385032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.385926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 44343073-1c2b-42d1-8bb7-6c9d4e86dd26] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.393358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.393975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.394490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.395431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.395954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.396649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.411718 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] HTTP exception thrown: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Request method failure captured: Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 HTTP/1.1 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHvC0sDYotRCNSl5y7B5VEJzrL_XzHLt-vDiLnZriasYgd6E0aNo2Yq-bBHpYSoVqox4DGd9pVVZp5ltSwg9mATka_4fu5j8qn871nnfzQOo2eJhk_vnFL9mzcmv3qXEt3d4kcvFscKf25VWnTVnV2zpkv_CwsjE1-aF5psHdcwbDaw Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: d08b5214fa914274895bcbd0267ad03a Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '44343073-1c2b-42d1-8bb7-6c9d4e86dd26'} Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.413423 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Returning 404 to user: Instance 44343073-1c2b-42d1-8bb7-6c9d4e86dd26 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9e30dedf-0183-44d6-b7da-235b5fa792ea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26" status: 404 len: 111 microversion: 2.1 time: 0.034653 Oct 04 18:34:27.419407 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1695/5538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/44343073-1c2b-42d1-8bb7-6c9d4e86dd26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:27.871316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:27.871752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:27.872538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:27.872948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:27.873407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:27.887927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.888336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.889011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.889507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.890198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.890647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.912811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:27.920021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:27.935670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:27.937871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b176f5ab-5197-4e2a-b136-d4fa5f223a05',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:28.017223 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a58bd201-f39c-4f49-8022-0d8365e3a9b5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938618 Oct 04 18:34:28.018280 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3844/5539] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:28.038356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4d1e6c7-7690-44f3-9bc0-c3b1939c158e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.042442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4d1e6c7-7690-44f3-9bc0-c3b1939c158e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.128999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4d1e6c7-7690-44f3-9bc0-c3b1939c158e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.137793 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4d1e6c7-7690-44f3-9bc0-c3b1939c158e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1057 microversion: 2.1 time: 0.109493 Oct 04 18:34:28.139071 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1696/5540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1057 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.170560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.171703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.185545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.187477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.189184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.190784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.191945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.193164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.285006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.301257 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff0520c5-764b-4399-a46d-f44da36728e7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1109 microversion: 2.1 time: 0.139576 Oct 04 18:34:29.302473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3845/5541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1109 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.331769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.332411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.355763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.356658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.357109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.358366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.359289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.359934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.541482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.557722 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1cd6556d-fd7c-4226-ac81-fbc5a1ba3c35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1127 microversion: 2.1 time: 0.230065 Oct 04 18:34:30.573863 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1697/5542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1127 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.582651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.583615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.600954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.602006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.602452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.603250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.603727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.604163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.897537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.907170 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-869039d5-4423-4b7c-b022-09f24cd0dad2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.328833 Oct 04 18:34:31.920336 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3846/5543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.215364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad3ff95-bbec-4487-afa5-791b81dce03e", "tag": "08bee465-abf9-438b-a7e2-d4080a64caae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:32.252949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.253960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.254887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.276361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] Creating event network-changed:08bee465-abf9-438b-a7e2-d4080a64caae for instance 2ad3ff95-bbec-4487-afa5-791b81dce03e on n-h1-831193-17 Oct 04 18:34:32.297186 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8c6fa60f-1825-46a8-8f7a-799282593af4 req-c0daea24-bdb5-4537-93de-8f71ee9a1f7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092407 Oct 04 18:34:32.300098 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1698/5544] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:32.930066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.931380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.952192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.952714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.953165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.953955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.954466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.954801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.187707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.202632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-29090deb-acdc-4515-9a97-ed013e7fc226 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '.version_select at 0x7f6341adfc10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.235316 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5d28d8d2-45c9-40ec-9bc5-acb66ea7c8ad tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.289840 Oct 04 18:34:33.239442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3847/5545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.278621 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-29090deb-acdc-4515-9a97-ed013e7fc226 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538522057" status: 202 len: 0 microversion: 2.1 time: 0.099591 Oct 04 18:34:33.280487 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1699/5546] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 18:34:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538522057 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:33.327844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5a45b8f-5ee3-4ed3-91d7-b5a918169573 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: .version_select at 0x7f6340080040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-407652583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2pXJkeosZUjObb5MGAhtJBErh9HNNRhcrjpc8oWq1fHNvi0tPSGFO38z8jZMhaXRqdODp74ZEWL09PTzHpEl0wQ/+xC1sBrbfQnsVFZdcypB6QQ605qJqv/tLFnNDIXg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:33.352605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b5a45b8f-5ee3-4ed3-91d7-b5a918169573 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:33.365328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b5a45b8f-5ee3-4ed3-91d7-b5a918169573 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:33.411554 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5a45b8f-5ee3-4ed3-91d7-b5a918169573 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.092044 Oct 04 18:34:33.413527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3848/5547] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:34:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:34.268598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.269481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.279207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.279823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.280351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.281347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.282084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.282755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.498245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.514635 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eb8fb6f8-680f-46a4-a0c3-cfae983f139c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.254515 Oct 04 18:34:34.531325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1700/5548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.542067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.542794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.557356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.560750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.561444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.564229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.567385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.568206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.803333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.814156 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b87c9846-0e3b-4ed1-9407-9a79c104e29b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.277762 Oct 04 18:34:35.815689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3849/5549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.842498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.843829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.857543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.860123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.860826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.863648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.864586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.865659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.132648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.143564 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ff87e764-f26f-43ab-b10f-e5919adb75a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.305257 Oct 04 18:34:37.144472 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1701/5550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:38.174002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.177233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.185148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:38.187308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.188010 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.188610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.189501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.190280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.191309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.444495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.467432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19aeb1bc-3511-43de-9775-dfe95018c02a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.300609 Oct 04 18:34:38.486434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3850/5551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:39.496855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.497609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.500382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:39.515464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.515987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.516449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.517183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.517644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.518267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.807472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.823419 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fd20ef09-096f-4b64-b251-cde0b4cece3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.329143 Oct 04 18:34:39.837921 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1702/5552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:40.845009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.846344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.869432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.870504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.874921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.876303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.880148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.880761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.372424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.401590 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac5bf335-3b5d-4ed0-b1af-8ff1a66c4f62 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.561026 Oct 04 18:34:41.420908 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3851/5553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.446548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.447738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.455512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.456289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.456954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.457837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.458479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.459116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.708028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.719084 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c4a35bdb-857b-4aae-b687-2661061cb02c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.278084 Oct 04 18:34:42.719635 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1703/5554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.223820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-462517177", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1801581f-b720-4890-9fdd-10d52d5174e8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-407652583", "security_groups": [{"name": "tempest-secgroup-smoke-1354769532"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:43.373194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] validate_networks() for [('1801581f-b720-4890-9fdd-10d52d5174e8', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:43.379290 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:43.742770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.744084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.752921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.753965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.754633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.755848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.756490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.757943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.923437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:43.924734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:43.926219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:43.927772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:43.928826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:43.950541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.953097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.954011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.955560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.958116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.958647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.962448 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3337ed5a-1e1e-4e03-a9c0-c9b2c10e1b2b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.223974 Oct 04 18:34:43.967081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.967322 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1704/5555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:43.989193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:43.996432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:44.028956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:44.033411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:44.090711 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ea9cb3a-15cd-434a-9242-2383eb39d63d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871459 Oct 04 18:34:44.097801 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3852/5556] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:44.103445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d3adeb1-25f0-4656-ad13-24dc3bc69a48 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.104312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d3adeb1-25f0-4656-ad13-24dc3bc69a48 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.187338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d3adeb1-25f0-4656-ad13-24dc3bc69a48 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.196157 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d3adeb1-25f0-4656-ad13-24dc3bc69a48 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1265 microversion: 2.1 time: 0.095486 Oct 04 18:34:44.197103 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1705/5557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.005251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.005872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.014563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.015140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.015603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.016547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.017320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.019071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.220555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.221190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.223848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:45.243740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.244369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.245062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.245859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.246393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.246928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.255345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:45.292947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.310411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4e3ffd81-5c81-45c5-aa40-8911740a307b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.317698 Oct 04 18:34:45.326708 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3853/5558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.336740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.344987 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-867e81a0-54f0-4822-99c3-a9a63e632622 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1317 microversion: 2.1 time: 0.128291 Oct 04 18:34:45.346017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1706/5559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1317 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:46.333805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.334440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.345398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.346815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.347942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.349380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.350330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.351228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.371284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.373892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.397362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.398709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.398940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.399734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.404474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.415315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.823319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.839300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.841428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-289c543d-d626-43f8-8da7-f795f6b6bedc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.511572 Oct 04 18:34:46.842558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3854/5560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.849541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a81946c5-37d5-474e-a3ef-34c3db5dcf7e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.484378 Oct 04 18:34:46.863058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1707/5561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:47.702584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:47.725330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.726875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.727537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.879298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.879298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.893931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.894264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.894820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.895976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.896679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.898042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.155158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] Creating event network-changed:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h2-831193-17 Oct 04 18:34:48.164693 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3f8571f7-f58c-4010-84a4-b5b969ed3785 req-d70c4c4a-23d8-420a-9d4a-60ff7b5db0ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465246 Oct 04 18:34:48.166155 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3855/5562] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:48.182027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.183683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.200853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.202505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.204591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.206196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.207336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.208551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.298243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.309778 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36d0c262-d589-45d4-a95f-acd856965d0a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.439584 Oct 04 18:34:48.311086 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1708/5563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:48.550190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.574948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c4b190c-b60a-4652-b72b-0e34ddafc7a0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1169 microversion: 2.1 time: 0.406065 Oct 04 18:34:48.577270 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3856/5564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1169 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.345790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.346545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.356736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.357327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.357916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.358868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.359532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.360333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.602782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.603695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.608018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.612279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.612826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.613412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.614516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.615480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.616924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.622631 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16238224-3be9-4b1f-a4b7-5c27d8a56936 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.282515 Oct 04 18:34:49.625359 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1709/5565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.897182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.910601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a41a73bb-6c82-455e-8e95-f6f8318d97ee tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.312284 Oct 04 18:34:49.911405 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3857/5566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.662210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.662832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.669709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.670185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.670617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.671346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.671799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.672223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.822042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.830973 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50e4dc5b-03eb-491b-96bd-06094172d98b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.172810 Oct 04 18:34:50.831580 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1710/5567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.946477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.947157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.954436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.954940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.955434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.956150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.956617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.957056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.103055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.112197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59063b73-9c58-41fc-8641-4997616b426f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.170141 Oct 04 18:34:51.112931 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3858/5568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.856068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.856694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.866902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.867560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.868012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.869115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.869585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.870631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.011187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.018944 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6918b8f6-7bb9-438f-b437-2abecd11ea32 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.168286 Oct 04 18:34:52.019554 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1711/5569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:52.137449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:52.138127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:52.141835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:52.147953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.148472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.148926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.149671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.150289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.150935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.154557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=89 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:52.287166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.295823 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-351f6f09-8cca-4a14-8d0d-cb2358222939 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.162425 Oct 04 18:34:52.296399 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3859/5570] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.041516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.042126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.049025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.049505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.049939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.050624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.051106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.051530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.208043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.217325 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-530707c2-3751-4ef7-b0ce-80504532297e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.179540 Oct 04 18:34:53.217903 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1712/5571] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.318763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.319689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.327907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.328601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.329153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.330014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.330578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.331201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.470245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.478937 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d1afc663-b27e-4e45-9cf6-6be7b3ab03ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.164548 Oct 04 18:34:53.479552 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3860/5572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.496932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "name": "network-vif-plugged", "status": "completed", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:53.506922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.507543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.508047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.519472 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] Creating event network-vif-plugged:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h2-831193-17 Oct 04 18:34:53.524774 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9327261b-1013-46eb-aa5e-1d6f8c06c098 req-a6eea5dc-7d43-4f36-bcd6-f0b9754635ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Oct 04 18:34:53.525587 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1713/5573] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:54.241609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.242229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.244182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:54.244849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:54.251075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.251574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.252022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.252726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.253192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.253629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.398414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.406535 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d10f66a6-ac29-4760-8445-1ae8f6143b4d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1391 microversion: 2.1 time: 0.168860 Oct 04 18:34:54.407131 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3861/5574] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.504302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:54.511957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.512916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.522196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.522921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.523612 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.524617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.525269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.525911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.668216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.676501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae1f7b4a-3b7c-4f51-b8a9-1d2efff94db5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.175097 Oct 04 18:34:54.677197 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1714/5575] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:55.430161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.430751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.437905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.438402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.438851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.439605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.440071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.440505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.597561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.605542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3be38c4b-7af7-4e3e-9ccc-6213ce5f53e3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1563 microversion: 2.1 time: 0.179473 Oct 04 18:34:55.606123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3862/5576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:55.627530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.628537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.636276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.636758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.637195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.637884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.638342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.638765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.700348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.700967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.707773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.708258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.708634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.709360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.710345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.710794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.816597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.827225 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3b554466-9175-44a9-b4f1-51ed691cabe7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1563 microversion: 2.1 time: 0.203420 Oct 04 18:34:55.827813 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1715/5577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:55.866998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.875114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-758a6e03-399f-458e-86a3-00ac4a229a52 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.178610 Oct 04 18:34:55.875925 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3863/5578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:56.900037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.900693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.908424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.908943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.909716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.910477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.910958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.911403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.066692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.079362 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50b3a46d-e38c-479b-958d-0d4b7ba61a64 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.183636 Oct 04 18:34:57.080225 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1716/5579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.507500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:57.508956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.510158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.517197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.517681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.518209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.524508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.525493 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.526420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.527899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.529354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.529910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.530515 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] Creating event network-changed:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h2-831193-17 Oct 04 18:34:57.537208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3997f8f4-5a9b-4edd-8452-5c7064d06261 req-3b9bdc5d-1bbf-4c72-9909-0aa2ce729c11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033347 Oct 04 18:34:57.538273 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1717/5580] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:58.069699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.082502 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa463d49-c83e-446b-b46f-ccc240ecdb2a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1563 microversion: 2.1 time: 0.579004 Oct 04 18:34:58.083638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3864/5581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1563 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.106329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.107628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.119714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.121087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.122341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.123709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.124743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.125736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.348458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.357676 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a64a2889-289b-4eef-a4d6-0cd2d120afc3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.256979 Oct 04 18:34:58.369111 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1718/5582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:59.381294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.381913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.389190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.389693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.390144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.390863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.391360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.391800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.528773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.536777 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fb677662-26f4-4cae-86ee-6059bc61acaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.159660 Oct 04 18:34:59.537362 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3865/5583] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:00.560822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.561452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.568549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.569620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.570072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.570786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.571275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.571713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.742878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.750806 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de91da93-2e1b-43ab-99e9-fcb189122831 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.193886 Oct 04 18:35:00.751769 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1719/5584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:00.793391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad3ff95-bbec-4487-afa5-791b81dce03e", "name": "network-vif-plugged", "status": "completed", "tag": "08bee465-abf9-438b-a7e2-d4080a64caae"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:00.808657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.809165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.809608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.822714 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] Creating event network-vif-plugged:08bee465-abf9-438b-a7e2-d4080a64caae for instance 2ad3ff95-bbec-4487-afa5-791b81dce03e on n-h1-831193-17 Oct 04 18:35:00.829540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6d433fba-3f09-4cda-9bf1-a579de55dbfd req-b72c1fbe-4f6a-4e73-b066-de81d1bdeeae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039835 Oct 04 18:35:00.830649 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3866/5585] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:01.776032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.776721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.784104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.784595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.785035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.785729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.786184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.786614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.922583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.941155 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f7977355-099d-4294-8cb0-af2645d98539 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1203 microversion: 2.1 time: 0.169609 Oct 04 18:35:01.953712 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1720/5586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.964911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.966340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.973040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.973530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.974066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.974788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.975796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.976232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.120743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.129004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b97d5256-e4f8-45db-ac55-f8b9faeaaecf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1390 microversion: 2.1 time: 0.168450 Oct 04 18:35:03.129793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3867/5587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.151100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.151698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.158872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.159453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.159969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.160821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.161298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.161727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.309222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.317521 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a991b191-6806-415f-9c6d-8bcb9c344be4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1390 microversion: 2.1 time: 0.170227 Oct 04 18:35:03.318106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1721/5588] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.340020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.340682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.346829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.347350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.347798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.348504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.348967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.349400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.486206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.499356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a0595c4-3130-4ce4-895d-4d5b0c653b10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1390 microversion: 2.1 time: 0.163245 Oct 04 18:35:03.499954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3868/5589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.591356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.592056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.598095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.599060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.599060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.600174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.600174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.600852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.626311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:03.673917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:03.710955 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-705fcdd1-c297-41bc-86bb-cf8e28faaf37 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 204 len: 0 microversion: 2.1 time: 0.123680 Oct 04 18:35:03.712123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1722/5590] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:03 2022] DELETE /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:03.720265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.720880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.727481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.727977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.728425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.729130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.729597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.730028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.875944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.883833 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-922a87a3-2983-4346-b850-939cb9b52eed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1396 microversion: 2.1 time: 0.167512 Oct 04 18:35:03.884597 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3869/5591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:04.906848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.907523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.914422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.914922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.915380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.916070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.916523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.916952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.052673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.061284 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-28e116d0-9ea6-4575-8169-ba74b82491c0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1396 microversion: 2.1 time: 0.159127 Oct 04 18:35:05.062087 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1723/5592] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:05.690857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad3ff95-bbec-4487-afa5-791b81dce03e", "name": "network-vif-deleted", "tag": "08bee465-abf9-438b-a7e2-d4080a64caae"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:05.705068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.705611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.706005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.725855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] Creating event network-vif-deleted:08bee465-abf9-438b-a7e2-d4080a64caae for instance 2ad3ff95-bbec-4487-afa5-791b81dce03e on n-h1-831193-17 Oct 04 18:35:05.732151 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-24debcb2-774e-4504-9984-eb4b9e142a42 req-ab26cb7b-43b6-4d05-b004-9b049f8b5264 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045995 Oct 04 18:35:05.733047 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3870/5593] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:06.085822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.086372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.093562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.094056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.094493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.095224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.095678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.096100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.176150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.184172 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-750baf79-345f-4c0c-b20e-33d36a9d0ffc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1188 microversion: 2.1 time: 0.102951 Oct 04 18:35:06.184751 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1724/5594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:07.212633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.213816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.222942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.223776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.224545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.226327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.226922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.227408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.299817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.308888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59ee29cc-d283-44c2-b7f1-46cb478bd97e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1188 microversion: 2.1 time: 0.104364 Oct 04 18:35:07.309804 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3871/5595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:08.332503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.333139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.340390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.340873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.341425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.342140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.342596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.343021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.413792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.421987 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a8b437f9-e187-4f21-afda-73e0bc076ac6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1188 microversion: 2.1 time: 0.093351 Oct 04 18:35:08.422563 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1725/5596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:09.446296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:09.446952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:09.454449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.454953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.455436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.456168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.456657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.457072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.525702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.533984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-78ac9deb-5409-476a-9cad-876abf8d2608 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 200 len: 1188 microversion: 2.1 time: 0.092218 Oct 04 18:35:09.534559 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3872/5597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:09 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:10.558004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.558614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.565814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.566299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.566735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.567535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.567921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.568351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.582554 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e HTTP/1.1 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2ad3ff95-bbec-4487-afa5-791b81dce03e'} Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:10.584409 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:10.590156 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e414acc3-f1c4-448d-9292-b97ba5e5e37f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 404 len: 111 microversion: 2.1 time: 0.032665 Oct 04 18:35:10.591275 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1726/5598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:13.807332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.808161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.815417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.815923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.816328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.817039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.817501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.818035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.833396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e HTTP/1.1 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2ad3ff95-bbec-4487-afa5-791b81dce03e'} Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:13.835570 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-40c6b893-f406-45d1-a9df-e46565aea0b3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 404 len: 111 microversion: 2.1 time: 0.034495 Oct 04 18:35:13.840399 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3873/5599] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:13 2022] DELETE /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:13.846217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.847323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 2ad3ff95-bbec-4487-afa5-791b81dce03e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.855551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.856049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.856488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.857229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.857689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.858118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.873880 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e HTTP/1.1 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2ad3ff95-bbec-4487-afa5-791b81dce03e'} Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:13.876428 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 2ad3ff95-bbec-4487-afa5-791b81dce03e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f6a62f1-2c50-4903-b8c8-06fa57977edc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e" status: 404 len: 111 microversion: 2.1 time: 0.036546 Oct 04 18:35:13.882957 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1727/5600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/2ad3ff95-bbec-4487-afa5-791b81dce03e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:19.396114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:19.399410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:19.406992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.407508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.408175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.408918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.409389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.409813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.466425 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-be73dedb-f7ae-4b11-87b8-526cf09fb186 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action" status: 200 len: 24572 microversion: 2.1 time: 0.075795 Oct 04 18:35:19.467110 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3874/5601] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:19 2022] POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:25.856361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.857082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.859503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:25.860242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:25.867895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.868394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.868843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.869558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.870016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.870446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.054759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.066532 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e7295ba2-97f6-4d18-80ee-c1d61e894892 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1682 microversion: 2.1 time: 0.214427 Oct 04 18:35:26.067345 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1728/5602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.225721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.228101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.230956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=32 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:26.237754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.238761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.239432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.241061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.241749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.242187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.263827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=82 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:26.309314 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9f83b705-b29f-47e4-a15b-6a5a5530b897 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action" status: 200 len: 32648 microversion: 2.1 time: 0.088516 Oct 04 18:35:26.310697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3875/5603] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action => generated 32648 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:26.543078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.544329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.554364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.555148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.555767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.556917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.557529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.558392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.799146 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8f087797-73f7-4b39-ae0a-f51e747ebe52 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1835 microversion: 2.1 time: 0.259804 Oct 04 18:35:26.800263 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1729/5604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1835 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.840579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.843794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.852554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.853169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.853502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.854215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.854673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.855128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.886945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lazy-loading 'flavor' on Instance uuid 170b23a1-8526-456d-b731-182d5e43654f {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:26.903966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Going to try to live migrate instance to another host {{(pid=128770) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:35:28.801440 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d245a0a6-ea2d-4ce7-b179-2b353c97ca7e tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action" status: 202 len: 0 microversion: 2.1 time: 1.965373 Oct 04 18:35:28.806713 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3876/5605] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action => generated 0 bytes in 1973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:28.906872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.907600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.915090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.916171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.916717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.917485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.917966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.918440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.100370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.110546 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c70343bd-66e6-483f-af22-c7b8aef71101 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.302536 Oct 04 18:35:29.111408 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1730/5606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:30.050555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "name": "network-vif-unplugged", "status": "completed", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:30.062325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.062682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.063480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.075642 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] Creating event network-vif-unplugged:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h2-831193-17 Oct 04 18:35:30.080885 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-89ef1708-9dd6-46a7-ab98-074cd2158066 req-f112dd7e-b56b-4e89-89ef-0b60d32c491c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034506 Oct 04 18:35:30.082263 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3877/5607] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:30.137693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.138688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.148018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.148672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.149256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.150237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.151013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.152004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.299963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.308948 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d76c926-f52e-47eb-9fdd-500770094b02 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.175808 Oct 04 18:35:30.309535 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1731/5608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.334936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.336347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.343640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.344129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.344572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.345279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.345736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.346163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.492409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.501051 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e7698e1-0a74-44b2-bb7f-55fc86470074 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.170814 Oct 04 18:35:31.501639 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3878/5609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.120530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:32.131922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.132412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.132838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.148022 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] Creating event network-changed:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h2-831193-17 Oct 04 18:35:32.153895 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2025bbc6-0a59-4ad1-9ef3-908564cd1d23 req-d84faef0-73ad-42d6-8aa3-b01f366d3345 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037191 Oct 04 18:35:32.154684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1732/5610] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:32.524916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.525540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.534567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.535091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.535541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.536273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.536796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.537231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.775765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.790785 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-58a42e60-37a3-4a02-883f-283d3a3bae90 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.270129 Oct 04 18:35:32.807176 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3879/5611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:33.819078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:33.820057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:33.828121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.828627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.829308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:33.830053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.830993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.831191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:33.988565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.997526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3f7bfed4-de94-4548-9ec3-223a3b77d947 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.185122 Oct 04 18:35:33.998137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1733/5612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:33 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.021046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.021655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.028973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.029460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.029902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.030628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.031109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.031541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.170217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.178611 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e719d005-6f5c-4a32-8758-1e22885c5683 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.161490 Oct 04 18:35:35.179226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3880/5613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.930494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-732721982", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8f132078-c129-4aa5-a356-f5b053028e35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:35.996018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:36.203173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.203795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.212472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.213334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.213974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.214857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.215563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.216161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.443684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.452571 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6dcb9a34-cd0e-48dd-a022-a6b5aefa45ff tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1692 microversion: 2.1 time: 0.253870 Oct 04 18:35:36.465925 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3881/5614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1692 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.540029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:36.540580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:36.541320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:36.541739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:36.542359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:36.558470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.559138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.559618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.560697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.561155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.561671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.583558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:36.589276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:36.649850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:36.652111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f132078-c129-4aa5-a356-f5b053028e35',volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:36.794772 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a04da8b4-1775-46ea-a96f-97b1e7ffdba7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868362 Oct 04 18:35:36.795606 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1734/5615] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:36.808767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2abc3b61-2713-4b74-ab73-2ac369ecc9d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.809843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2abc3b61-2713-4b74-ab73-2ac369ecc9d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.872873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2abc3b61-2713-4b74-ab73-2ac369ecc9d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.881062 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2abc3b61-2713-4b74-ab73-2ac369ecc9d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1070 microversion: 2.1 time: 0.076765 Oct 04 18:35:36.882592 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3882/5616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1070 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.479333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.480006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.490793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.491679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.492127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.492855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.493328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.493741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.639904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.649954 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-00f7d990-7e2d-4a42-8fdc-1fd7af2f3bed tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1682 microversion: 2.1 time: 0.175744 Oct 04 18:35:37.650549 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1735/5617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.673434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.674706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.686861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.687413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.687858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.688600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.689092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.689524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.854126 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c626225c-629b-4b9a-885d-a753152d6004 tempest-TestNetworkAdvancedServerOps-807165866 tempest-TestNetworkAdvancedServerOps-807165866-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1835 microversion: 2.1 time: 0.184369 Oct 04 18:35:37.854933 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3883/5618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1835 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.879386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.880016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.886647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.887452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.887904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.888621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.889086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.889522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.905794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.906556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.913791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.914406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.914852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.915765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.916506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.917178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.994878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.005476 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-18febfd6-5a89-4b76-93e9-ed7454aad92b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1176 microversion: 2.1 time: 0.104891 Oct 04 18:35:38.016596 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3884/5619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1176 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:38.098301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.109484 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2a97072-0d79-4296-adb6-c5c86d9df6ef tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1682 microversion: 2.1 time: 0.234661 Oct 04 18:35:38.110936 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1736/5620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.243745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:38.247007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.254682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.255542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.256219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.256951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.257420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.257864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.314512 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2970e8a9-56ae-417b-89f9-fa1474b17084 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action" status: 200 len: 38470 microversion: 2.1 time: 0.075539 Oct 04 18:35:38.315426 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3885/5621] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:38 2022] POST /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f/action => generated 38470 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:35:39.030351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.031807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.040413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.041210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.041877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.043297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.043980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.045142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.637466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5b2bf1-4556-41b3-a7f7-925542bc8a9e", "tag": "704e562c-d3e8-4071-ad06-c63e43cf8ad3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:39.659096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.661251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.663549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.686274 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] Creating event network-changed:704e562c-d3e8-4071-ad06-c63e43cf8ad3 for instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e on n-h1-831193-17 Oct 04 18:35:39.697217 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1bfa82b7-42a9-4439-b02f-617ade55d52f req-c8e81172-076b-4460-aaf7-a9bcf5c11e8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082863 Oct 04 18:35:39.698519 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3886/5622] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:39.734161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.750245 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-16b01974-6506-4ec8-bb4b-5227c0757471 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1228 microversion: 2.1 time: 0.718255 Oct 04 18:35:39.751615 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1737/5623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1228 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.972888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.974540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.984377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.985642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.987332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.988445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.989371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.990665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.990996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:40.010848 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.017468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.018012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.031826 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] Creating event network-changed:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h1-831193-17 Oct 04 18:35:40.039385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:40.039956 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e026c01e-558a-4111-8a17-ef6391e557c2 req-83d5dc7c-d144-4bfc-ae3a-68b9908101ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054625 Oct 04 18:35:40.041948 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1738/5624] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:40.279876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-afefaf3c-f2e2-498c-a0c6-74ecdac6da3e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 204 len: 0 microversion: 2.1 time: 0.311106 Oct 04 18:35:40.281050 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3887/5625] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:39 2022] DELETE /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:40.292194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.292981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.304717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.305810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.306438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.307418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.308536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.309427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.564055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.573108 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdf447fa-1e82-4395-be5b-2555b72c367a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1688 microversion: 2.1 time: 0.286407 Oct 04 18:35:40.578380 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1739/5626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.775612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.776976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.796911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.797628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.798206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.799060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.799637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.800179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.240534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.259173 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa77b1b9-d75e-473a-bced-4c0aaf54fd3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1228 microversion: 2.1 time: 0.486089 Oct 04 18:35:41.262011 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3888/5627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1228 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.600140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.601682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.640520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.643265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.651358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.651903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.652424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.662850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.773074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.785350 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b02b8e15-c040-41d8-a6cb-3edb4301c851 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 200 len: 1501 microversion: 2.1 time: 0.190537 Oct 04 18:35:41.787318 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1740/5628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.059527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170b23a1-8526-456d-b731-182d5e43654f", "name": "network-vif-deleted", "tag": "aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:42.075602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.076199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.076739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.092815 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] Creating event network-vif-deleted:aed384c0-4fef-4e0d-9b3b-e3802ce8d5ea for instance 170b23a1-8526-456d-b731-182d5e43654f on n-h1-831193-17 Oct 04 18:35:42.098587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-94689d8a-0d2a-4631-ab93-5b9800200ee2 req-fef09b4e-7aa0-4911-8761-c8200ec9c9c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043543 Oct 04 18:35:42.099606 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3889/5629] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:42.285129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.285664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.292661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.293166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.293611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.294395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.294860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.295329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.446104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.456830 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eedd81bd-3a23-4670-84c2-3e63fae24437 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1228 microversion: 2.1 time: 0.173758 Oct 04 18:35:42.456830 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1741/5630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1228 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.813594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.815100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 170b23a1-8526-456d-b731-182d5e43654f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.826935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.828075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.828871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.830311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.836466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.836466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.849933 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] HTTP exception thrown: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Request method failure captured: Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f HTTP/1.1 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHvC0sDYotRCNSl5y7B5VEJzrL_XzHLt-vDiLnZriasYgd6E0aNo2Yq-bBHpYSoVqox4DGd9pVVZp5ltSwg9mATka_4fu5j8qn871nnfzQOo2eJhk_vnFL9mzcmv3qXEt3d4kcvFscKf25VWnTVnV2zpkv_CwsjE1-aF5psHdcwbDaw Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d08b5214fa914274895bcbd0267ad03a Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '170b23a1-8526-456d-b731-182d5e43654f'} Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:42.851736 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Returning 404 to user: Instance 170b23a1-8526-456d-b731-182d5e43654f could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2ab4286-a504-4ac3-85ea-10f634e11161 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f" status: 404 len: 111 microversion: 2.1 time: 0.045592 Oct 04 18:35:42.857064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3890/5631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/170b23a1-8526-456d-b731-182d5e43654f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:43.477713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.478364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.487690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.488373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.489015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.490252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.492310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.492310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.708751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.717466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88e78ae5-af8c-43db-ba0e-077883a8197f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1228 microversion: 2.1 time: 0.243738 Oct 04 18:35:43.718142 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1742/5632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1228 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.740165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.741088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.747962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.748465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.749584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.750320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.752421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.753664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.947070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.959618 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f075901f-4f36-4838-89d9-bb5bd1c34569 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.223088 Oct 04 18:35:44.961307 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3891/5633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:45.986674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.988018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.996058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.996824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.997464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.998412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.998915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.999385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.137123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.146720 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6df7b97b-d58d-4dfe-9edc-c1e22654619d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.164898 Oct 04 18:35:46.147343 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1743/5634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:46.435298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-396fee65-4495-4c6f-82a5-d36ac9918006 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '.version_select at 0x7f633bf03310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.456690 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-396fee65-4495-4c6f-82a5-d36ac9918006 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-407652583" status: 202 len: 0 microversion: 2.1 time: 0.025942 Oct 04 18:35:46.457371 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3892/5635] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 18:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-407652583 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:46.484723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82a64bf2-d346-465f-98dc-c5162fac9c74 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: .version_select at 0x7f6345c3b5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1778751121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdcTCyI0oPmetaUlkRnSPdOF8FVzZsgyDBNj3ocmuVLwr9dsy/k3VJBRdCJB3ixIF+wd4byy5YQBTyxxvSUbWENimDxqfRhcnJRusfj6BUgS3DGskk2cfuY+F8Xw2lleA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:46.500681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-82a64bf2-d346-465f-98dc-c5162fac9c74 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:46.507355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-82a64bf2-d346-465f-98dc-c5162fac9c74 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:46.532497 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82a64bf2-d346-465f-98dc-c5162fac9c74 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051617 Oct 04 18:35:46.533062 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1744/5636] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:47.167450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:47.172440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.173198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.181696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.182235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.182718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.183462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.183932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.184377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.377059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.379325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:47.386871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29997c3b-308a-4885-9772-70dbd76ed2ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.220358 Oct 04 18:35:47.387712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3893/5637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.411070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.411697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.413674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:48.420808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.421295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.421736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.422437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.422901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.423349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.573093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.581961 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6c331316-90a8-41f2-992c-eb59cca56f48 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.175290 Oct 04 18:35:48.582675 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1745/5638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:49.611965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.612909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.626300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.627406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.628243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.629368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.630657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.631302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.809709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.819090 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-24dcbeef-7a45-4942-877c-8a1c787b74f7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.212226 Oct 04 18:35:49.820315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3894/5639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.844277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.844998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.856198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.857335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.858095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.859276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.860408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.861046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.042607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.050704 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ff7849d-cf02-43e8-a9d3-a8000c23462b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.212433 Oct 04 18:35:51.051311 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1746/5640] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.074535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.075419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.083269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.083782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.084233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.084973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.085638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.086086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.232279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.242273 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4d2a271f-5b90-41c7-92bf-d8c219000c2d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.171681 Oct 04 18:35:52.242975 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3895/5641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.996128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-818696783", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "abf6fdbc-2fd2-44f0-8b88-3fe881ea92e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1778751121", "security_groups": [{"name": "tempest-secgroup-smoke-498843733"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:53.234816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] validate_networks() for [('abf6fdbc-2fd2-44f0-8b88-3fe881ea92e9', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:53.271150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.272306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.290090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.291292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.292317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.294673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.296511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.298138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.944337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.971702 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdd5ca84-437e-4763-b805-13df38087ed0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.707674 Oct 04 18:35:53.972896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3896/5642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:54.238732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:54.240423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:54.241601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:54.243238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:54.244145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:54.261348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.262931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.263558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.264637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.265592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.266173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.285754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:54.291929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Getting quotas for user d08b5214fa914274895bcbd0267ad03a and project 37bd5b5cb56a49cfb533786afec9ad89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:54.307427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:54.309805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:54.363653 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-047eb270-2bb6-4620-a3aa-e3679bc34a0c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.374278 Oct 04 18:35:54.364939 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1747/5643] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:35:54.384814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dcfb6d41-e868-4d6f-9e76-1a5e5f07957b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.386066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dcfb6d41-e868-4d6f-9e76-1a5e5f07957b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.476430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dcfb6d41-e868-4d6f-9e76-1a5e5f07957b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.484883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dcfb6d41-e868-4d6f-9e76-1a5e5f07957b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1266 microversion: 2.1 time: 0.107539 Oct 04 18:35:54.485479 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3897/5644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.015068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.017151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.030527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.031506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.033179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.034533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.035452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.037204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.048733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=100 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:55.406889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.420718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5b2bf1-4556-41b3-a7f7-925542bc8a9e", "name": "network-vif-plugged", "status": "completed", "tag": "704e562c-d3e8-4071-ad06-c63e43cf8ad3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:55.425765 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3337ffb1-20db-4f9e-804c-732b69486e79 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.426109 Oct 04 18:35:55.428285 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1748/5645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.441965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.444998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.445891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.475915 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] Creating event network-vif-plugged:704e562c-d3e8-4071-ad06-c63e43cf8ad3 for instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e on n-h1-831193-17 Oct 04 18:35:55.488049 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6f8c971b-ae20-486d-a67b-4a65876ba13c req-278a41a7-cc7f-4ed5-afb1-eb87da4a0ba0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388715 Oct 04 18:35:55.490587 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3898/5646] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:55.510068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.510888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.522078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.524708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.525445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.526573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.527261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.527881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.692771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.703674 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-68bc37c4-d343-44b3-8ed2-e6d0907c6c0d tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1318 microversion: 2.1 time: 0.198453 Oct 04 18:35:55.704869 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1749/5647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.462492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.463805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.467797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:56.474152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.474938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.475611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.476335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.476794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.477219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.690104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.700802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9cf47f04-ba19-476f-897d-b864322b4732 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1216 microversion: 2.1 time: 0.242880 Oct 04 18:35:56.701793 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3899/5648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.728939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.729964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.733268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:56.750144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.750760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.751535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.752832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.753580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.755869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.021267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.033414 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e20b5d0-edc2-48f5-820c-1fb860651813 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.309720 Oct 04 18:35:57.034298 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1750/5649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.726675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.727589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.735374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.736000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.736459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.737213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.737789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.738221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.846746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:57.858548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.859097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.859544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.872190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] Creating event network-changed:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:35:57.878438 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-dd23279e-55c5-4822-9e6c-4eb2f4b85774 req-0d8f1fb3-a80a-4218-bd21-baa77752f94c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119182 Oct 04 18:35:57.879395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1751/5650] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:58.038310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.054661 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f81ef444-80d8-4eaf-b3db-66d34f21454b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1404 microversion: 2.1 time: 0.332653 Oct 04 18:35:58.059169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.060167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.067366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.067722 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3900/5651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1404 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.067889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.068320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.069254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.069704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.070326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.082427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.083597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.090904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.091436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.091876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.092591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.093050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.093509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.527421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.535882 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ca18531-fa41-4afb-918b-810395ab7cc2 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.481430 Oct 04 18:35:58.536462 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1752/5652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.600111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.609567 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7316cebf-9848-4a38-a24f-3128af7a89cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1404 microversion: 2.1 time: 0.530916 Oct 04 18:35:58.610259 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3901/5653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.634606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-673685176"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:58.637051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.643409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.643902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.644350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.645046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.645515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.645938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.745781 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.compute.api [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Attempting to quiesce instance before volume snapshot. Oct 04 18:35:58.800296 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.compute.api [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 18:35:58.875868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Creating snapshot from volume 8f132078-c129-4aa5-a356-f5b053028e35. {{(pid=128771) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 18:35:59.560655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.561383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.574414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.574923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.576761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.577985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.578697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.579395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.900747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.919706 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef46b12c-0cad-4d11-94f5-509417e6a102 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.362596 Oct 04 18:35:59.932539 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3902/5654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:59.941376 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3b765b43-13ea-4aa0-b3af-d33526e0046b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e/action" status: 202 len: 0 microversion: 2.1 time: 1.309908 Oct 04 18:35:59.943667 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1753/5655] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:58 2022] POST /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e/action => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:36:00.946141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.946802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.954853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.955624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.956267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.957280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.957956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.958845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.106801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.116013 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b7b205f3-c579-4a73-9377-d7555b56a734 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.174372 Oct 04 18:36:01.127924 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3903/5656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.161665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-808022137", "imageRef": "6c2cb172-5c71-4ade-9cbb-0d568e96fa2d", "flavorRef": "452", "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:01.217852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:01.613525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:01.614027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:01.614537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:01.614984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:01.615433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:01.625029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.625519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.625968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.626703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.627200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.627639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.646276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:01.651945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:01.665922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:01.668620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3609b024-8d5e-4ed3-88cd-ed5386c39c7e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:01.749789 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22d7b158-f0d1-4f1f-8ca7-ba9062ce5589 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593490 Oct 04 18:36:01.750779 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1754/5657] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:01.762933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-939800ec-0eac-419f-b7b1-8f6a9caacf05 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.763622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-939800ec-0eac-419f-b7b1-8f6a9caacf05 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.846707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-939800ec-0eac-419f-b7b1-8f6a9caacf05 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.855346 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-939800ec-0eac-419f-b7b1-8f6a9caacf05 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1229 microversion: 2.1 time: 0.097228 Oct 04 18:36:01.856247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3904/5658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.145993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.146852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.157731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.158895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.159821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.161349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.162174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.164103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.365028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.375738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2358f3d2-5153-4ce2-81b0-0c83878317d9 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.237035 Oct 04 18:36:02.377050 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1755/5659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.880526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.881164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.890265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.890763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.891263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.892104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.892649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.893096 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.974430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.987456 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19d8ac90-2686-4512-92d8-5175e652951b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1281 microversion: 2.1 time: 0.112240 Oct 04 18:36:03.003264 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3905/5660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.411544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.413376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.421356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.422169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.423107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.424090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.424769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.425464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.698509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.708935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1fbde82d-c2bb-4eb4-904e-82e644c7dbfc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.302301 Oct 04 18:36:03.724901 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1756/5661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.013606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.015551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.023765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.032823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.033680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.036410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.039287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.040001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.138205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "name": "network-vif-plugged", "status": "completed", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:04.152565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.154823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.156039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.184110 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] Creating event network-vif-plugged:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:36:04.200088 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9b471275-3b7c-4ebd-b0e4-9df94038abd5 req-965201d6-2d70-4019-b676-9582e4221a83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065746 Oct 04 18:36:04.203369 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1757/5662] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:04.734136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.736176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.743342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.746715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.747841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.748556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.749572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.750341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.751077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.754172 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-101e1250-61c4-44ee-873d-170af2040e4b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.744953 Oct 04 18:36:04.757224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3906/5663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.037227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.047091 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26bcae03-afcf-4323-9e6b-3b610f381502 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1391 microversion: 2.1 time: 0.318355 Oct 04 18:36:05.047999 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1758/5664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:05.356765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5b8da-bca9-42f9-a3e4-60ff07984e47", "tag": "71820383-86b1-46a4-a3da-bd4b06ed319c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:05.370860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.371689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.372288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.389063 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] Creating event network-changed:71820383-86b1-46a4-a3da-bd4b06ed319c for instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 on n-h2-831193-17 Oct 04 18:36:05.395947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7921df93-b4e7-4a16-9fbe-e735c025f1a4 req-3f48e03d-4692-41ea-920a-5c3c0e42babc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048447 Oct 04 18:36:05.396955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3907/5665] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:05.787101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.789634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.804764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.805652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.807003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.808696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.810909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.811655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.038990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.049263 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7f7b6101-a134-4cf2-bca2-1751cb6a37ed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.271335 Oct 04 18:36:06.050244 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1759/5666] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.074300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.075505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.082225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.083007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.083502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.084218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.084871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.085315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.363576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.383941 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f75193ca-1a76-44c3-a1bd-9d94993a05cf tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1562 microversion: 2.1 time: 0.313827 Oct 04 18:36:06.384572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3908/5667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1562 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.414422 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.415068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.422984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.423730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.424323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.425213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.426022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.428291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.684751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.693779 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-545a36cf-4274-4ede-8d94-e28dca5eef73 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1562 microversion: 2.1 time: 0.284184 Oct 04 18:36:06.694525 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1760/5668] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1562 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.077878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.078638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.086240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.086992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.087638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.088357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.088832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.089432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.339506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.352779 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb938d99-d3d3-4628-9021-6f2a1f6264cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.279542 Oct 04 18:36:07.363896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3909/5669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.418239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.419801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.434500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.436149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.437005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.437866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.438526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.439075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.708711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.722243 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9a89b58d-d255-4801-a13b-f9e214a25664 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.312904 Oct 04 18:36:08.724320 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1761/5670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.239877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.241315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.251717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.252572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.253345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.254943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.255703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.256393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.376787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:09.390980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.391901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.392588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.406409 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] Creating event network-changed:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:36:09.413122 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5f78cca0-c235-4a52-96a7-7c6d54c6147e req-71df5a29-40d0-4558-b375-247f749c01ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180507 Oct 04 18:36:09.417644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3910/5671] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:09.424945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.437198 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-90cafe10-df6b-4789-add8-90cb9e16f8c6 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1562 microversion: 2.1 time: 0.203559 Oct 04 18:36:09.437876 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1762/5672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1562 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.765274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.766553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.780360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.781667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.782856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.784162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.785248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.786316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.196658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.205430 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-070d059f-a93d-43a2-bcce-c81e88a52c8f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.449272 Oct 04 18:36:10.206038 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3911/5673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.233077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.233986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.246977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.247870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.248568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.249810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.250760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.251402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.442032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.451296 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8de95b66-4a8b-4eff-99d8-928c23d8468a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.224267 Oct 04 18:36:11.451918 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1763/5674] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.480079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.481095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.487475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:12.493024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.493535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.493975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.494833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.495303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.495728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.662926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.671313 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7154233-f067-4b3f-acd2-5098bbf246ba tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.198875 Oct 04 18:36:12.672164 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3912/5675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:13.702100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.702969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.705302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.706009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.713558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.714071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.714537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.715308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.715996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.716436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.884421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.887409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.896944 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-52dd8a67-7f82-41c2-ba1d-c6e30c179d2e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.200257 Oct 04 18:36:13.897634 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1764/5676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.923302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.923928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.932230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.932877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.933433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.934248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.934922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.935550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.094363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.103617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9baa0817-af83-47a2-b6e5-49ceaacac3f3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.184251 Oct 04 18:36:15.104221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3913/5677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.137058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.138463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.148083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.148607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.149076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.149856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.150341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.150798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.329668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.338301 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0007fb5b-9ebb-4a67-9498-a2925ce1b623 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.205180 Oct 04 18:36:16.338909 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1765/5678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:17.369485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.370209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.377014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.377511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.377958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.378671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.379205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.379643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.399611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=100 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:17.534885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.543187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-29fc5762-0f2c-4228-85ba-6934d9de9c14 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.177911 Oct 04 18:36:17.543959 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3914/5679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.574091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.574972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.585122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.585835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.586485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.587367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.588051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.588586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.785119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.798770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f09f07ed-b76e-4df1-9863-680a8a339379 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.229515 Oct 04 18:36:18.799446 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1766/5680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.829148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.830166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.839137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.839712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.840160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.840876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.841338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.841767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.020433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.038451 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4630758-05b1-4cfe-ae5c-097c0b6671d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.215762 Oct 04 18:36:20.039236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3915/5681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:21.076429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.077679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.085318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.085662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.086139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.086843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.087339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.087774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.287418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.303251 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-13798d0e-2ef2-4fc9-8e2d-f1a6854fb416 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1341 microversion: 2.1 time: 0.233271 Oct 04 18:36:21.304133 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1767/5682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.330795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.331558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.346950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.348101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.349035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.350638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.351567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.352718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.546157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.556420 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5d512f6-3c15-49be-bdf8-615a00014d8e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.229537 Oct 04 18:36:22.557219 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3916/5683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:23.582102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.582736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.589969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.590472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.590927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.591689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.592159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.592677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.745060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.753887 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c9bd07d4-82e2-40b6-bee1-18eea7704f76 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.175415 Oct 04 18:36:23.754578 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1768/5684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.777540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.778457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.785378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.785872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.786314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.787051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.787513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.787944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.939820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.948544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca893945-7cc0-4752-97df-dc9aceb25c10 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.175069 Oct 04 18:36:24.949129 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3917/5685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:25.978420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.979977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.990124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.990722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.991526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.992175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.992694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.993113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.231517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.243905 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-561c8d8a-3e41-44e0-bd1b-9ebf6cde33a8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.273069 Oct 04 18:36:26.244921 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1769/5686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.277657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.278768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.282557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=40 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:27.290318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.291023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.291671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.292665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.293314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.293821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.452906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.461558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7bac4753-5039-4711-ac80-559e8560535a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.189622 Oct 04 18:36:27.462183 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3918/5687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.114209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5b8da-bca9-42f9-a3e4-60ff07984e47", "name": "network-vif-plugged", "status": "completed", "tag": "71820383-86b1-46a4-a3da-bd4b06ed319c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:28.124997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:28.135475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.136196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.136805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.149957 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] Creating event network-vif-plugged:71820383-86b1-46a4-a3da-bd4b06ed319c for instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 on n-h2-831193-17 Oct 04 18:36:28.155666 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-d3663e92-9b89-454b-a7ba-f4c728478f68 req-ff16710d-e865-4469-9006-135fe31064ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047471 Oct 04 18:36:28.156289 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1770/5688] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:28.487186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.488757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.498883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.499431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.500054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.500966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.501510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.502078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.671246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.684424 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f108f36-d426-43d7-976e-481d2cd48fea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1375 microversion: 2.1 time: 0.201809 Oct 04 18:36:28.685558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3919/5689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.725255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.726375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.734722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.735297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.735819 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.736566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.737199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.737764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.926796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.938227 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3ff00d66-134b-47c0-9446-6ce6469556f0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1562 microversion: 2.1 time: 0.220642 Oct 04 18:36:29.938847 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1771/5690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.969416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:29.971900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.972117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.973477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.983659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.984313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.984997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.985674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.986181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.986389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.986810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.987182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.987580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.988735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.989232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.989893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.079110 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e30f2230-5503-410a-a1fa-b402a56ab48c tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action" status: 200 len: 24573 microversion: 2.1 time: 0.114037 Oct 04 18:36:30.080322 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3920/5691] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:29 2022] POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action => generated 24573 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:30.205740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.216747 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a46f496a-2180-45f9-a396-440883349e3b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1562 microversion: 2.1 time: 0.250508 Oct 04 18:36:30.217525 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1772/5692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:30.320730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.321650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.332627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.333424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.334134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.335226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.336113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.336626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.373592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:30.478491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c152ec8a-f587-4342-a3f5-9e31c92370c3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 204 len: 0 microversion: 2.1 time: 0.163729 Oct 04 18:36:30.482637 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3921/5693] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:30 2022] DELETE /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:30.491341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.492521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.505045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.505660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.506321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.507330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.507998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.508539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.692636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.702163 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c53fa590-a5e1-43cf-aab0-f7d24c2f04cb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1568 microversion: 2.1 time: 0.216857 Oct 04 18:36:30.702774 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1773/5694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.725916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.726578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.735016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.735584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.736025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.736752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.737413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.738367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.907423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.918680 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ac7e8a22-9be6-4bef-863e-11d1d9281447 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1568 microversion: 2.1 time: 0.197363 Oct 04 18:36:31.919333 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3922/5695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.938252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5b8da-bca9-42f9-a3e4-60ff07984e47", "name": "network-vif-deleted", "tag": "71820383-86b1-46a4-a3da-bd4b06ed319c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:32.953109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.973715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.974044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.974044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.974044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.982991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.984106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.017781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.024828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] Creating event network-vif-deleted:71820383-86b1-46a4-a3da-bd4b06ed319c for instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 on n-h2-831193-17 Oct 04 18:36:33.030475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.032070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.038576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.041812 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5bddfe64-ba9c-4f22-92e2-5adedf3655dd req-a6a4a0eb-2020-415b-a903-41522a3ba421 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111373 Oct 04 18:36:33.044401 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1774/5696] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:33.409254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.420091 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67ba275f-fa29-45f2-b769-8695f1a84e84 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1360 microversion: 2.1 time: 0.479750 Oct 04 18:36:33.420940 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3923/5697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1360 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:34.450340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.451561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.462462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.463344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.464097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.465282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.466067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.466808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.575770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.584026 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22b5cb90-7d4b-4027-a143-1cbe2eb103cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1360 microversion: 2.1 time: 0.143524 Oct 04 18:36:34.584628 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1775/5698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:35.609449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.610155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.617758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.618265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.618803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.619624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.620095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.620539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.701660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.713573 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2407cfd9-7e7e-495d-bb4b-1f41e5ded8cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1360 microversion: 2.1 time: 0.107685 Oct 04 18:36:35.715196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3924/5699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1360 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.746870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.747543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.758795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.759685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.765679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.765679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.765679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.765679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.849065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.864466 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8da5e5f9-fc47-4d7e-a781-f5b57544e68b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1360 microversion: 2.1 time: 0.123938 Oct 04 18:36:36.865133 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1776/5700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.889303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.890572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.898193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.898705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.899191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.899916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.900604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.901024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.940579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.941619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.942061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.942523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lazy-loading 'fault' on Instance uuid b0c5b8da-bca9-42f9-a3e4-60ff07984e47 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:38.007870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.016867 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-654f6998-fa79-4651-a29d-6afd86523126 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 200 len: 1365 microversion: 2.1 time: 0.131673 Oct 04 18:36:38.018125 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3925/5701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.051234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.052079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.060182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.060737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.061292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.062133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.062608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.063152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.081791 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 HTTP/1.1 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'b0c5b8da-bca9-42f9-a3e4-60ff07984e47'} Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:39.083739 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9eb50ecd-6d44-49cd-995b-70bf470d6926 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 404 len: 111 microversion: 2.1 time: 0.039214 Oct 04 18:36:39.094759 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1777/5702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:41.045053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:41.048946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.056877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.057487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.057947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.058680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.059177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.059659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.163713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:41.164140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:41.164628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:41.165060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:41.165481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:41.236730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.246215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.247510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.248358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.249665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.250585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.252353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.292978 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8613154e-3afd-4319-938b-118ff5101edd tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action" status: 202 len: 1136 microversion: 2.1 time: 0.251533 Oct 04 18:36:41.299215 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3926/5703] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:41 2022] POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action => generated 1136 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:36:41.317571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.318896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.328960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.329769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.330440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.331556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.332525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.333219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.532337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.543904 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78f8e72f-e0fd-4774-8ceb-da0889b50d98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.231090 Oct 04 18:36:41.545125 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1778/5704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.569184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.569800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.577271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.577769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.578216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.578954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.579464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.579898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.597804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:42.762488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.771113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e92b20de-ef69-492d-aaa9-0c07fa77100e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.206476 Oct 04 18:36:42.771698 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3927/5705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.517598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.518125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.525327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.525828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.526318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.527053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.527543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.528287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.554829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:43.646993 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-508fef98-d74f-46c9-8041-e583027e1b19 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 204 len: 0 microversion: 2.1 time: 0.132930 Oct 04 18:36:43.647843 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1779/5706] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:43 2022] DELETE /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:43.657194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.657814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.666689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.667209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.667652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.668480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.669134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.669570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.798432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.799766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.806769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.807391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.807970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.808760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.809997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.810482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.812075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.821711 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-660c9914-9625-41e9-a55c-dee17dbdaaca tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1410 microversion: 2.1 time: 0.168993 Oct 04 18:36:43.822943 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3928/5707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1410 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.959223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.967487 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-eca9d8fa-32d1-4eb7-ba5a-8963d172bf98 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.173660 Oct 04 18:36:43.968080 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1780/5708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:44.845119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.845739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.852776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.853269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.853936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.854728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.855223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.855655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.993551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.994189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.997577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.001636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.002139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.002594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.003903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.004377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.004817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.006117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b1adfb25-e317-4b32-a0e6-f1500f974411 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1410 microversion: 2.1 time: 0.164957 Oct 04 18:36:45.006712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3929/5709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:45.194212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.198220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:45.209870 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd0d6da7-6c3e-4007-8dab-20d20fce5d7f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.220157 Oct 04 18:36:45.210474 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1781/5710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:45.721727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5b2bf1-4556-41b3-a7f7-925542bc8a9e", "name": "network-vif-deleted", "tag": "704e562c-d3e8-4071-ad06-c63e43cf8ad3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:45.732295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.732855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.733298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.747187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] Creating event network-vif-deleted:704e562c-d3e8-4071-ad06-c63e43cf8ad3 for instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e on n-h1-831193-17 Oct 04 18:36:45.753889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ed94570f-d20f-4b43-bb21-1b4c92e96735 req-deb50777-d9c7-44a8-8d4c-6568d0a570e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036029 Oct 04 18:36:45.754691 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3930/5711] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:46.034190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.036549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.045207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.046073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.046831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.048035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.048740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.051545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.144330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:46.163143 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c339c08c-0c46-4acf-987b-58f37dc44f0e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1201 microversion: 2.1 time: 0.135721 Oct 04 18:36:46.164130 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1782/5712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1201 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:46.235872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.236738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.244670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.245094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.245547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.246277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.246748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.247353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.439710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:46.449563 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30a38882-38e5-42f9-8a55-007478f0992b tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.219105 Oct 04 18:36:46.450292 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3931/5713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:47.192054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.192752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.200280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.200859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.201480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.202263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.203116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.203645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.271323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.281359 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c6e8642-94dc-4eda-ba88-5353d5713af6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1201 microversion: 2.1 time: 0.094083 Oct 04 18:36:47.281359 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1783/5714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:47.481929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.482545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.489465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.490125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.490565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.491353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.491821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.492261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.645681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.654733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33836a71-a0ad-4668-bee9-bcc736b2ec45 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.177214 Oct 04 18:36:47.655391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3932/5715] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.305542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.306186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.314050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.314563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.315014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.316400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.316875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.317319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.388610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.397421 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-11b1c432-70a9-4e0b-8029-4925960ed674 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1201 microversion: 2.1 time: 0.095889 Oct 04 18:36:48.410773 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1784/5716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:48.678448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.679006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.685946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.686433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.686875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.687603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.688062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.688486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.840133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.849413 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86341231-3610-4ab2-90b8-722da5fe904e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.175510 Oct 04 18:36:48.850003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3933/5717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:49.421635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.422408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.429437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.429916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.430367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.431111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.431582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.432024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.495448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.503964 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c2de00e-b058-4ca9-b2f5-4d54b2a124df tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1201 microversion: 2.1 time: 0.085823 Oct 04 18:36:49.504545 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1785/5718] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:49.873960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.876665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.881909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.882413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.882930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.883595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.884056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.884485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.027558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.037237 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f31c67e-e236-4a81-b838-b8e30fbb97b8 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.167366 Oct 04 18:36:50.037844 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3934/5719] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:50.530002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.531402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.540024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.540667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.541550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.542279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.542749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.543370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.584280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.584899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.585356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.585821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lazy-loading 'fault' on Instance uuid 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:50.650124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.664832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-46e474d9-b2e1-4229-a462-e4f2df16320c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 200 len: 1206 microversion: 2.1 time: 0.141216 Oct 04 18:36:50.678823 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1786/5720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 1206 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:51.061847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.062931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.081414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.081798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.082236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.082967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.083433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.083864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.236924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.250258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c04e2fdd-9d6b-46e4-b1aa-6426c97f5465 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.192221 Oct 04 18:36:51.250993 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3935/5721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:51.688499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.689137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.699641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.700401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.701025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.701932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.702460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.702910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.722870 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e HTTP/1.1 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '0c5b2bf1-4556-41b3-a7f7-925542bc8a9e'} Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:51.725386 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdab3059-92f7-49ed-94c6-e752e07114b1 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 404 len: 111 microversion: 2.1 time: 0.042965 Oct 04 18:36:51.730184 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1787/5722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:52.273996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.274684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.283065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.283621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.284640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.285435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.285899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.286326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.431918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.440340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a7b76c04-9410-43a6-963b-bc1db2c578e4 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.170417 Oct 04 18:36:52.441204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3936/5723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.465035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.465687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.473684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.474190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.474648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.475465 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.475939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.476380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.633230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.641129 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-780abd61-8ffc-4b25-b7bc-ccff6a27b2a3 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.180326 Oct 04 18:36:53.641696 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1788/5724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.890936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.891572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.899753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.900005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.900338 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.901064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.902803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.902803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.921588 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 HTTP/1.1 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b0c5b8da-bca9-42f9-a3e4-60ff07984e47'} Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.923386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eec15e08-ccb4-448e-9117-7f22c22b212d tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 404 len: 111 microversion: 2.1 time: 0.037961 Oct 04 18:36:53.928958 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3937/5725] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:53 2022] DELETE /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:53.938662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.939853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: b0c5b8da-bca9-42f9-a3e4-60ff07984e47] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.946989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.947548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.948012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.948736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.949216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.949667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.965833 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 HTTP/1.1 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'b0c5b8da-bca9-42f9-a3e4-60ff07984e47'} Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.968077 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance b0c5b8da-bca9-42f9-a3e4-60ff07984e47 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2fff7c28-beba-4c23-ab2b-03855c969bed tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47" status: 404 len: 111 microversion: 2.1 time: 0.036513 Oct 04 18:36:53.973990 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1789/5726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/b0c5b8da-bca9-42f9-a3e4-60ff07984e47 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:54.433177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.434052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.440948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.441444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.441883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.442720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.443234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.443667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.462302 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e HTTP/1.1 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '0c5b2bf1-4556-41b3-a7f7-925542bc8a9e'} Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.464161 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68f7ab45-6ef4-479a-804d-5cc21be26028 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 404 len: 111 microversion: 2.1 time: 0.037251 Oct 04 18:36:54.469316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3938/5727] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:54 2022] DELETE /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.475329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.475960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.483251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.483754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.484255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.484967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.485433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.485872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.500484 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e HTTP/1.1 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '0c5b2bf1-4556-41b3-a7f7-925542bc8a9e'} Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.502061 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 0c5b2bf1-4556-41b3-a7f7-925542bc8a9e could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dcf826e8-e457-46d4-9fd6-a3a0c6bf8e6e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e" status: 404 len: 111 microversion: 2.1 time: 0.033260 Oct 04 18:36:54.507404 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1790/5728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/0c5b2bf1-4556-41b3-a7f7-925542bc8a9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:54.591538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3776f90d-4fbb-47b7-86ca-4040de29fb2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: .version_select at 0x7f633bf14160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-175734176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNpf1Ybg9RxURBy+Iiknq8+UOS7K1OGtF9wrWrgUTfMm+E7iclZoaj0pB/SuLpcR7DhsmRkmrZuNKy95vp9f+8OqSBBkwFPcrj1Hz40LP68ejMzbHdU9F1gbkDOeUlTdA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:54.608535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3776f90d-4fbb-47b7-86ca-4040de29fb2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:54.617105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-3776f90d-4fbb-47b7-86ca-4040de29fb2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:54.646393 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3776f90d-4fbb-47b7-86ca-4040de29fb2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.061132 Oct 04 18:36:54.647045 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3939/5729] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:36:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:54.665728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.666366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.672512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.673021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.673485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.674206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.674716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.675192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.818172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.831204 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-55435f42-6333-40ac-98b5-9f4d733a7f1e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.169286 Oct 04 18:36:54.831803 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1791/5730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:55.855234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.855842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:55.864462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.864948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.865398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.866103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.866564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.866995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.029394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.037458 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9224ac16-4c6b-4a64-b8f8-1d7bdc64b6d7 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.186132 Oct 04 18:36:56.038054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3940/5731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:57.061602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.062227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.075357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.214401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.222889 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d25b8d1-b06e-445a-8998-7470d4651fcc tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1690 microversion: 2.1 time: 0.165479 Oct 04 18:36:57.223514 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1792/5732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.247004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.247650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.250610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:58.258753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.259285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.259922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.260649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.261111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.261546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.410172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.418587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7935f9a3-9022-4be1-a33f-466079845073 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1696 microversion: 2.1 time: 0.175635 Oct 04 18:36:58.419329 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3941/5733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.443498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.444078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.447163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:59.453345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.453854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.454313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.455048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.455522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.455964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.605770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.614917 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7a05df79-88f0-410b-97bb-e6d986a98534 tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1696 microversion: 2.1 time: 0.175900 Oct 04 18:36:59.615722 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1793/5734] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.639627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.640323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.647877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.648743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.649188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.649927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.650895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.651362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.805982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.820430 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-21c07508-d59c-422a-b9c1-ac085bb12aea tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1681 microversion: 2.1 time: 0.178636 Oct 04 18:37:00.821807 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3942/5735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.322963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "name": "network-vif-unplugged", "status": "completed", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:02.339460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.340093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.340588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.359884 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] Creating event network-vif-unplugged:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:37:02.368358 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-299f118a-28cd-4b6c-8bbb-67be104e6834 req-66fac29d-2506-466c-b5be-24d68bd00ae8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049712 Oct 04 18:37:02.369873 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1794/5736] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:04.396540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "name": "network-vif-plugged", "status": "completed", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:04.408306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.409101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.409548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.421434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] Creating event network-vif-plugged:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:37:04.426651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-dd8eccfa-0598-4350-adfe-f94842bd902c req-af75200a-7fc0-401c-83fb-1c7b2ae50d00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Oct 04 18:37:04.427320 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3943/5737] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:10.992257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1658635779", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-175734176", "security_groups": [{"name": "tempest-secgroup-smoke-1651749936"}], "block_device_mapping_v2": [{"uuid": "60649574-0f1a-46c0-9b8d-f2d484e18891", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:11.106629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:11.519424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:11.519871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:11.520367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:11.520826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:11.521288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:11.530668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.531203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.531662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.532409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.532884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.533332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.550879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:11.556268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:11.617061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:11.619321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60649574-0f1a-46c0-9b8d-f2d484e18891',volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:11.758407 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-798a6fbd-7e9b-4f5e-91a2-a166c3290b2f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773525 Oct 04 18:37:11.759078 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1795/5738] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:11.767824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:11.775203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9b4f2545-9d42-4df4-ab17-064c9788b014 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.776358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9b4f2545-9d42-4df4-ab17-064c9788b014 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.841824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9b4f2545-9d42-4df4-ab17-064c9788b014 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.849107 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9b4f2545-9d42-4df4-ab17-064c9788b014 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1094 microversion: 2.1 time: 0.082572 Oct 04 18:37:11.849699 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3944/5739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.873781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.874626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.884086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.884594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.885092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.885988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.886473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.886924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.960554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.971637 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f9364a67-baaa-4af7-a1f8-6b629e80a59e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1192 microversion: 2.1 time: 0.102251 Oct 04 18:37:12.972006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1796/5740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:14.003265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.004857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.021988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.022876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.023824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.025820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.027172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.028484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.084181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=78 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:14.301213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.316668 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-564b02e0-8bd1-4629-8b51-ce95b948a9e5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1278 microversion: 2.1 time: 0.323977 Oct 04 18:37:14.319642 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3945/5741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:14.666521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b32c28-16c2-44e4-9c7c-bec691742ff3", "tag": "f731f692-df9a-4748-8bff-30772935b13f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:14.680569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.681080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.682002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.700354 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] Creating event network-changed:f731f692-df9a-4748-8bff-30772935b13f for instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 on n-h1-831193-17 Oct 04 18:37:14.706445 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-94791dd4-9cf1-4e50-ad0f-53e4c397770f req-d0c8a2ec-2d7f-426a-b0a5-1766d72fcc54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045803 Oct 04 18:37:14.707414 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1797/5742] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:15.342343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.343225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.352524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.353186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.353733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.354580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.355292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.356143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.586727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.596435 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7e0d3e09-2fb5-4beb-a352-27299688afdc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1278 microversion: 2.1 time: 0.257883 Oct 04 18:37:15.611571 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3946/5743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.623574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.624204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.630862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.631409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.631876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.632610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.633092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.633547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.636455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=76 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:16.784977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.794347 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-18aa7a7c-e105-40cc-8ddc-1c22b6a06638 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1278 microversion: 2.1 time: 0.176140 Oct 04 18:37:16.794956 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1798/5744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.818008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.818797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.827945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.828477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.832154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.833005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.833500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.833977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.019750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.035022 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d98c31f3-e041-420a-beb9-d616e83757c2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1278 microversion: 2.1 time: 0.221722 Oct 04 18:37:18.037187 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3947/5745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.071863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.073023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.081672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.082097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.082557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.083386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.083864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.084310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.258111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.267153 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e99e921-7a3b-4adf-9eab-09facd2713fb tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.202286 Oct 04 18:37:19.267796 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1799/5746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:20.290127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.290738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.297454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.297950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.298399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.299649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.300111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.300546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.459965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.469068 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6699f1be-a6b0-4089-ad10-9963a623db6a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.183017 Oct 04 18:37:20.469679 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3948/5747] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.493223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.493909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.501147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.501647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.502096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.502814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.503297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.503736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.541467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.562828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.660125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.669178 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0ae822c8-1b46-4c3a-bc6c-f7ceda6ed770 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.179676 Oct 04 18:37:21.670193 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1800/5748] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.694385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.694970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.697718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:22.703271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.703778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.704226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.704939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.705434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.705869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.852429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.860158 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4774bc3a-9583-4e23-b51f-ff63da6a3812 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.170215 Oct 04 18:37:22.860708 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3949/5749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.883801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.884453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.891571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.892075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.893218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.893937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.894413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.894857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.040392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.050349 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dc54c391-0320-48c0-8e44-f04b8e865552 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.170333 Oct 04 18:37:24.050962 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1801/5750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.040301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:25.042619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.050061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.050550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.050992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.051717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.052179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.052613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.081199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.081786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.088750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.089253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.089709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.090425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.090895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.091374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.105119 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55b71563-c7c9-450d-abab-e2a8a3a2415a tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action" status: 200 len: 24569 microversion: 2.1 time: 0.068086 Oct 04 18:37:25.106089 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3950/5751] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:25 2022] POST /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76/action => generated 24569 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:37:25.247248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.255343 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5de7959c-c8c8-41b5-885d-59b26f90164e tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.178158 Oct 04 18:37:25.255916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1802/5752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:26.279284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.280141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.287855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.288363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.288865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.289527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.289990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.290421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.538299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.546332 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6960858f-e132-4f30-b763-02494cef0ad4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.272105 Oct 04 18:37:26.546911 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3951/5753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.573086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.573714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.581124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.581559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.581851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.582577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.583083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.583527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.735714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.744153 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62bf27dd-c6a2-4257-a245-9a4bda7d47c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.175259 Oct 04 18:37:27.744732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1803/5754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.768158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.768786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.771918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=24 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:28.778754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.779478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.779933 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.780660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.781129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.781569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.924380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.932619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70705a39-1a43-4a9f-8f86-e0ed897984cc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.169132 Oct 04 18:37:28.933220 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3952/5755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.602668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b32c28-16c2-44e4-9c7c-bec691742ff3", "name": "network-vif-plugged", "status": "completed", "tag": "f731f692-df9a-4748-8bff-30772935b13f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:29.609971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:29.618230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.618690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.619169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.631123 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] Creating event network-vif-plugged:f731f692-df9a-4748-8bff-30772935b13f for instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 on n-h1-831193-17 Oct 04 18:37:29.636174 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5649713d-2a9e-4b2d-acb9-c1c5bc24db50 req-9d7711d7-ab02-453a-bfea-cf1311a1b248 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Oct 04 18:37:29.636779 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1804/5756] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:29.959941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.961052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.973211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.974093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.974877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.976183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.976729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.977221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.119740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.132509 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-541284e9-2d50-44c2-ac16-183998d80b7b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1266 microversion: 2.1 time: 0.180322 Oct 04 18:37:30.133611 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3953/5757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.157076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.157706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.164001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.164497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.164946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.165672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.166132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.166572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.308113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.317156 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0032507c-805d-4859-a07f-8e960db21334 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1453 microversion: 2.1 time: 0.165453 Oct 04 18:37:31.317735 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1805/5758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.339728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.340434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.347497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.347984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.348428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.349121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.349578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.350004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.513687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.522364 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99f0ff7d-533b-4a79-ba89-d444b6cf4260 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1453 microversion: 2.1 time: 0.186494 Oct 04 18:37:31.523234 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3954/5759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:32.366656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.367478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.375985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:32.378898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.379446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.380145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.381235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.381721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.382172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.387969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.388700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.389349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.414272 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] Creating event network-changed:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:37:32.417907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:32.420521 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c9c92807-9b77-4bc6-85c3-17379acb4d79 req-d4012616-b02d-4330-b777-fb5c8bda8da7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051789 Oct 04 18:37:32.421475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3955/5760] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:32.534036 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b490324-feba-42eb-b8bf-9f1166578eae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 204 len: 0 microversion: 2.1 time: 0.170095 Oct 04 18:37:32.536469 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1806/5761] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:32 2022] DELETE /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:32.546453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.547358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.555767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.556171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.556795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.557523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.558075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.558502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.807479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.816466 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cae578c8-27ee-4f36-8162-7f292ad9a32e tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1687 microversion: 2.1 time: 0.274800 Oct 04 18:37:32.817328 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3956/5762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1687 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.846119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.847499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.855600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.855773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.856175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.857068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.857533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.857974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.159828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b32c28-16c2-44e4-9c7c-bec691742ff3", "tag": "f731f692-df9a-4748-8bff-30772935b13f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:34.176280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.177007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.178048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.192973 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] Creating event network-changed:f731f692-df9a-4748-8bff-30772935b13f for instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 on n-h1-831193-17 Oct 04 18:37:34.199007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-105eaef6-39b0-4580-a8de-5528459d67d1 req-649d9f0d-bf3d-4fac-988c-1c4a5ce611c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045146 Oct 04 18:37:34.200291 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3957/5763] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:34.416837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.428934 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-75d6b472-3dbb-4e9c-9d79-21e080e93eda tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1687 microversion: 2.1 time: 0.587862 Oct 04 18:37:34.445531 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1807/5764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1687 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.462488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.464612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.474309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.474752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.475220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.475934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.476391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.476819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.517842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.518557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.519202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.519869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lazy-loading 'fault' on Instance uuid 81f265ef-9e4a-4338-a8e5-f95362ebff76 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:35.579149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08b5214fa914274895bcbd0267ad03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37bd5b5cb56a49cfb533786afec9ad89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.589584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a0ff820b-7a9b-4786-acff-0d8b1658d96f tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 200 len: 1356 microversion: 2.1 time: 0.135865 Oct 04 18:37:35.590494 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3958/5765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 1356 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.216754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f265ef-9e4a-4338-a8e5-f95362ebff76", "name": "network-vif-deleted", "tag": "1e013100-c41c-4d80-976c-ce654af0f51e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.228038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.228531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.228966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.240652 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] Creating event network-vif-deleted:1e013100-c41c-4d80-976c-ce654af0f51e for instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 on n-h2-831193-17 Oct 04 18:37:36.245658 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-fff2d960-2f8b-4a57-8ee7-4fae3493517d req-de7124b8-fb6b-49ac-8ea3-0e7f30c2e517 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Oct 04 18:37:36.246239 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1808/5766] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:36.614486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.615015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] [instance: 81f265ef-9e4a-4338-a8e5-f95362ebff76] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.622306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.625030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.625030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.625030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.625030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.625030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.646154 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] HTTP exception thrown: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Request method failure captured: Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 HTTP/1.1 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHvC0sDYotRCNSl5y7B5VEJzrL_XzHLt-vDiLnZriasYgd6E0aNo2Yq-bBHpYSoVqox4DGd9pVVZp5ltSwg9mATka_4fu5j8qn871nnfzQOo2eJhk_vnFL9mzcmv3qXEt3d4kcvFscKf25VWnTVnV2zpkv_CwsjE1-aF5psHdcwbDaw Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/37bd5b5cb56a49cfb533786afec9ad89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 37bd5b5cb56a49cfb533786afec9ad89 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1861249272 Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d08b5214fa914274895bcbd0267ad03a Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1861249272-project Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '81f265ef-9e4a-4338-a8e5-f95362ebff76'} Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.647887 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Returning 404 to user: Instance 81f265ef-9e4a-4338-a8e5-f95362ebff76 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-25f483b1-2caf-4ab0-babb-0b2eb0d675ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76" status: 404 len: 111 microversion: 2.1 time: 0.039551 Oct 04 18:37:36.654617 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3959/5767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/81f265ef-9e4a-4338-a8e5-f95362ebff76 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:40.465427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03754d88-4dbc-4461-859f-898f171c13ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] Calling method '.version_select at 0x7f6340e83a60>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.493751 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03754d88-4dbc-4461-859f-898f171c13ae tempest-TestNetworkAdvancedServerOps-1861249272 tempest-TestNetworkAdvancedServerOps-1861249272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1778751121" status: 202 len: 0 microversion: 2.1 time: 0.033324 Oct 04 18:37:40.494730 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1809/5768] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 18:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1778751121 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:29.432455 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:39:29.433146 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 18:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 (ip 10.222.0.33) !!! Oct 04 18:39:29.433888 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:39:29.434014 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 18:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 (ip 10.222.0.33) !!! Oct 04 18:39:29.434996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=17 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.435769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=77 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.695683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.696227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.706859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.707392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.707835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.708694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.709155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.709589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.737772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:29.844349 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-55ce37ed-8a5c-42e1-8d51-186b84b4b87a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 204 len: 0 microversion: 2.1 time: 0.414833 Oct 04 18:39:29.845192 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3960/5769] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:29 2022] DELETE /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:29.855564 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 18:39:29.858726 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:39:29.858726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.858726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.864256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.864906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.874913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.875450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.875900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.876618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.877089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.877535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.021287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.030704 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dcea8605-f3f5-4c31-8657-8f513da38bae tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1578 microversion: 2.1 time: 0.179789 Oct 04 18:39:30.031317 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1810/5770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:31.059907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.061161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.073767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.074635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.075470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.076702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.077514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.078282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.446390 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.454682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4311ec50-8d2d-442d-b142-1a045fd2e218 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1578 microversion: 2.1 time: 0.402964 Oct 04 18:39:31.455335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3961/5771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1578 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.478968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.479710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.492752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.493264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.493717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.494475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.494953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.495583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.504568 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56034. Oct 04 18:39:32.509384 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56036. Oct 04 18:39:32.608744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.619381 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a17e94c-fa39-405f-926d-6ea2b7704970 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1510 microversion: 2.1 time: 0.144735 Oct 04 18:39:32.620064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1811/5772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.673969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b32c28-16c2-44e4-9c7c-bec691742ff3", "name": "network-vif-deleted", "tag": "f731f692-df9a-4748-8bff-30772935b13f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:32.686356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.687430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.688093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.703071 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] Creating event network-vif-deleted:f731f692-df9a-4748-8bff-30772935b13f for instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 on n-h1-831193-17 Oct 04 18:39:32.715466 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7750bc68-c027-49e9-aef0-51915fcf6ea9 req-8f66f3d0-b0b7-4c9a-ba5b-f325e1e1cca6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044911 Oct 04 18:39:32.717410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3962/5773] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:33.649418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.650826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.658255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.658774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.659370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.660219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.661082 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.661298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.744038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.753415 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ffe2d91b-14ca-4efe-b3d6-f93c91e20fbd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1225 microversion: 2.1 time: 0.113270 Oct 04 18:39:33.754586 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1812/5774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:34.781613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.782403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.789299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.789820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.790259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.791026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.791516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.791955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.866613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.876504 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-27236986-faf0-4f62-b6a8-7c612a3c7382 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1225 microversion: 2.1 time: 0.101388 Oct 04 18:39:34.876938 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3963/5775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:35.900990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.901749 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.909324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.909830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.910317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.911057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.911540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.911991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.277305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.286097 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7b5e76a8-de2a-48d3-9881-47907ff22771 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1225 microversion: 2.1 time: 0.389549 Oct 04 18:39:36.286807 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1813/5776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1225 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.312079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.312708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.319829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.320321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.320758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.321467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.321919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.322859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.355975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.356303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.356746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.357190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lazy-loading 'fault' on Instance uuid d1b32c28-16c2-44e4-9c7c-bec691742ff3 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:37.399387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.408178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04e44db1-e87f-4c54-8009-c92d401ceb20 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 200 len: 1230 microversion: 2.1 time: 0.099989 Oct 04 18:39:37.408746 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3964/5777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.429797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.430428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.438421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.438927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.439404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.440120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.440590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.441030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.454757 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 HTTP/1.1 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'd1b32c28-16c2-44e4-9c7c-bec691742ff3'} Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:38.456505 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-841560ca-831c-47ef-a6a2-95b8283eccaa tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 404 len: 111 microversion: 2.1 time: 0.032082 Oct 04 18:39:38.460980 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1814/5778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:38.510603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-748858373", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-175734176", "security_groups": [{"name": "tempest-secgroup-smoke-1651749936"}], "block_device_mapping_v2": [{"uuid": "60649574-0f1a-46c0-9b8d-f2d484e18891", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:38.648620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:39.121944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:39.122406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:39.122870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:39.123333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:39.123763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:39.134167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.135103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.136220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.137248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.137729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.138198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.157457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:39.163094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:39.224324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:39.226595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60649574-0f1a-46c0-9b8d-f2d484e18891',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:39.367306 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f89dbae6-1859-493b-ad5c-0aa08484f9e3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860490 Oct 04 18:39:39.367886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3965/5779] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:39.380268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a01c7475-742d-4d63-aec1-4e8fce80cea0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.381048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a01c7475-742d-4d63-aec1-4e8fce80cea0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.442664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a01c7475-742d-4d63-aec1-4e8fce80cea0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.454361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a01c7475-742d-4d63-aec1-4e8fce80cea0 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1093 microversion: 2.1 time: 0.077972 Oct 04 18:39:39.454952 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1815/5780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:40.478743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.479329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.485796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.486294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.486738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.487494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.487966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.488406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.574360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.582515 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fac902a3-e461-4180-88f3-5505a2316d85 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1143 microversion: 2.1 time: 0.109280 Oct 04 18:39:40.583410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3966/5781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.611468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.612495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.619524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.620407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.621064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.622018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.622698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.623419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.704291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.716161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8726e0b9-da56-4bb6-89bf-194c58fedcd7 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1199 microversion: 2.1 time: 0.113385 Oct 04 18:39:41.717308 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1816/5782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:42.740093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.740946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.749251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.749888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.750443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.752138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.753229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.753781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.977495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.988755 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9d72c329-2e5d-4573-9e4a-2a9242407cb3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1277 microversion: 2.1 time: 0.252864 Oct 04 18:39:42.989620 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3967/5783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:43.343588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e29146-ca1a-4fe5-9e17-cff51ab696b5", "tag": "97e59c18-cd0d-43cd-ab37-f4a54b4b35d7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:43.357493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.358101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.358630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.371815 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] Creating event network-changed:97e59c18-cd0d-43cd-ab37-f4a54b4b35d7 for instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 on n-h2-831193-17 Oct 04 18:39:43.377909 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-825fa4db-6497-42ee-a594-5ebcb48d017b req-8fef0c8f-bd69-4b57-91a1-0c1e0df61911 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038456 Oct 04 18:39:43.378641 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1817/5784] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:44.013254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.014036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.022169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.022668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.023331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.024201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.024680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.025249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.271847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.285859 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f636d0a0-2ebe-4895-af45-54f2b044b4d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1277 microversion: 2.1 time: 0.276189 Oct 04 18:39:44.294136 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3968/5785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:45.315913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.316659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.324083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.324600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.325066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.325874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.326357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.326804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.479453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.487476 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-35a3fa3f-827f-4f25-ba53-2962e68d2dd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1277 microversion: 2.1 time: 0.176713 Oct 04 18:39:45.488096 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1818/5786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.517380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.518145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.526437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.527001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.527470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.528535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.528915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.529357 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.684311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.693074 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c4fc85c-69d6-4e14-b5be-6cbb697f21cf tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1277 microversion: 2.1 time: 0.184613 Oct 04 18:39:46.693865 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3969/5787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.719672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.720491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.727524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.728801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.729524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.730359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.730832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.731300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.887343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.895320 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dba11929-db5d-4b28-ba90-67fe9f7aa8c6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.179591 Oct 04 18:39:47.895920 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1819/5788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.919946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.920566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.927233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.927722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.928165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.928860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.929320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.929751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.065544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.073536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04b7ecd6-50d9-4f2b-bc06-1fe6c596d8ec tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.158075 Oct 04 18:39:49.074055 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3970/5789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:50.097025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.097551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.101694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:50.106382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.106886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.107374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.108102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.108575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.109020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.254842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.262767 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be5df382-0b4e-48e2-ad44-57deefa593e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.169734 Oct 04 18:39:50.263382 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1820/5790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.287604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.288259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.290457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:51.291180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:51.298278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.298781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.299336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.300110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.300588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.301035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.444256 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.454811 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f8a0398-8092-493b-b7aa-97db5537c3c9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.172456 Oct 04 18:39:51.455441 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3971/5791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.478914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.479985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.488387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.489242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.489820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.490639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.491245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.491777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.647210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.655935 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f4ba56a-b630-443b-812e-357bf8e63ea4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.181236 Oct 04 18:39:52.656722 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1821/5792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:53.679689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.680305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.687867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.688382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.688822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.689524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.689977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.690403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.843959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.851892 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f60a0c5d-b80b-4543-800e-4157d9aa8596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.176280 Oct 04 18:39:53.852482 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3972/5793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.875131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.875756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.883724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.885260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.885810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.886703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.887309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.887833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.059354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.069696 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-30bcfe9c-fb56-4df3-9aed-9dbe5888d731 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.198355 Oct 04 18:39:55.070310 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1822/5794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:56.094535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.095119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.102680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.103157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.103606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.104327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.104793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.105225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.247730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.256150 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44d5bdcc-a273-469d-8c41-21ab6251413c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.165587 Oct 04 18:39:56.256752 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3973/5795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:57.220911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e29146-ca1a-4fe5-9e17-cff51ab696b5", "name": "network-vif-plugged", "status": "completed", "tag": "97e59c18-cd0d-43cd-ab37-f4a54b4b35d7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:57.235503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.236144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.236715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.249464 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] Creating event network-vif-plugged:97e59c18-cd0d-43cd-ab37-f4a54b4b35d7 for instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 on n-h2-831193-17 Oct 04 18:39:57.258182 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e5e1e27e-bb76-413a-bd57-d2b7c276c497 req-e88a09bc-f4c8-41d8-8300-1b82fba63542 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039595 Oct 04 18:39:57.259024 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1823/5796] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:57.280242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.281025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.288179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.288892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.289523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.290308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.291602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.292090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.492964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.500861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-204f97f1-db3f-45b8-a342-e3ffe10b35dc tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1265 microversion: 2.1 time: 0.224926 Oct 04 18:39:57.501452 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3974/5797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:57 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.526896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.527649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.535293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.535833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.536285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.537000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.537464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.537899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.690526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.698924 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b1ac517b-7b5d-4697-8576-604c357f0688 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1452 microversion: 2.1 time: 0.177583 Oct 04 18:39:58.699535 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1824/5798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.721938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.722555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.730826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.731347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.731790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.732500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.732960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.733394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.882631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.886855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:58.893304 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ef7d252b-0dd5-4343-86ea-4ab643eb917a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1452 microversion: 2.1 time: 0.175287 Oct 04 18:39:58.893971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3975/5799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:01.078723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e29146-ca1a-4fe5-9e17-cff51ab696b5", "tag": "97e59c18-cd0d-43cd-ab37-f4a54b4b35d7"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:01.089737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=33 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.100306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.101179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.101965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.110306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=73 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.122452 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] Creating event network-changed:97e59c18-cd0d-43cd-ab37-f4a54b4b35d7 for instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 on n-h2-831193-17 Oct 04 18:40:01.128543 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b7f5f408-ed1e-4716-aa2f-002bee9697ae req-dde5cf75-62b9-4ba3-a224-48fd073392eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056774 Oct 04 18:40:01.130073 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1825/5800] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:50.938756 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:41:50.940063 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:41:50.940642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:50.946105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-459957993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-175734176", "security_groups": [{"name": "tempest-secgroup-smoke-1651749936"}], "block_device_mapping_v2": [{"uuid": "6541c453-df00-4dbc-ba6a-ae2ef72bc60e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2bc55b05-2872-42a9-a76a-41fa6cd42499"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:51.065475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] validate_networks() for [('2bc55b05-2872-42a9-a76a-41fa6cd42499', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:51.442137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:51.442571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:51.443078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:51.443504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:51.443939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:51.453114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.453602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.454044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.455002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.455437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.455869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.473039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:51.478202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Getting quotas for user 4845b6045c454034b8e566a1ad3f02f8 and project ab92ed846a0f451b8e002f5fef3d342b. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:51.537031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:51.539126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6541c453-df00-4dbc-ba6a-ae2ef72bc60e',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:51.670411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-400b8919-a48e-48a7-92dd-202293a954f4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733665 Oct 04 18:41:51.671274 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3976/5801] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:51.682233 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 18:41:51.684139 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 18:41:51.684746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:51.685607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:51.687334 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:41:51.687516 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d (ip 10.222.0.33) !!! Oct 04 18:41:51.701660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7a7f662-2cdd-4041-81bd-cfe36ec209dd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.702381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c7a7f662-2cdd-4041-81bd-cfe36ec209dd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:51.812530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c7a7f662-2cdd-4041-81bd-cfe36ec209dd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.823200 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c7a7f662-2cdd-4041-81bd-cfe36ec209dd tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1093 microversion: 2.1 time: 0.144665 Oct 04 18:41:51.830855 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1826/5802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1093 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:52.845802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.846736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.856688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.857197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.857642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.858360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.858820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.862317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.869145 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56236. Oct 04 18:41:52.881016 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56238. Oct 04 18:41:52.944152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:52.953311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-203c287d-98bf-4fe0-897b-da2fe09f54d2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1209 microversion: 2.1 time: 0.111420 Oct 04 18:41:52.954152 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3977/5803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:53.977096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.977972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.990087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.990602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.991085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.991946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.992264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.992712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.010501 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56246. Oct 04 18:41:54.018698 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56244. Oct 04 18:41:54.221032 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.229785 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df6c81c8-8098-49bd-a0ff-f6d43d1dc5f6 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1277 microversion: 2.1 time: 0.256586 Oct 04 18:41:54.230376 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1827/5804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:54.346440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de02e0c4-6403-4318-8520-7be425eb217d", "tag": "c9801547-0063-4b8a-9c92-3b6c82c3e16c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:54.356304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.356790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.357266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.369516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] Creating event network-changed:c9801547-0063-4b8a-9c92-3b6c82c3e16c for instance de02e0c4-6403-4318-8520-7be425eb217d on n-h1-831193-17 Oct 04 18:41:54.374555 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7e600ae3-ac94-4ac7-9717-60e1b67c49fa req-fd84d231-46be-4e68-96cc-d542f4e0f443 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102861 Oct 04 18:41:54.375532 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3978/5805] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:55.253070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.254683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.263213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.264294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.264921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.265823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.266453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.267136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.500219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.509863 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-204015fd-1429-42e9-8023-86bf9c8cbd5a tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1277 microversion: 2.1 time: 0.260180 Oct 04 18:41:55.523130 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1828/5806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.540898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.541608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.548069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.548629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.549240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.550014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.550484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.550912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.695372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.704396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f67f3fbe-a556-4f56-831f-9ee6166ab77c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1277 microversion: 2.1 time: 0.168727 Oct 04 18:41:56.704961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3979/5807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:57.726986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.727744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.734918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.735458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.735912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.736629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.741965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.742489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.893483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.901687 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d81907c0-0d08-4cf9-bebc-0a8894ab7c50 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1277 microversion: 2.1 time: 0.178592 Oct 04 18:41:57.902266 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1829/5808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.925597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.926226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.933538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.934089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.934533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.935317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.935834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.936323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.091426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.099792 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c657d011-835e-4b4c-b2ae-57fb1b8bd5a5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.178349 Oct 04 18:41:59.100385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3980/5809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:00.125261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.125765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.132743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.133239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.133693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.134395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.135064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.136098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.277159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:00.285972 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2cec383d-7fe8-42fb-b456-efbb3751257f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.164808 Oct 04 18:42:00.286616 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1830/5810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.308581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.309179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.316093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.316582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.317022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.317717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.318178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.318610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.451739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.459807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04a2335e-6e49-4c37-92a0-2b192c7931ea tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.155229 Oct 04 18:42:01.460382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3981/5811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.485146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.485781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.488532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:02.493797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.494296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.494755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.495502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.495971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.496418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.630641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.638467 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9862bfac-6f18-4f7c-a95d-eb689efe9bb5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.157184 Oct 04 18:42:02.639047 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1831/5812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.664459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.665075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.667057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:03.668318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:03.676193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.676687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.677126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.678353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.678812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.679276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.820436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.829298 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cacdc0f-7491-4051-8eee-0a354cdd5572 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.170551 Oct 04 18:42:03.829895 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3982/5813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:04.854006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.854710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.863959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.864562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.865138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.866007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.866478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.866913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.022040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.031115 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-98080a43-f3dd-44e8-b74b-e33e088dc596 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.182101 Oct 04 18:42:05.031718 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1832/5814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:06.054019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.054664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.061688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.062176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.062613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.063379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.063870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.064307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.200804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.209443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6606181b-2de5-4710-a901-45de7bc71302 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.159301 Oct 04 18:42:06.210060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3983/5815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.238270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.239801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.252355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.253350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.260772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.261745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.262242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.262724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.271441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de02e0c4-6403-4318-8520-7be425eb217d", "name": "network-vif-plugged", "status": "completed", "tag": "c9801547-0063-4b8a-9c92-3b6c82c3e16c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:07.281251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.281740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.282184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.293632 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] Creating event network-vif-plugged:c9801547-0063-4b8a-9c92-3b6c82c3e16c for instance de02e0c4-6403-4318-8520-7be425eb217d on n-h1-831193-17 Oct 04 18:42:07.298853 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-db859226-e109-448d-83d6-ea7333a46674 req-b5418912-4949-4077-a737-61cd55085fa2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135941 Oct 04 18:42:07.299796 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1833/5816] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:07.435776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.443858 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-463daf2d-8ec9-42f9-80c5-8c8ddec76a3c tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1265 microversion: 2.1 time: 0.214605 Oct 04 18:42:07.444459 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3984/5817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.467540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.468406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.475058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.475678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.476149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.476877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.477354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.477800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.630908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:08.639824 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c76a949d-2179-4d75-b06c-46364dea61de tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1453 microversion: 2.1 time: 0.177457 Oct 04 18:42:08.640416 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1834/5818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.662517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.663165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.671497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.672047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.672533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.673399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.673947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.674460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.816743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:08.827857 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75944290-d7c1-4d97-976c-0cb424f88188 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1453 microversion: 2.1 time: 0.168839 Oct 04 18:42:08.828845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3985/5819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:10.910367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de02e0c4-6403-4318-8520-7be425eb217d", "tag": "c9801547-0063-4b8a-9c92-3b6c82c3e16c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:10.920133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.920633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.921085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.932934 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] Creating event network-changed:c9801547-0063-4b8a-9c92-3b6c82c3e16c for instance de02e0c4-6403-4318-8520-7be425eb217d on n-h1-831193-17 Oct 04 18:42:10.938127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-913da741-a501-4bf2-9573-083690142b9d req-2915e795-7927-4ba0-87f1-0b34ccd04214 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097778 Oct 04 18:42:10.939189 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1835/5820] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:43.569854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.570679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=46 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.571587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.572448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=52 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.573944 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:43:43.575482 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:43:43.575634 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 18:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d (ip 10.222.0.33) !!! Oct 04 18:43:43.578640 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 18:43:43.584709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de02e0c4-6403-4318-8520-7be425eb217d", "tag": "c9801547-0063-4b8a-9c92-3b6c82c3e16c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:43.594163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.594673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.604129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.604904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.605573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.607102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.607785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.607916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.608223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.608332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.608740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.623500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] Creating event network-changed:c9801547-0063-4b8a-9c92-3b6c82c3e16c for instance de02e0c4-6403-4318-8520-7be425eb217d on n-h1-831193-17 Oct 04 18:43:43.629298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-35b98831-5b3a-4d34-a606-a265cc2821b3 req-81a901ca-7a95-480e-a474-c6b3794eec10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061448 Oct 04 18:43:43.630605 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1836/5821] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:43.640917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:43.738831 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a6ad76f6-7e4d-4871-8148-7b8f6ddb0c65 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 204 len: 0 microversion: 2.1 time: 0.174040 Oct 04 18:43:43.740841 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3986/5822] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:43 2022] DELETE /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:43:43.750320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.751420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.759337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.760365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.761030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.762087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.762766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.763414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.936341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.945362 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41a487db-02c6-4001-bda6-1ebcf2d37985 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1578 microversion: 2.1 time: 0.200008 Oct 04 18:43:43.946059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1837/5823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.972528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.973854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.981816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.982307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.982744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.983699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.984160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.984581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.124421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.132532 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8067891-7f2e-4f8d-8096-098633250fe9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1578 microversion: 2.1 time: 0.165252 Oct 04 18:43:45.133117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3987/5824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:45.792276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de02e0c4-6403-4318-8520-7be425eb217d", "name": "network-vif-deleted", "tag": "c9801547-0063-4b8a-9c92-3b6c82c3e16c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:45.806900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.807488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.807955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.829678 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] Creating event network-vif-deleted:c9801547-0063-4b8a-9c92-3b6c82c3e16c for instance de02e0c4-6403-4318-8520-7be425eb217d on n-h1-831193-17 Oct 04 18:43:45.837083 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-287c3928-6043-48e4-93ad-dab1668bdc4f req-66b9049d-d1ce-4e8f-8db9-7fc538e65253 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048482 Oct 04 18:43:45.838078 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1838/5825] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:46.157048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.157826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:46.166053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.166564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.167014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.167770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.168905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.169524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.246326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.256059 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14d063d6-10a9-4451-bbcb-5980376c0d74 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1224 microversion: 2.1 time: 0.102671 Oct 04 18:43:46.256911 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3988/5826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.283672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.284516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.291069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.291701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.292226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.293040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.293622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.294136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.374078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.383472 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-14265e87-e477-4b5e-8d60-a63e17577e3f tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1224 microversion: 2.1 time: 0.105206 Oct 04 18:43:47.384144 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1839/5827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:48.409326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.409958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.417860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.418361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.418801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.419558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.420009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.420435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.508815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.518774 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-894067ea-5f82-4eba-a3ed-c1df5c4a46d8 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1224 microversion: 2.1 time: 0.113436 Oct 04 18:43:48.519354 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3989/5828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.542944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.543705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.551988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.552631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.553142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.553920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.554455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.555053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.621282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.630360 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0bc15f9-01c6-4ec8-af28-96950e9b24f9 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 200 len: 1224 microversion: 2.1 time: 0.091249 Oct 04 18:43:49.630956 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1840/5829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:50.653418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.654456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: de02e0c4-6403-4318-8520-7be425eb217d] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.661705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.662186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.662633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.663580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.664056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.664521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.679881 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d HTTP/1.1 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'de02e0c4-6403-4318-8520-7be425eb217d'} Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:50.681604 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance de02e0c4-6403-4318-8520-7be425eb217d could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c1c4ac2a-211b-4b66-992d-14f6df75e43b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d" status: 404 len: 111 microversion: 2.1 time: 0.033635 Oct 04 18:43:50.686324 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3990/5830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/de02e0c4-6403-4318-8520-7be425eb217d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:57.630055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.630661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.633919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e29146-ca1a-4fe5-9e17-cff51ab696b5", "tag": "97e59c18-cd0d-43cd-ab37-f4a54b4b35d7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:57.638084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.638589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.639262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.640207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.640927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.641514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.648657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.649328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.650011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.671587 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] Creating event network-changed:97e59c18-cd0d-43cd-ab37-f4a54b4b35d7 for instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 on n-h2-831193-17 Oct 04 18:43:57.674906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:57.678630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-aec9d996-d986-4adf-9d52-18120e606dff req-52961fd7-c026-4d3b-9ea0-7b80de09666f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050893 Oct 04 18:43:57.680244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3991/5831] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:57.815270 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-23ace162-c750-421d-afff-b0322cf78fd4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 204 len: 0 microversion: 2.1 time: 0.190716 Oct 04 18:43:57.819271 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1841/5832] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:57 2022] DELETE /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:57.831141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.832860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.849274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.850117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.850901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.852210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.853022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.853793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.081642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.095344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1ed634c-f307-4cec-996e-7fd35f5d4ada tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1577 microversion: 2.1 time: 0.272521 Oct 04 18:43:58.096586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3992/5833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1577 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.131094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.131860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.140777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.141327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.141814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.142606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.143235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.143729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.456005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.471137 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-69842f04-c9f8-4907-80f5-deb4ebddf81b tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1577 microversion: 2.1 time: 0.343785 Oct 04 18:43:59.472256 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1842/5834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1577 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.872413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e29146-ca1a-4fe5-9e17-cff51ab696b5", "name": "network-vif-deleted", "tag": "97e59c18-cd0d-43cd-ab37-f4a54b4b35d7"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:59.897267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.897781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.898323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.910975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] Creating event network-vif-deleted:97e59c18-cd0d-43cd-ab37-f4a54b4b35d7 for instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 on n-h2-831193-17 Oct 04 18:43:59.916878 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-7f0facb3-7751-4669-be57-6d36703ed6ec req-0cb2a528-bdd6-496e-8838-642ce3ee1cf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052396 Oct 04 18:43:59.917495 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3993/5835] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:00.495220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.495866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.503275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.503928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.504705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.505755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.506391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.506845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.593965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.608052 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d3246d64-f3d3-4f16-9eee-29792ac4ef90 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1224 microversion: 2.1 time: 0.116089 Oct 04 18:44:00.609793 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1843/5836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.641608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.642333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.649901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.653985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.661700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.661983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.663143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.664116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.741714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.750580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61db2d05-0234-441a-bce6-a56a72fcad02 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1224 microversion: 2.1 time: 0.116915 Oct 04 18:44:01.751214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3994/5837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:02.785438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.786375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.798547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.799939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.800735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.801501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.801977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.802418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.881000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:02.897106 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7ffdb35d-5aef-44e5-bafc-8417edf46ba3 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1224 microversion: 2.1 time: 0.119428 Oct 04 18:44:02.898095 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1844/5838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:03.930886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.931968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.944601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.945512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.946312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.947666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.948530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.949874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.055349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4845b6045c454034b8e566a1ad3f02f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab92ed846a0f451b8e002f5fef3d342b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.064492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-736a2d81-9311-4091-8b75-ca6dee48dbf5 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 200 len: 1224 microversion: 2.1 time: 0.140917 Oct 04 18:44:04.065762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3995/5839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:05.096433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.097217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: 88e29146-ca1a-4fe5-9e17-cff51ab696b5] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.104698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.105198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.105652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.106374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.106837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.107309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.122500 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 HTTP/1.1 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '88e29146-ca1a-4fe5-9e17-cff51ab696b5'} Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.125610 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance 88e29146-ca1a-4fe5-9e17-cff51ab696b5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0d147cbf-a961-4318-954f-147bb032e8e4 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5" status: 404 len: 111 microversion: 2.1 time: 0.035592 Oct 04 18:44:05.132775 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1845/5840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/88e29146-ca1a-4fe5-9e17-cff51ab696b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:05.697106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.700665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.705107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.705605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.706046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.706756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.707249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.707683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.722103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 HTTP/1.1 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'd1b32c28-16c2-44e4-9c7c-bec691742ff3'} Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:05.723863 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-692457e0-d339-44b4-a227-27d25dd57bd2 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 404 len: 111 microversion: 2.1 time: 0.032384 Oct 04 18:44:05.729896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3996/5841] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:05 2022] DELETE /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:05.737128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.737757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] [instance: d1b32c28-16c2-44e4-9c7c-bec691742ff3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.743971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.744472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.744923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.745639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.746701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.747175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.766959 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] HTTP exception thrown: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Request method failure captured: Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 HTTP/1.1 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPHxLEkXANHhoQg3o0YK04JzbWG3Q8kDbVgzhRIABY4i8AbD6CB2ZHal-3BGdTOqW6J8Tt7OrC5A6lcBadBxaQ12EISyHLCBw-bgd1IJwJrmACtuJBiGFebEER1SalQVvV48KvztTJyZhSMYxqurl3IB41hDScYnHY1UlFayf0YuJVDM Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab92ed846a0f451b8e002f5fef3d342b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: ab92ed846a0f451b8e002f5fef3d342b Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473208277 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 4845b6045c454034b8e566a1ad3f02f8 Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestVolumeBootPattern-1473208277-project Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'd1b32c28-16c2-44e4-9c7c-bec691742ff3'} Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:05.768567 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Returning 404 to user: Instance d1b32c28-16c2-44e4-9c7c-bec691742ff3 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e16d24a9-8425-4e8d-b66e-0e5fa8d9c274 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3" status: 404 len: 111 microversion: 2.1 time: 0.036992 Oct 04 18:44:05.772923 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1846/5842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/d1b32c28-16c2-44e4-9c7c-bec691742ff3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:09.318691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc129400-ea5b-49c7-92c5-6b2934d94b35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] Calling method '.version_select at 0x7f6340bf9b80>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.393419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc129400-ea5b-49c7-92c5-6b2934d94b35 tempest-TestVolumeBootPattern-1473208277 tempest-TestVolumeBootPattern-1473208277-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-175734176" status: 202 len: 0 microversion: 2.1 time: 0.083855 Oct 04 18:44:09.394254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3997/5843] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 18:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-175734176 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:30.254914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:30.255710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:30.392121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-861607824", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:30.472187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] validate_networks() for None {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:30.689901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:30.690346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:30.690844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:30.691296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:30.691730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:30.701483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.701982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.702440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.703227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.703705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.704152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.722397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Getting quotas for project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:30.728237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Getting quotas for user f4d7de42270a4ee2a568635d22868c41 and project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:30.747232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:30.749601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:30.811749 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0cfbb3c5-d021-4066-8c1c-c4afaf91ce46 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564274 Oct 04 18:44:30.812839 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1847/5844] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:30.830995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:30.832273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:30.838151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a53c2a2a-795d-4ba1-a899-e1f204577200 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:30.839877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a53c2a2a-795d-4ba1-a899-e1f204577200 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:30.914677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a53c2a2a-795d-4ba1-a899-e1f204577200 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.922554 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a53c2a2a-795d-4ba1-a899-e1f204577200 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1221 microversion: 2.1 time: 0.095562 Oct 04 18:44:30.923164 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3998/5845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:30 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:31.952755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d557e9aa-43c6-4d31-a0c1-e2b5c1031c9d tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.953735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d557e9aa-43c6-4d31-a0c1-e2b5c1031c9d tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:32.029135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d557e9aa-43c6-4d31-a0c1-e2b5c1031c9d tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.039795 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d557e9aa-43c6-4d31-a0c1-e2b5c1031c9d tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1221 microversion: 2.1 time: 0.097465 Oct 04 18:44:32.040392 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1848/5846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:33.068686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e93e25d-425c-434c-b31d-18829ca59c81 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.070702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e93e25d-425c-434c-b31d-18829ca59c81 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.260640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e93e25d-425c-434c-b31d-18829ca59c81 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.270686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e93e25d-425c-434c-b31d-18829ca59c81 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1221 microversion: 2.1 time: 0.208087 Oct 04 18:44:33.271405 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 3999/5847] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:34.294772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a982787b-0ac6-4c5d-a02c-9faef2867112 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:34.296428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a982787b-0ac6-4c5d-a02c-9faef2867112 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:34.364346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a982787b-0ac6-4c5d-a02c-9faef2867112 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:34.369571 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a982787b-0ac6-4c5d-a02c-9faef2867112 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1221 microversion: 2.1 time: 0.078620 Oct 04 18:44:34.369954 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1849/5848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:34 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.393206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.394140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.402747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.403307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.403761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.404801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.405259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.405735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.486194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.496411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6ab9c89-32ae-4544-90cc-3fb494ae7af2 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1225 microversion: 2.1 time: 0.107246 Oct 04 18:44:35.497033 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4000/5849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.532847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.534423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.544301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.544872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.545599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.546843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.547606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.548156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.628112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.636959 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec469f19-e9fc-4407-a223-3df9d4e84419 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1279 microversion: 2.1 time: 0.109978 Oct 04 18:44:36.637573 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1850/5850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:37.665785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.666999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.680026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.680942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.681751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.684148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.685092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.685551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.919079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.928032 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9e24146-daeb-49e6-8aae-d00db65742bf tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.269234 Oct 04 18:44:37.928701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4001/5851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:38.017853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbf8219-0940-4be3-aac5-974d03ce1ad0", "tag": "c8b08db8-cdfe-4514-97f6-4b0e2b3255ad"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:38.038108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.038615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.039088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.059470 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] Creating event network-changed:c8b08db8-cdfe-4514-97f6-4b0e2b3255ad for instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 on n-h2-831193-17 Oct 04 18:44:38.066452 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-1a411774-c3e9-465f-90dd-e1c582d0d0dd req-38fc9cc7-22bc-4094-9073-62c3ada93263 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054182 Oct 04 18:44:38.067714 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1851/5852] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:38.953236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.953755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.961040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.961529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.961967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.962683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.963270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.963601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.104503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.112723 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6cc48697-9a75-4437-870d-640da9263c5c tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.164055 Oct 04 18:44:39.113509 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4002/5853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:40.141340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.142161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.149533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.150059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.150516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.151583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.152756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.153333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.316100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.329769 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f246ae01-63fc-4828-8268-254b745370a9 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.194243 Oct 04 18:44:40.330730 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1852/5854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.367550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.368168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.375378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.375871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.376321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.377125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.377589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.378051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.532779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.544796 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43d4214a-0bcf-41e7-a6fd-ceca9d3116c3 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.180958 Oct 04 18:44:41.545758 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4003/5855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.568943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.569598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.571965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:42.579420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.579935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.580400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.581134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.581616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.582063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.749013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.757134 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-39332acf-e680-4a9e-8d62-6c6f6b73b930 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.192005 Oct 04 18:44:42.757798 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1853/5856] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.781637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.782399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.785271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:43.791476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.792007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.792454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.793204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.793808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.794425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.944749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.954803 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-743e36cc-c0c1-47a5-8ff4-016a4a98fc9e tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.177310 Oct 04 18:44:43.955582 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4004/5857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:44.708923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbf8219-0940-4be3-aac5-974d03ce1ad0", "name": "network-vif-plugged", "status": "completed", "tag": "c8b08db8-cdfe-4514-97f6-4b0e2b3255ad"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:44.717004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=10 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:44.723841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.724344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.724793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.737843 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] Creating event network-vif-plugged:c8b08db8-cdfe-4514-97f6-4b0e2b3255ad for instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 on n-h2-831193-17 Oct 04 18:44:44.743690 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-16c62e46-48f8-47d9-a3f5-525c2af07d15 req-d65164f4-9b55-4d2c-a963-02afe026e8c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038891 Oct 04 18:44:44.744474 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1854/5858] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:44.981967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.982857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.990427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.990927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.991384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.992097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.992547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.992972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.138058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.146036 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a4373384-7c99-4bc7-9cad-c420139a9b88 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1321 microversion: 2.1 time: 0.169462 Oct 04 18:44:45.146617 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4005/5859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:46.171968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.172645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:46.178992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.179563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.180024 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.180735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.181209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.181655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.329359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.337471 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2f92bf2-ff2b-4777-811e-a1cbd5ac22fe tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1471 microversion: 2.1 time: 0.171261 Oct 04 18:44:46.338258 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1855/5860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:46.425690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c81776f-54b9-47ea-97f5-45c6a680ada0 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '.version_select at 0x7f633bfbce50>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.498882 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c81776f-54b9-47ea-97f5-45c6a680ada0 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/d6e1755b636f4032b0082b6f6819de38" status: 200 len: 371 microversion: 2.1 time: 0.139156 Oct 04 18:44:46.499921 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4006/5861] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/os-quota-sets/d6e1755b636f4032b0082b6f6819de38 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:46.512538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f4fc741-a129-4fef-bae4-06b59b074b9d tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1305248164", "id": 394949669, "os-flavor-access:is_public": "True"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:46.533738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f4fc741-a129-4fef-bae4-06b59b074b9d tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024797 Oct 04 18:44:46.534464 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1856/5862] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:46 2022] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:46.551506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "394949669"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:46.555746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:46.564714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.565488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.566158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.567188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.567940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.568542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.771175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8490bce4d41546d2ba35a6ec6ea83838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e1755b636f4032b0082b6f6819de38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.778458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1305248164 {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:44:46.786438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.786922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.787470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.788201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.788651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.789165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.811720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Getting quotas for project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:46.817322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Getting quotas for user f4d7de42270a4ee2a568635d22868c41 and project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:46.832803 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] ram quota exceeded for d6e1755b636f4032b0082b6f6819de38, tried to resize instance. Oct 04 18:44:46.833349 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Request method failure captured: Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action HTTP/1.1 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 38 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH8OtP00Uzi8W4sdcYg2p4eCIyRkbEskbef2dtPO7JTKYn7l6Y2zZBIQiSJXKQ0zz-3pFAlB_Dn2a7BmZlMhthHIEDKKBx8oenixQ8jABf4Jreu9FeERpNixp7QDKN9eS6di8jozqxvtDkBN8qkH4Z3F1DyAOAFQOgcFSxCDTopLLmU Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: d6e1755b636f4032b0082b6f6819de38 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member,admin Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member,admin Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: d6e1755b636f4032b0082b6f6819de38 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersAdminNegativeTestJSON-460994379-project-admin Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 8490bce4d41546d2ba35a6ec6ea83838 Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersAdminNegativeTestJSON-460994379-project-admin Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: {"resize": {"flavorRef": "394949669"}} Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '5bbf8219-0940-4be3-aac5-974d03ce1ad0', 'body': {'resize': {'flavorRef': '394949669'}}} Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:46.835395 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f413ece-0b4f-49a5-8e70-9f3a91ff8fac tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action" status: 403 len: 118 microversion: 2.1 time: 0.292875 Oct 04 18:44:46.842931 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4007/5863] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:46 2022] POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action => generated 118 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:46.853965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04b83a1e-d504-44b1-bdd4-2eed47753441 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.873292 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04b83a1e-d504-44b1-bdd4-2eed47753441 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/394949669" status: 202 len: 0 microversion: 2.1 time: 0.029718 Oct 04 18:44:46.874144 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1857/5864] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 18:44:46 2022] DELETE /compute/v2.1/flavors/394949669 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:46.884187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39fb83ab-24ff-4e96-9400-2875c16899ff tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.908085 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39fb83ab-24ff-4e96-9400-2875c16899ff tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028394 Oct 04 18:44:46.908696 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4008/5865] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:46.929467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ee6fdf7-f77b-42a6-9831-32b92d8f3d60 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '.version_select at 0x7f6340e69670>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.005993 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ee6fdf7-f77b-42a6-9831-32b92d8f3d60 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/d6e1755b636f4032b0082b6f6819de38" status: 200 len: 371 microversion: 2.1 time: 0.080181 Oct 04 18:44:47.006574 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1858/5866] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/os-quota-sets/d6e1755b636f4032b0082b6f6819de38 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:47.019166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4aecb4b-8863-451b-8617-78abe864d3ee tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-16032988", "id": 2124294236, "os-flavor-access:is_public": "True"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:47.039343 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4aecb4b-8863-451b-8617-78abe864d3ee tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023965 Oct 04 18:44:47.039950 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4009/5867] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:47 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:47.053080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2124294236"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:47.055477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.061912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.062395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.062859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.063603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.064083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.064507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.207350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8490bce4d41546d2ba35a6ec6ea83838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e1755b636f4032b0082b6f6819de38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.213788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-16032988 {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:44:47.221213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.221623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.222069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.222803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.223303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.223739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.245746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Getting quotas for project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:47.250791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Getting quotas for user f4d7de42270a4ee2a568635d22868c41 and project f425b9abedcc4b33b25c1614249c3fb3. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:47.265035 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.compute.api [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] cores quota exceeded for d6e1755b636f4032b0082b6f6819de38, tried to resize instance. Oct 04 18:44:47.265592 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Request method failure captured: Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action HTTP/1.1 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 39 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH8OtP00Uzi8W4sdcYg2p4eCIyRkbEskbef2dtPO7JTKYn7l6Y2zZBIQiSJXKQ0zz-3pFAlB_Dn2a7BmZlMhthHIEDKKBx8oenixQ8jABf4Jreu9FeERpNixp7QDKN9eS6di8jozqxvtDkBN8qkH4Z3F1DyAOAFQOgcFSxCDTopLLmU Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: d6e1755b636f4032b0082b6f6819de38 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member,admin Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member,admin Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6e1755b636f4032b0082b6f6819de38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: d6e1755b636f4032b0082b6f6819de38 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-460994379 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersAdminNegativeTestJSON-460994379-project-admin Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 8490bce4d41546d2ba35a6ec6ea83838 Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersAdminNegativeTestJSON-460994379-project-admin Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: {"resize": {"flavorRef": "2124294236"}} Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5bbf8219-0940-4be3-aac5-974d03ce1ad0', 'body': {'resize': {'flavorRef': '2124294236'}}} Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:47.267712 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e658e522-a83d-4074-8c3b-50160643e943 tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action" status: 403 len: 113 microversion: 2.1 time: 0.220269 Oct 04 18:44:47.271284 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1859/5868] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:47 2022] POST /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0/action => generated 113 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:47.279905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8710c258-7787-43b3-bec5-1d37cc7fdabe tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.297542 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8710c258-7787-43b3-bec5-1d37cc7fdabe tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2124294236" status: 202 len: 0 microversion: 2.1 time: 0.021773 Oct 04 18:44:47.298145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4010/5869] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 18:44:47 2022] DELETE /compute/v2.1/flavors/2124294236 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:44:47.306830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-595119f2-258a-494f-beea-95419cd73e2e tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.328421 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-595119f2-258a-494f-beea-95419cd73e2e tempest-ServersAdminNegativeTestJSON-460994379 tempest-ServersAdminNegativeTestJSON-460994379-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025182 Oct 04 18:44:47.328993 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1860/5870] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:47.349838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.350346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.356489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.356984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.357429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.358140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.358604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.359058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.395058 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:47.500548 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-620974e4-9fd4-44d2-b316-19d714bc3b02 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 204 len: 0 microversion: 2.1 time: 0.154190 Oct 04 18:44:47.501536 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4011/5871] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:47 2022] DELETE /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:47.510530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.512008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.523060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.523957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.524781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.526064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.526641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.527599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.709869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.724249 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-42558dbf-b58b-429d-bd9a-5c641ec78ca7 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1477 microversion: 2.1 time: 0.217188 Oct 04 18:44:47.726439 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1861/5872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:48.752196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.752928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.759959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.760453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.760934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.761673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.762132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.762559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.038411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:49.049214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-00216e6b-c82a-44aa-9d14-4b5affd57645 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1477 microversion: 2.1 time: 0.302122 Oct 04 18:44:49.050172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4012/5873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:49.547876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbf8219-0940-4be3-aac5-974d03ce1ad0", "name": "network-vif-deleted", "tag": "c8b08db8-cdfe-4514-97f6-4b0e2b3255ad"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:49.564499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.565747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.567416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.841565 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] Creating event network-vif-deleted:c8b08db8-cdfe-4514-97f6-4b0e2b3255ad for instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 on n-h2-831193-17 Oct 04 18:44:49.847132 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-125a305c-e012-4c4b-9dd0-671b81c40517 req-b5a830eb-dc98-458a-8687-50d93cd3a128 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304624 Oct 04 18:44:49.847887 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1862/5874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:50.073797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.074746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.083521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.084134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.084766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.085696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.086279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.086954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.132413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.133170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.133733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.134273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lazy-loading 'fault' on Instance uuid 5bbf8219-0940-4be3-aac5-974d03ce1ad0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:50.188984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d7de42270a4ee2a568635d22868c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f425b9abedcc4b33b25c1614249c3fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.196422 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11457ac4-7db2-4f3a-b455-6058f16d8c40 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 200 len: 1311 microversion: 2.1 time: 0.127187 Oct 04 18:44:50.197007 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4013/5875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:51.225674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.226662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] [instance: 5bbf8219-0940-4be3-aac5-974d03ce1ad0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.236632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.237137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.237594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.238322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.238791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.239264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.254317 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] HTTP exception thrown: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Request method failure captured: Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 HTTP/1.1 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH8Ng23IchyJyGZjz7ixmqiFGbpMMy_PMo-ieWXwAtiVWVGvP3pIIBbvJkxB6d3mA2krLG3nJ2kC6DwGnLbIEJDs3HDQTamwFYXG8r1cS85ZQs82zZ9fVqz5Jfcg_rytX0t1K31605MdRXVkbZweLtMfZw3zNSNdRsxUr13k8nYYEDA Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: f425b9abedcc4b33b25c1614249c3fb3 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-912627672 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f425b9abedcc4b33b25c1614249c3fb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f425b9abedcc4b33b25c1614249c3fb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f425b9abedcc4b33b25c1614249c3fb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f425b9abedcc4b33b25c1614249c3fb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersAdminNegativeTestJSON-912627672 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: f425b9abedcc4b33b25c1614249c3fb3 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-912627672 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersAdminNegativeTestJSON-912627672-project Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: f4d7de42270a4ee2a568635d22868c41 Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersAdminNegativeTestJSON-912627672-project Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5bbf8219-0940-4be3-aac5-974d03ce1ad0'} Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:51.256033 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] Returning 404 to user: Instance 5bbf8219-0940-4be3-aac5-974d03ce1ad0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fe97819d-c1d2-471e-894b-e53941ddb778 tempest-ServersAdminNegativeTestJSON-912627672 tempest-ServersAdminNegativeTestJSON-912627672-project] 10.222.0.33 "GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0" status: 404 len: 111 microversion: 2.1 time: 0.039338 Oct 04 18:44:51.262426 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1863/5876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/5bbf8219-0940-4be3-aac5-974d03ce1ad0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:58.968002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:58.969070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:59.099409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1271860312", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "ed66f80d-f73a-4935-93a9-838446b7f4a2"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.160518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] validate_networks() for [('ed66f80d-f73a-4935-93a9-838446b7f4a2', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:59.925552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:59.925947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:59.927257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:59.927712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:59.928219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:59.944436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.945002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.945678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.946981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.947737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.948950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.970139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Getting quotas for project c4c930d7f0ee4158865ef957ff9b00ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:59.976115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Getting quotas for user d875e7992c8144339f6f7c84e62bf8fa and project c4c930d7f0ee4158865ef957ff9b00ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:59.990420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:59.993476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:00.048725 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:45:01.059268 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56686. Oct 04 18:45:01.067479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ed665f4-c5e4-4b34-b193-0ea527518e8b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104221 Oct 04 18:45:01.068920 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4014/5877] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:45:01.089193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4ec3acd-639a-4417-a23e-454c0da8e772 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.090329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4ec3acd-639a-4417-a23e-454c0da8e772 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.095860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:01.097020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:01.098376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:01.189188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a4ec3acd-639a-4417-a23e-454c0da8e772 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.202831 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4ec3acd-639a-4417-a23e-454c0da8e772 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1215 microversion: 2.1 time: 0.121624 Oct 04 18:45:01.204156 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1864/5878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.234944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.237005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.240404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:02.251295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.252222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.253051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.254350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.255235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.256056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.263930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:02.353059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.361822 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea22127d-7af6-41b5-b3d1-d3e7be7975df tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1267 microversion: 2.1 time: 0.136177 Oct 04 18:45:02.362491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4015/5879] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.396512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.397911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.400397 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=53 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:03.410345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.410902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.411391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.412120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.412600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.413045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.737492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.748060 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54e62ade-4fa4-4351-af3b-c01846d93d3f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.355407 Oct 04 18:45:03.749017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1865/5880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.273183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2182317e-578f-467a-9444-85ff7e456a5f", "tag": "a42688ad-2b14-4185-aa53-4c4dd317e6c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:04.293282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.293981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.294532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.316720 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] Creating event network-changed:a42688ad-2b14-4185-aa53-4c4dd317e6c3 for instance 2182317e-578f-467a-9444-85ff7e456a5f on n-h2-831193-17 Oct 04 18:45:04.325595 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-bb961291-2dc0-4ad0-94de-fbd6ae30b309 req-39eead8d-6610-4e83-8096-6bc72f862193 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059647 Oct 04 18:45:04.326508 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4016/5881] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:04.774046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.775153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.782908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.783439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.783900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.784595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.785056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.785489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.941471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.949611 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ee1cd179-e6f5-49fd-8b07-72c895a8afa7 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.180506 Oct 04 18:45:04.950177 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1866/5882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.975740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.977039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.988614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.989579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.990823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.991902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.992454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.993024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.166116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.175725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04795541-4bb0-4554-95e6-96ccf260e92e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.206840 Oct 04 18:45:06.176310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4017/5883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:07.200563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.201191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.208759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.209261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.209727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.210448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.210911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.211370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.366823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.379511 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-61cb89ae-0d44-4962-ad83-858055359605 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.183491 Oct 04 18:45:07.380140 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1867/5884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.404745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.405624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.412654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.413186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.413622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.414334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.414795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.415257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.568522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.576875 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d79143c6-9a0e-4c41-aff1-2ae0f559eb36 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.176795 Oct 04 18:45:08.577478 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4018/5885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:08.795672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182317e-578f-467a-9444-85ff7e456a5f", "name": "network-vif-plugged", "status": "completed", "tag": "a42688ad-2b14-4185-aa53-4c4dd317e6c3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:08.808276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.808866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.809524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.830118 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] Creating event network-vif-plugged:a42688ad-2b14-4185-aa53-4c4dd317e6c3 for instance 2182317e-578f-467a-9444-85ff7e456a5f on n-h2-831193-17 Oct 04 18:45:08.836832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2f66e69a-775f-4b3d-afe5-8ee9aa64bdf8 req-07e9e16f-4980-4fd0-b360-4b0c20df5078 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045364 Oct 04 18:45:08.837453 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1868/5886] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:09.602381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.603154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.611486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.611486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.611756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.615682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.615682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.615682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.754539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.766835 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-772559f6-ecb3-401d-9aef-136dba4ae609 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1315 microversion: 2.1 time: 0.168861 Oct 04 18:45:09.767479 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4019/5887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.796774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.797603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.805179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.805681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.806128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.806841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.807962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.808550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.967018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.977426 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c20b79b-510a-483f-9fdc-5fc5dc40cb1b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1503 microversion: 2.1 time: 0.187040 Oct 04 18:45:10.978059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1869/5888] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:11.002314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:11.004817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.007006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.007724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.015941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.016441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.016978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.017698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.018166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.018588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.049422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.056460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:45:11.063415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:11.063934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:11.064442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:11.064856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:11.065271 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:11.143428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30c456f4-ac8d-49d1-8759-3e07bc019bb5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "POST /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.145728 Oct 04 18:45:11.144064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4020/5889] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:10 2022] POST /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:45:11.152570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.153214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.160262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.160775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.161230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.161966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.162438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.162888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.196178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.337602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.347738 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca308d7a-3a9c-4f94-ae49-850f8abb2f31 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1512 microversion: 2.1 time: 0.199290 Oct 04 18:45:11.348614 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1870/5890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:12.374954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.376003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.389317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.389831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.390282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.391016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.391522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.391962 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.583632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.597115 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26e270f3-018c-4db3-8935-f80ffbf97e51 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1512 microversion: 2.1 time: 0.228506 Oct 04 18:45:12.598004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4021/5891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.629272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.629936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.638026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.638532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.638990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.639735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.640207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.640653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.795996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.804162 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5733c67c-33f2-407f-b9ea-bf6e96c9b5ac tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.178733 Oct 04 18:45:13.804756 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1871/5892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.830305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.831467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.841611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.842198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.842738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.843417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.843981 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.844308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.003700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.012396 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a84193e-f04a-424b-aab5-3a319ecff0c3 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.187996 Oct 04 18:45:15.012995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4022/5893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:16.041832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.042902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.050646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.051187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.051648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.052376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.053027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.053472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.227567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.235801 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-97edb3aa-5e34-48f2-a4e4-9bca44bf5352 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.202032 Oct 04 18:45:16.236395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1872/5894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:17.260407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.261027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.269120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.269664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.270151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.270999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.271561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.272040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.425634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.437344 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31abc02e-cb24-4945-a17d-a7f61fb1d24f tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.180627 Oct 04 18:45:17.438406 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4023/5895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:18.464057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.464986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.475182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.476044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.476851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.478126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.480854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.480854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.638596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.647102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b148267-67f9-4484-bf79-e72b4b268078 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.187542 Oct 04 18:45:18.647686 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1873/5896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:19.674882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.675556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.686403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.686910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.687394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.688152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.688625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.689053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.874126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.883382 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bccff7c8-fa09-48c4-9e3a-46751d7ca6a4 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.212459 Oct 04 18:45:19.884004 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4024/5897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:20.921987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.923727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.929852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.930352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.930802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.931652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.932155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.932604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.074890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.082929 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ec15eb2-d406-445e-98b3-885ee0dbd6ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.164935 Oct 04 18:45:21.083523 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1874/5898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:22.107102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.107866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.115323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.115824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.116267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.116980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.117436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.117859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.269400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.279242 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9c333b3-e46b-45b6-bf9b-19390dc239ec tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.176576 Oct 04 18:45:22.280101 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4025/5899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.305707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.306455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.314262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.314763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.315237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.315960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.316430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.316999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.481997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:23.490687 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-83c52008-5f8a-42e2-8afd-4a2b1a649948 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.190481 Oct 04 18:45:23.491307 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1875/5900] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.516751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:24.517527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:24.528715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.529451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.530402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.531545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.532309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.532982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.723406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.732561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1e4d7e72-97e4-4f0c-8de7-23a15a9ba710 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.220214 Oct 04 18:45:24.733305 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4026/5901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:24 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:25.761387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.764309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.765617 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:45:25.765785 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f (ip 10.222.0.33) !!! Oct 04 18:45:25.776806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.777392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.777905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.778687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.779258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.780021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.971988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.981242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8e188aa5-cd0a-4e43-bfc7-2e4cd1e1a9dd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.224668 Oct 04 18:45:25.981747 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1876/5902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:27.005893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.006987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.015234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.015722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.016164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.016872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.017337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.017765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.179172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.189695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e3750e8-d1db-457d-9cf1-cedc00c58bb8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.188459 Oct 04 18:45:27.190310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4027/5903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:28.219972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.220671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.227904 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.228414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.228868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.229590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.230071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.230509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.369796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.377967 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a1b60d1-0ce0-44cb-b844-e11fc62fe130 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.161952 Oct 04 18:45:28.378550 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1877/5904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:29.401984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.402605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.409970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.410455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.410905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.411662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.412115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.412538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.567755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.576691 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-06add123-d8d3-4f7d-a9fd-4d39bb432dfd tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.178649 Oct 04 18:45:29.577291 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4028/5905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:30.600561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.601213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.609251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.609750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.610233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.611026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.611542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.611985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.753234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:30.761724 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-061fb16d-387b-4dd8-ad49-134d573d17e8 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.165064 Oct 04 18:45:30.762529 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1878/5906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:31.784659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.785280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.792212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.792709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.793155 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.793849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.794312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.794745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.927705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.936639 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5dfdcdac-6bb8-4711-9d21-43915a5ed014 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.155916 Oct 04 18:45:31.937227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4029/5907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.960380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.961015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.964394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:32.970042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.970545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.971000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.971739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.972209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.972652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.103280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:33.111465 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cab81ec2-526e-4e2a-89a6-fa2a1b97f534 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.154999 Oct 04 18:45:33.112035 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1879/5908] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:34.135121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:34.135671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:34.139113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=34 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:34.144887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.145384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.145829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.146535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.146997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.147456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.151589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:34.288019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.299129 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4640ca4-7b49-4d84-9270-87fea3edea71 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.168081 Oct 04 18:45:34.299734 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4030/5909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:34 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.323974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.324759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.331675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.332212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.332665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.333389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.333842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.334278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.337350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=87 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:35.482578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:35.491867 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a3d2b2fd-17d8-458c-9717-afc07e99f0b6 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.172016 Oct 04 18:45:35.492458 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1880/5910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:36.517229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:36.517804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:36.524804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.525392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.525909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.526707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.527268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.527784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.682402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.690360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e993bc7e-609d-4392-b532-aff8509e7f14 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.177550 Oct 04 18:45:36.690942 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4031/5911] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:36 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.713192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.713869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.720974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.721708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.722418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.723060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.723769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.724370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.862257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:37.870878 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78dca812-8920-4db0-8b39-e6989fb6c9f5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.161549 Oct 04 18:45:37.871518 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1881/5912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:37 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.895426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.896250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.903736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.904361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.905264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.906001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.906565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.907001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.063319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:39.071437 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-49b471ff-cdd0-493d-a03a-48fc07b02c74 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.180433 Oct 04 18:45:39.072062 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4032/5913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:40.116424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:40.117387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:40.128812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.129552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.130203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.131265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:40.131864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:40.132573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.331351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:40.341402 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-19c8d8a0-7caa-42c6-a4de-b4f6435ae4dc tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.232723 Oct 04 18:45:40.342064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1882/5914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:40 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:41.366153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.366773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.374399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.374904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.375408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.376125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.376589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.377023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.523636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.532624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-806f3c49-7cbc-4e6b-8c21-d4c7cfa8c7e2 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.170426 Oct 04 18:45:41.533205 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4033/5915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:42.562065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.562982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.569962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.570502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.570935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.571690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.572157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.573104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.725862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.734422 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d0844ce-be0e-46cc-8759-dd49a3257603 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.176708 Oct 04 18:45:42.735015 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1883/5916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:43.767553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.768419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.776165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.776853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.777288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.778001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.778502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.778974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.942875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.952027 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39afb58d-3709-4539-b4a5-f49c3ef6f65c tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.188447 Oct 04 18:45:43.952642 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4034/5917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:44.985741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:44.986640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:44.994699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.995370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.995822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.996625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.997092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.997532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.208174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:45.218719 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0cfc40aa-8651-4f0d-92d3-b45582092d72 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1517 microversion: 2.1 time: 0.239936 Oct 04 18:45:45.219814 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1884/5918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:44 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:45.817199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182317e-578f-467a-9444-85ff7e456a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "a42688ad-2b14-4185-aa53-4c4dd317e6c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:45.829047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.829889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.830505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.846196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Creating event network-vif-unplugged:a42688ad-2b14-4185-aa53-4c4dd317e6c3 for instance 2182317e-578f-467a-9444-85ff7e456a5f on n-h1-831193-17 Oct 04 18:45:45.853099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] Instance 2182317e-578f-467a-9444-85ff7e456a5f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:45:45.867307 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3daa81f7-d540-4984-b5cc-cf4b1c70792a req-899c8265-6dc1-46d1-ac11-ddb6832d8389 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054208 Oct 04 18:45:45.868211 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4035/5919] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:46.255173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:46.255859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:46.263935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.264402 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.264871 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.265607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:46.266081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:46.266525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.409093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.418310 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2c753270-2570-48fa-a63c-44ccdba5990b tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1516 microversion: 2.1 time: 0.167113 Oct 04 18:45:46.418925 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1885/5920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:46 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.447526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.448463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.457028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.457516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.457953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.458655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.459148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.459578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.600101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.608517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b893f96-24ca-41f9-a115-2ca28d15576e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1514 microversion: 2.1 time: 0.167623 Oct 04 18:45:47.609095 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4036/5921] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.883789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2182317e-578f-467a-9444-85ff7e456a5f", "tag": "a42688ad-2b14-4185-aa53-4c4dd317e6c3"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:47.895450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.895975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.896431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.909681 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Creating event network-changed:a42688ad-2b14-4185-aa53-4c4dd317e6c3 for instance 2182317e-578f-467a-9444-85ff7e456a5f on n-h1-831193-17 Oct 04 18:45:47.915596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] Instance 2182317e-578f-467a-9444-85ff7e456a5f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:45:47.926921 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3e8ee935-4eeb-4e40-80b9-7a2e34f59bc5 req-d7831cd5-790d-447c-bb67-ead24f8b7bbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046786 Oct 04 18:45:47.927742 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1886/5922] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:48.633743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.634652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.642270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.642775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.643265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.643993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.644464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.645062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.867472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.876432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c65a0f4b-bec0-4992-b033-21856a0eec8e tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1511 microversion: 2.1 time: 0.246548 Oct 04 18:45:48.877224 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4037/5923] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:48.903428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.904156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.911170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.911684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.912143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.912889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.913357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.913806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.942191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:49.008586 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.compute.api [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Found an unconfirmed migration during delete, id: 15, status: finished Oct 04 18:45:50.610892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b869c304-de77-46e3-af90-9fad8f95c5a5 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 204 len: 0 microversion: 2.1 time: 1.712959 Oct 04 18:45:50.612714 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1887/5924] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:48 2022] DELETE /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 0 bytes in 1715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:50.622203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.622986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.630342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.630914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.631476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.632226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.632687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.633118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.790466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.799544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e00f529f-3861-4163-addd-705bab8650ab tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1503 microversion: 2.1 time: 0.182116 Oct 04 18:45:50.800154 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4038/5925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:51.830013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.830739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.838345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.839177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.839718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.841084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.841084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.841454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.000275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd875e7992c8144339f6f7c84e62bf8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c930d7f0ee4158865ef957ff9b00ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.009040 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6cfab290-f79f-4571-8962-fe2f7f4c1590 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 200 len: 1503 microversion: 2.1 time: 0.183393 Oct 04 18:45:52.009812 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1888/5926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:52.473576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182317e-578f-467a-9444-85ff7e456a5f", "name": "network-vif-deleted", "tag": "a42688ad-2b14-4185-aa53-4c4dd317e6c3"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:52.489352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.489986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.490670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.507805 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] Creating event network-vif-deleted:a42688ad-2b14-4185-aa53-4c4dd317e6c3 for instance 2182317e-578f-467a-9444-85ff7e456a5f on n-h1-831193-17 Oct 04 18:45:52.513949 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-d33e191a-40ea-4506-935f-2d48e352d4fa req-d605a728-8b6f-487c-a8d8-8395f622e325 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044156 Oct 04 18:45:52.514527 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4039/5927] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:53.034611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.035277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.042181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.042695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.043184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.043889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.044362 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.044834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.059354 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] HTTP exception thrown: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Request method failure captured: Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f HTTP/1.1 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH8qVbcronVaJm5Occ8m-6z_pjs07a7njxCkVl-HoBapEGm9AKFUS4Ewd4BMcAMy0pYUbmkuUfT-pYmaPgLPX5vUQbtoyfWCMBH-K9aWDvlfbM_KV-H8ZQXRDRPIoEPHPcxUb1fUVsvpt_afFToAS7tUZHy7hbCXFWIKSvRjSKEykAo Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: d875e7992c8144339f6f7c84e62bf8fa Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2182317e-578f-467a-9444-85ff7e456a5f'} Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.061036 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Returning 404 to user: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-acb9a4db-9c78-440e-9055-390a7849e2a9 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 404 len: 111 microversion: 2.1 time: 0.031909 Oct 04 18:45:53.068006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1889/5928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:53.084844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.085490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.092131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.092619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.093059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.093761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.094223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.094654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.108643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] HTTP exception thrown: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Request method failure captured: Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f HTTP/1.1 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH8qVbcronVaJm5Occ8m-6z_pjs07a7njxCkVl-HoBapEGm9AKFUS4Ewd4BMcAMy0pYUbmkuUfT-pYmaPgLPX5vUQbtoyfWCMBH-K9aWDvlfbM_KV-H8ZQXRDRPIoEPHPcxUb1fUVsvpt_afFToAS7tUZHy7hbCXFWIKSvRjSKEykAo Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: d875e7992c8144339f6f7c84e62bf8fa Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2182317e-578f-467a-9444-85ff7e456a5f'} Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:53.110302 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Returning 404 to user: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-369bb4c6-70fb-453e-807a-a7db7037786d tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 404 len: 111 microversion: 2.1 time: 0.037551 Oct 04 18:45:53.113695 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4040/5929] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:53 2022] DELETE /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:45:53.120615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.121233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] [instance: 2182317e-578f-467a-9444-85ff7e456a5f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.127309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.127804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.128252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.128949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.129412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.129847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.143842 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] HTTP exception thrown: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Request method failure captured: Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f HTTP/1.1 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH8qVbcronVaJm5Occ8m-6z_pjs07a7njxCkVl-HoBapEGm9AKFUS4Ewd4BMcAMy0pYUbmkuUfT-pYmaPgLPX5vUQbtoyfWCMBH-K9aWDvlfbM_KV-H8ZQXRDRPIoEPHPcxUb1fUVsvpt_afFToAS7tUZHy7hbCXFWIKSvRjSKEykAo Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c4c930d7f0ee4158865ef957ff9b00ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: c4c930d7f0ee4158865ef957ff9b00ad Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1435508213 Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: d875e7992c8144339f6f7c84e62bf8fa Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-DeleteServersTestJSON-1435508213-project Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2182317e-578f-467a-9444-85ff7e456a5f'} Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:53.145396 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] Returning 404 to user: Instance 2182317e-578f-467a-9444-85ff7e456a5f could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a40c4737-b7d0-4d0a-834b-4b43a79d7166 tempest-DeleteServersTestJSON-1435508213 tempest-DeleteServersTestJSON-1435508213-project] 10.222.0.33 "GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f" status: 404 len: 111 microversion: 2.1 time: 0.030072 Oct 04 18:45:53.149550 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1890/5930] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/2182317e-578f-467a-9444-85ff7e456a5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:02.926241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1106642536", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "836611db-b439-4c08-8556-eff90355851a"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:02.983782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] validate_networks() for [('836611db-b439-4c08-8556-eff90355851a', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:03.099439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=55 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:03.403637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:03.404054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:03.404528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:03.405194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:03.405623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:03.422823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.423645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.424088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.424837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.425299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.425761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.445657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:03.452620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for user 3340b4fc5b564f709c822dc7f0ff99e1 and project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:03.469547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:03.473635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:03.526916 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0259dad5-d5ba-4921-8c1a-b29463ec033f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788693 Oct 04 18:46:03.534403 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4041/5931] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:03.537495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:03.538808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:03.544533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f55e75d-de64-4e0b-982f-abe35c09b9c0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:03.545132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1f55e75d-de64-4e0b-982f-abe35c09b9c0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:03.675396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1f55e75d-de64-4e0b-982f-abe35c09b9c0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.683696 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f55e75d-de64-4e0b-982f-abe35c09b9c0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1218 microversion: 2.1 time: 0.147575 Oct 04 18:46:03.684421 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1891/5932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:03 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:04.708820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:04.709445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.712715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:04.721172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.721684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.722129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.722915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.723564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.724000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.805453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:04.814187 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3647a1a-4c13-4527-8509-6d51ccc45dee tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1288 microversion: 2.1 time: 0.112105 Oct 04 18:46:04.815407 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4042/5933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:04 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:05.839474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:05.840185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:05.848821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.849357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.850175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.850899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.851912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.852521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.992961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.002793 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0014dd0c-d03d-4d72-b9d6-98930ddeab9c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1318 microversion: 2.1 time: 0.168766 Oct 04 18:46:06.003750 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1892/5934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:05 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:06.042110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:06.053941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.055469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.056721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.075385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] Creating event network-changed:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h1-831193-17 Oct 04 18:46:06.081269 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e50dcaa8-b95c-4589-bf04-8b22415aba17 req-f547515a-2284-492a-b059-38f3047bf771 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044692 Oct 04 18:46:06.082085 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4043/5935] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:07.026921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:07.027628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.034813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.035341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.035791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.036506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.036975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.037417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.170588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:07.179101 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-607ad6f9-4243-4e6e-91f8-798b3f9d9e63 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1318 microversion: 2.1 time: 0.156185 Oct 04 18:46:07.179751 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1893/5936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:07 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:08.204693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:08.205391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.211818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.212315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.212754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.213994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.214452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.214884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.432952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:08.440985 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-245fd4a2-38c7-4d9a-b54a-d893c8bfc85e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1318 microversion: 2.1 time: 0.241353 Oct 04 18:46:08.441558 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4044/5937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:08 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:09.465912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:09.466669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:09.473764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.474343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.474861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.475674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.476241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.476751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.607423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:09.615327 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b066d55-320b-45fc-8dfd-bcfdec6f598c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1318 microversion: 2.1 time: 0.153397 Oct 04 18:46:09.615899 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1894/5938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:09 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:10.424280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "name": "network-vif-plugged", "status": "completed", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:10.436036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.436528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.437002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.448731 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] Creating event network-vif-plugged:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h1-831193-17 Oct 04 18:46:10.454677 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-fac9b957-20e2-453a-ad67-9f08f347a114 req-b787c035-f4f0-4768-a6c2-1f92a189161d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 Oct 04 18:46:10.455334 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4045/5939] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:10.638875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:10.639534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:10.646409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.646916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.647410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.648129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.648602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.649047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.781246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:10.792881 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c8bf363-2be5-4a9a-a2e6-96f4a896960a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1318 microversion: 2.1 time: 0.157963 Oct 04 18:46:10.793451 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1895/5940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:10 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:11.816121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.816824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.824646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.825149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.825595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.826337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.826765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.827229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.964385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.972192 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c05ef4b2-5167-47e8-8a7d-8a54cf08cc4e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1508 microversion: 2.1 time: 0.160339 Oct 04 18:46:11.972767 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4046/5941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:11.995437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.996101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.003017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.003551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.004011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.004727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.005201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.005646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.142488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.150373 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5aa70ffb-caf0-4be7-b60f-47d4c4a52c05 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1508 microversion: 2.1 time: 0.158841 Oct 04 18:46:12.150944 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1896/5942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.172594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.175176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.182102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.182746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.183250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.183975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.184441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.184875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.255239 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e4b7c9e7-d9ff-4833-b34a-70bdd1545e0f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "PUT /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1080 microversion: 2.1 time: 0.086329 Oct 04 18:46:12.256486 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4047/5943] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 18:46:12 2022] PUT /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.275080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.276186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.282910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.283431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.283880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.284587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.285090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.285574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.413795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.422078 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-85705654-26b6-476d-a831-7491a98458e9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1506 microversion: 2.1 time: 0.150872 Oct 04 18:46:12.422672 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1897/5944] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.445037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.445654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.451985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.452480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.452926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.453630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.454106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.454530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.594020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.601741 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88b0eac7-3cf3-4654-aaa7-44a3e5da572a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1506 microversion: 2.1 time: 0.160690 Oct 04 18:46:12.602316 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4048/5945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.625536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.627951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.634197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.634693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.635178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.635884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.636349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.636784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.717757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.723341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:46:12.730291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:12.730755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:12.731271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:12.731695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:12.732135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:12.848064 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c85d83a-963f-4087-be65-8259a780c204 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0/action" status: 202 len: 0 microversion: 2.1 time: 0.226325 Oct 04 18:46:12.848845 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1898/5946] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:12 2022] POST /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:12.857824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.858443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.865725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.866215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.866657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.867394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.867848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.868274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.009386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:13.018210 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-95610dc9-823f-4961-a6f9-a7a8d90ca9a7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1517 microversion: 2.1 time: 0.165157 Oct 04 18:46:13.018797 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4049/5947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:14.039807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:14.045015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:14.045734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.052363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.052869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.053325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.054044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.054512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.054952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.197356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.205696 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-51244be0-d4de-4b5b-83c3-8c4c0e29b6d0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1517 microversion: 2.1 time: 0.167544 Oct 04 18:46:14.206298 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1899/5948] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:14 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:15.230633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.231296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.233317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:15.233995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:15.240878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.241372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.241808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.242511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.242968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.243419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.381937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.390467 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43be57e9-c8af-403a-b3de-f90049c28f44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.164495 Oct 04 18:46:15.391067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4050/5949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.414725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:16.415376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.422520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.423016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.423488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.424192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.424654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.425091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.554837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.563513 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f1641834-b6f8-468f-ad73-3a37e7d47293 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.152640 Oct 04 18:46:16.564096 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1900/5950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:16 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:17.587971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:17.589240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.596531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.597021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.597462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.598162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.598619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.599072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.732311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.740722 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63072948-3e9a-468c-9937-49d40b97b4cf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.156725 Oct 04 18:46:17.741318 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4051/5951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:17 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.764064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.764690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.771555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.772048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.772498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.773196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.773664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.774135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.904921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.912954 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-664dcaa0-5270-4aa5-b3b4-f4b93fa14eac tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.153377 Oct 04 18:46:18.913537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1901/5952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:19.936117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.936734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.943607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.944103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.944546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.945246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.945706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.946139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.075455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.083243 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e34b727-4d86-46f2-93d5-f0dfcd86792b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.151132 Oct 04 18:46:20.083827 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4052/5953] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.109419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.109975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.117145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.117658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.118114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.118828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.119380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.120018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.252595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.262152 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f5f89f99-b7d3-4f25-8c40-29f5fe871911 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.156740 Oct 04 18:46:21.262739 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1902/5954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:22.285689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.286313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.293367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.293859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.294300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.295004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.295485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.295915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.432525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.440698 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44e8f37c-c950-483b-a9fa-947dd3c33fbf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.158880 Oct 04 18:46:22.441288 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4053/5955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:23.465756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.466388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.473468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.473966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.474425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.475177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.475650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.476100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.612887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.620947 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bbb38ecd-93ba-4fb1-b00b-2775ec6354d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.159842 Oct 04 18:46:23.621539 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1903/5956] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.643891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.644530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.650733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.651262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.651703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.652397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.652851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.653276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.784407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.792606 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d0d59dd9-4b9e-4c37-b96d-aee9f340cab5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.152774 Oct 04 18:46:24.793195 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4054/5957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.817435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.818073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.824540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.825045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.825504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.826232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.826706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.827176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.961806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.969600 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cb1ae4ae-e3c3-4cac-8f4b-fbbe2818e6bd tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.156304 Oct 04 18:46:25.970177 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1904/5958] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:26.993216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:26.993834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.001442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.001931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.002376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.003094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.003555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.003984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.133965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.142026 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-951ec3d6-12cc-46be-88ca-3c0b762f6b53 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.152813 Oct 04 18:46:27.142612 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4055/5959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:26 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.168189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.168865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.177768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.178280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.178776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.179643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.180112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.180566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.336333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.346578 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b5263296-71c0-45b0-9f51-588ad10af85f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.183614 Oct 04 18:46:28.347208 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1905/5960] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:29.372288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.373424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.380547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.381033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.381477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.382177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.382630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.383104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.530757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.538796 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a045e99b-3897-4991-9fd6-15abd8c8c5d7 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.170571 Oct 04 18:46:29.539444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4056/5961] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:30.562518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:30.563232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:30.570102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.570594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.571057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.571771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.572239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.572672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.706228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.714145 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-64061e62-50fe-43cd-8855-ac13068ce20b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.156045 Oct 04 18:46:30.714749 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1906/5962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:30 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:31.740859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.741495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.748605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.749727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.750179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.750896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.751396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.751826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.895388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.903770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6485f93a-5af3-466b-a08e-a41d475d9470 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.167154 Oct 04 18:46:31.904528 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4057/5963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.928197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.928855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.935744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.936247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.936702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.937413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.937879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.938350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.942403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:33.076946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.084771 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b459620-b1a4-483b-a1f8-6433c558f4d8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.160513 Oct 04 18:46:33.085353 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1907/5964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:34.108760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.109291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.116375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.116874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.117318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.118020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.118482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.118918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.121630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:34.256860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:34.265359 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-52c72013-fc22-4dea-95fe-f030ba07ccca tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.159945 Oct 04 18:46:34.265936 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4058/5965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:35.289254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.289905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:35.292600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=41 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:35.298435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.298924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.299396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.300094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.300557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.300995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.435865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.443672 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60b9e168-bd40-45c1-a014-749db60d2903 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.158376 Oct 04 18:46:35.444247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1908/5966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:35 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:36.468323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.468936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.470779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=34 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:36.476098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.476582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.477017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.477706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.478159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.478586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.614895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.623016 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c1fe2ea-338b-40a6-9abe-f8d4b37eb739 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.160061 Oct 04 18:46:36.623666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4059/5967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.646912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.648214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.655796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.656355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.656882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.657627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.658112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.658562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.794289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.802646 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f99ced91-a44d-4f20-894a-1fff34b69aa6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.159666 Oct 04 18:46:37.803252 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1909/5968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:38.826136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.826706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.837052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.837549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.837995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.838707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.839198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.839634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.971159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.980098 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee5175f0-1967-4a53-9ac4-14dbfebb4029 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.157882 Oct 04 18:46:38.980692 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4060/5969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.007564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.008336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.017687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.018442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.019149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.020204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.020763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.021210 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.181359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.195496 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-aa79cbde-ad41-49ee-abc1-314c57a9bea5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.191578 Oct 04 18:46:40.196755 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1910/5970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.228121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.228740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.237594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.238502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.239335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.240141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.240608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.241041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.382591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.391729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4a270a89-856d-4409-8eac-7097cb5f5874 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1522 microversion: 2.1 time: 0.167526 Oct 04 18:46:41.392501 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4061/5971] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.225832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:42.235883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.236371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.236816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.248453 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Creating event network-vif-unplugged:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h2-831193-17 Oct 04 18:46:42.253776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:46:42.265757 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-94ea1b61-66e2-4844-a80f-a28508aa289d req-1f12c483-9d8d-4037-97d8-43345d2bb80a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098229 Oct 04 18:46:42.266645 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1911/5972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:42.417488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.418169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.425561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.426049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.426480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.427444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.427905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.428339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.662050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.670310 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4398555-7c1d-45c0-81bb-d66fd8e5e6f0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1521 microversion: 2.1 time: 0.257890 Oct 04 18:46:42.671659 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4062/5973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.696451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.697193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.704114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.704620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.705079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.705798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.706271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.706719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.846919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.854759 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d52e56ec-935a-40bd-aefc-60f4f2f75f06 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1519 microversion: 2.1 time: 0.163486 Oct 04 18:46:43.855367 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1912/5974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.281105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:44.291608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.292098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.292543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.304828 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Creating event network-changed:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h2-831193-17 Oct 04 18:46:44.310086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:46:44.321114 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-19d32cdf-a95c-4936-881f-22f43917e014 req-332345c8-0d16-443b-a288-242f51f117fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044534 Oct 04 18:46:44.321725 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4063/5975] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:44.879672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.880959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.890243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.891057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.891774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.893459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.893769 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.894545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.093595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.102873 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08204455-6135-4554-9206-b195d910884a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1516 microversion: 2.1 time: 0.227113 Oct 04 18:46:45.103505 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1913/5976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:45.127163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:45.127780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.134152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.134670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.135142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.135868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.136360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.136795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.201238 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-410613a0-ac86-42f0-a8ab-1488fbffc12b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0/action" status: 204 len: 0 microversion: 2.1 time: 0.078418 Oct 04 18:46:45.202589 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4064/5977] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:45 2022] POST /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:45.219140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.220277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.227218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.228002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.229265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.229686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.231734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.231734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.402729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.418012 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c2358017-1dc2-4fcc-8c92-191e0106da44 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1516 microversion: 2.1 time: 0.204707 Oct 04 18:46:45.420128 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1914/5978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:46.462337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.463195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.470361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.470863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.471439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.472188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.472649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.473225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.647283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.658212 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ba05177-872c-4a55-9507-d3b5cc3be96f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1516 microversion: 2.1 time: 0.201785 Oct 04 18:46:46.659008 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4065/5979] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.468258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "name": "network-vif-plugged", "status": "completed", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:47.478264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.478750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.479225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.493020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] Creating event network-vif-plugged:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h2-831193-17 Oct 04 18:46:47.500187 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-dd52a294-559d-4227-8b56-9e1922416a5d req-84d7fceb-5c71-4b1c-b73d-69b7577f5d71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096021 Oct 04 18:46:47.500986 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1915/5980] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:47.687885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.688528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.696795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.697371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.697887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.698727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.699346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.699847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.902895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.913778 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee2806a0-a799-4d23-b374-91b82d8829f2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1508 microversion: 2.1 time: 0.231447 Oct 04 18:46:47.914256 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4066/5981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.943535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.944241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.951542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.952152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.952636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.953374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.953850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.954373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.099381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.107354 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-abea3e75-3632-454e-b08b-29cd7d4bf4c2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1508 microversion: 2.1 time: 0.168510 Oct 04 18:46:48.108493 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1916/5982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.133656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'create', calling method: .version_select at 0x7f6345ca4670>, body: {"keypair": {"name": "tempest-keypair-567775626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRGPO3YeWLPFFk+HpTfBA/A0l594sW6aR6g2YTx0R4i2wVlDWc1mfPwWRfT3UWddwkTr6b2KjAK+DGBVKD/YzIdMrPWC/M9t7MzsSvrhAjvuijJhI0WCEMqYwBorwHWBw=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:48.149558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:48.155612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for user 3340b4fc5b564f709c822dc7f0ff99e1 and project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:48.169200 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:46:49.177130 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57050. Oct 04 18:46:49.194327 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9cc513e-3219-4584-b978-a34d3d3870b2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.064680 Oct 04 18:46:49.194960 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4067/5983] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:46:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:50.440771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.441416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.448683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.449184 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.449634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.450350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.450817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.451288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.598801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.609860 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-687b0002-d21c-442f-ac3d-19bcab1a7b2e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 200 len: 1508 microversion: 2.1 time: 0.173753 Oct 04 18:46:50.610918 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1917/5984] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.635936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.636824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.642637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.643168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.643608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.644323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.644783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.645215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.676389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:50.763590 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-435c4769-1607-427b-a1bc-eea07f44ac57 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 204 len: 0 microversion: 2.1 time: 0.132769 Oct 04 18:46:50.764214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4068/5985] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:50 2022] DELETE /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:50.832989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1431730828", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "836611db-b439-4c08-8556-eff90355851a"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:50.893314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] validate_networks() for [('836611db-b439-4c08-8556-eff90355851a', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:51.616663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:51.617281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:51.617579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:51.618004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:51.618427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:51.628244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.628742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.629181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.629921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.630388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.630828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.650860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:51.656790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Getting quotas for user 3340b4fc5b564f709c822dc7f0ff99e1 and project 5761d3e4a69b484cbbab3858b6c760f6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:51.670307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:51.672690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:51.723581 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0224858-0d57-42c9-8cfb-eb9382574ace tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894495 Oct 04 18:46:51.724278 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1918/5986] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:51.743893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-942bad73-966c-409c-882b-21e5f8ccb2f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.745387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-942bad73-966c-409c-882b-21e5f8ccb2f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.832104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-942bad73-966c-409c-882b-21e5f8ccb2f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.845855 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-942bad73-966c-409c-882b-21e5f8ccb2f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1218 microversion: 2.1 time: 0.112912 Oct 04 18:46:51.846837 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4069/5987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:52.513212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d0ae86-1c3f-4747-b2a3-411e10f58fb0", "name": "network-vif-deleted", "tag": "2ca932f7-fa9c-480f-bb55-ba378b57ddbe"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:52.526531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.526968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.527433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.542208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] Creating event network-vif-deleted:2ca932f7-fa9c-480f-bb55-ba378b57ddbe for instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 on n-h2-831193-17 Oct 04 18:46:52.548477 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a7167923-a688-40d1-a6d4-8d3abd61612f req-02ab591d-318a-4ecd-9374-035ae4d310d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039335 Oct 04 18:46:52.549159 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1919/5988] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:52.881342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.882308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.895393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.896497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.897135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.897985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.898453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.898881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.998753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.008041 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ddd770a8-16a5-42f3-b8ff-dd6619566e97 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1278 microversion: 2.1 time: 0.130894 Oct 04 18:46:53.008914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4070/5989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.039063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.041034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.049495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.050144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.051915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.052754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.053330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.053882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.383766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.397387 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5667d350-657e-4a56-9d5d-2c1c14a3ae18 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.363840 Oct 04 18:46:54.397990 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1920/5990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.565215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:54.577263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.577885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.578393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.590901 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] Creating event network-changed:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h2-831193-17 Oct 04 18:46:54.596802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-a79f34d7-5be5-415a-acfa-f6e1d466d6ad req-88df9f41-7cbd-42c0-8a84-154740448cab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035580 Oct 04 18:46:54.597410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4071/5991] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:55.437504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.438133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.445139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.445640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.446092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.446806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.447308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.447755 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.583942 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.591786 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca0ada04-bc88-4e1b-8961-bdac1d0a29fb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.158263 Oct 04 18:46:55.592883 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1921/5992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:56.616776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.617657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.625923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.626419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.626948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.627798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.628302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.628703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.766332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:56.774414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-56f9bfff-d852-41c4-9d7a-2230c0e06e5c tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.163128 Oct 04 18:46:56.774994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4072/5993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:57.799258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.799806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.807598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.808103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.808561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.809278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.809750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.810196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.945834 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.953892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3550242f-0bf6-4fa0-b3da-90a610b24f30 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.158716 Oct 04 18:46:57.954465 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1922/5994] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:57 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.977875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.978580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.987579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.988063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.988499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.989196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.989648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.990228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.129400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.137197 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c2ae64a-fa58-46e0-b6a0-45b99aae1f37 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.163249 Oct 04 18:46:59.137769 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4073/5995] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:59.381449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "name": "network-vif-plugged", "status": "completed", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:59.393570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.394072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.394685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.407419 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] Creating event network-vif-plugged:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h2-831193-17 Oct 04 18:46:59.412692 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b334ad53-4416-4c1f-a151-7b4bda62fc82 req-9eaee371-90e0-4fd3-a84e-3c922d05dc59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Oct 04 18:46:59.413483 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1923/5996] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:00.160402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.160924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.168006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.168505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.168944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.169638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.170094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.170521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.317779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.321412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:00.327630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b9960f65-be99-44c5-a83a-9a641d6ad30e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1318 microversion: 2.1 time: 0.171230 Oct 04 18:47:00.328232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4074/5997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.354178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.355047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.362087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.362610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.363058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.363775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.364237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.364677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.509919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.522335 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a161781-2893-4e01-8ee2-be1911e77f01 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1507 microversion: 2.1 time: 0.174222 Oct 04 18:47:01.522920 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1924/5998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.547361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.548002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.556257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.556712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.557150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.557860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.558315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.558740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.702351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.710309 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cebea173-ab19-4957-b52b-cfdbedb1e450 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1507 microversion: 2.1 time: 0.168230 Oct 04 18:47:01.710886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4075/5999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.735814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:01.738089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.740150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.740853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.747493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.748005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.748505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.749258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.749726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.750173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.784843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.790859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:47:01.798019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:01.798463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:01.798960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:01.799457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:01.799892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:01.853995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.886196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fdf6d116-6f78-4a04-a7ed-baa4348260f6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78/action" status: 202 len: 0 microversion: 2.1 time: 0.154963 Oct 04 18:47:01.886868 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1925/6000] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:01 2022] POST /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:47:01.895942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.896487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.899205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.905228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.906075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.906619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.907449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.907971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.909142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.067339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.075725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a549900-9527-4cef-8968-991a2b2f4f2d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1514 microversion: 2.1 time: 0.183803 Oct 04 18:47:02.076830 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4076/6001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:03.100488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.101039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.108771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.109274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.109728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.110584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.111111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.111568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.350426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.359634 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-97e42d0c-9878-4aab-926e-034dcc5c173e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1514 microversion: 2.1 time: 0.264014 Oct 04 18:47:03.360152 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1926/6002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:03 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.384316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.384935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.392536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.393026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.393589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.394304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.394757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.395213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.534714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.542767 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c2e86a5a-a379-4ff2-b9af-7c3c142126a8 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.162448 Oct 04 18:47:04.543582 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4077/6003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:05.566872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.567623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.570278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:05.576235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.576777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.577232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.577949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.578432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.578877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.726776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.736038 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4b5fde2a-7d7a-43c3-a647-782106bd9bd6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.173010 Oct 04 18:47:05.738280 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1927/6004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.764407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.765542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.769890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:06.781014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.781852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.782634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.783906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.784738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.785330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.954496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.962695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88946fe7-41c6-4486-bcf4-4d687a69150f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.206003 Oct 04 18:47:06.963326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4078/6005] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.993319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.993941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.001750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.002304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.002760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.003595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.004071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.004506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.153447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.164129 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e57d93d0-9814-4439-85db-4ce1cacc6ccc tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.175526 Oct 04 18:47:08.164731 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1928/6006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:09.190088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.190901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.197745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.198236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.198684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.199499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.199902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.200360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.333941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.342336 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-84d25189-b21f-4eeb-a4b2-1977132aee3e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.156317 Oct 04 18:47:09.343145 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4079/6007] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.366637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.367289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.374627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.375164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.375632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.376336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.376810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.377248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.535203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.540883 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-72743fdf-f23a-488f-934b-0103eb1df1fe tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.178139 Oct 04 18:47:10.541477 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1929/6008] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.567169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.567788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.575135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.575631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.576636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.577401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.578000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.578283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.729076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.737739 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f28b8e84-da10-4468-9529-68bc57419f8f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.174695 Oct 04 18:47:11.738341 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4080/6009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:12.767043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.767759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.775266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.775768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.776221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.776940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.777412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.777856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.933204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.941062 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-44ba45c9-e0d8-4bfc-9b9d-949d3d780ea1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.178575 Oct 04 18:47:12.941644 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1930/6010] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:13.965583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.966269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.974921 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.975507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.975959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.976716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.977170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.977598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.145661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.156947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a003fc96-e72b-4d4a-b7cf-9e0dd464bae6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.196109 Oct 04 18:47:14.157548 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4081/6011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.183565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.184499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.193938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.194807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.195519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.196733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.197630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.198403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.351313 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.364689 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-044d583e-0975-4cf8-8d2a-f97bdd3956e1 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.186363 Oct 04 18:47:15.365297 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1931/6012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.389674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.390356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.397548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.398040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.398478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.399329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.399823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.400327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.564564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.579875 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50162553-13aa-4ae0-884c-11ac3642959f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.194646 Oct 04 18:47:16.580482 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4082/6013] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:17.607096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.608247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.621361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.622259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.623580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.624780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.625579 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.626354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.801742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:17.818520 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ea79cf7-3f6d-43a8-9768-e2131ef53e86 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.218459 Oct 04 18:47:17.820015 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1932/6014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:18.855836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.856462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.865511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.866015 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.866459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.867243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.867708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.868138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.057026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.065794 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a1adfd0-977d-4da7-a58a-a958c21123e2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.213978 Oct 04 18:47:19.066418 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4083/6015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:20.104622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.105592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.114523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.115381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.116219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.117424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.118222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.118955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.333418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.342679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9ac0ce61-ce24-48c6-aa89-e0a745237e83 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.242717 Oct 04 18:47:20.343348 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1933/6016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:21.374798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.375940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.391301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.392149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.392866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.394023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.394768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.395531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.589204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.603543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee97fcf9-ac7f-49bd-98a9-0498e94b20af tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.235499 Oct 04 18:47:21.607882 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4084/6017] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.641817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.642719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.650346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.650912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.651626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.652526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.653114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.653631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.820023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.834293 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cd68dff2-8b67-4142-85ff-b70f6f7239da tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.196888 Oct 04 18:47:22.835245 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1934/6018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:23.872470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.873517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.884538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.885365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.886089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.887379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.888187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.889447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.117236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:24.132142 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b139bf02-de23-473c-a668-11e437fd7076 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.266663 Oct 04 18:47:24.133167 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4085/6019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:25.173166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:25.174148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:25.191128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.191925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.192653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.194073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.194842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.195531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.443510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.458630 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e140f8fd-af23-4ece-a3f7-c62426a3f252 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.291943 Oct 04 18:47:25.459645 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1935/6020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:25 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.504151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.505265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.517659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.518513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.519517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.520769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.521570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.522267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.710244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.724734 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8de9955b-ef04-4ec6-a06d-ae7ba28f10e4 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.228716 Oct 04 18:47:26.725614 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4086/6021] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:27.764010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:27.764633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:27.772019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.772521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.772971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.773692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.774160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.775118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.933995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:27.945728 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1413797d-6063-41c2-acea-bc167de90342 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.185998 Oct 04 18:47:27.946543 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1936/6022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:27 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.974394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.975060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.983419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.983913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.984352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.985060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.985515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.985941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.127621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.135888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a54c8e4-f3dc-45a7-97d2-d73a1aca1217 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.165448 Oct 04 18:47:29.136587 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4087/6023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:30.161941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.162480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.170015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.170521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.171104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.172391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.173247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.173936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.342680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.351272 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-29b71f44-e505-464a-b71a-d68d91079a80 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.193291 Oct 04 18:47:30.351876 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1937/6024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.375560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.376577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.384656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.385193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.385632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.386335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.386817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.387259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.545647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.554348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a57358ae-46ed-48c3-9a31-f2f871c0ba71 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.183993 Oct 04 18:47:31.554972 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4088/6025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:32.581487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.582173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.595257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.596108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.596872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.598062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.598833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.599629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.603441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:32.777012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.788052 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e11543cf-30ba-4f5b-a7d6-fe3bd9be3b8b tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.210352 Oct 04 18:47:32.788773 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1938/6026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.814421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.815287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.822355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.822926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.823325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.824040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.824500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.824932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.830440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=85 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:34.024494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.036079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a813d92a-2263-4bd4-a7aa-327ac01ee30f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.226500 Oct 04 18:47:34.036955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4089/6027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:35.070824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.071504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.079485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.079909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.080360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.081108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.081543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.081992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.250443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:35.259707 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-49cec2fd-d3dd-4215-a43b-3535fcb6f256 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1519 microversion: 2.1 time: 0.192850 Oct 04 18:47:35.260331 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1939/6028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:36.212411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "name": "network-vif-unplugged", "status": "completed", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:36.222786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.223218 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.223701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.237487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Creating event network-vif-unplugged:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h1-831193-17 Oct 04 18:47:36.243658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:36.258370 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9641709a-caf9-41ec-9913-24ca74afc537 req-4aee0765-21d4-4c15-b8da-f33093c2e7fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102029 Oct 04 18:47:36.259001 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4090/6029] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:36.287316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:36.288409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:36.292155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=26 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:36.299836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.300669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.301199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.302069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.302705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.303285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.470081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.487723 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-81531766-2f0f-4fb7-b1b7-8e94a6293892 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1518 microversion: 2.1 time: 0.204612 Oct 04 18:47:36.496551 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1940/6030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:36 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.526677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.527696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.530999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=26 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:37.537402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.537890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.538331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.539049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.539673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.540104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.687117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:37.695325 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-43498aca-7bd6-48a2-9e3b-698ca4052ce6 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1516 microversion: 2.1 time: 0.172983 Oct 04 18:47:37.695922 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4091/6031] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:38.289572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:38.300216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.300709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.301197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.315698 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Creating event network-changed:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h1-831193-17 Oct 04 18:47:38.321638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:38.334321 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f98b7e48-fc3e-466e-b056-2f1963215be7 req-0070cdbb-1940-4df6-8123-0904689c06bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049117 Oct 04 18:47:38.335151 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1941/6032] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:38.724012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:38.726020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.744078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.744658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.745210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.746297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.747026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.747491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.109004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.119669 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d94e100-8925-4384-8a4f-e5007f9411d5 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1516 microversion: 2.1 time: 0.403349 Oct 04 18:47:39.120903 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4092/6033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:38 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.161309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.162503 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.176815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.177665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.178486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.179839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.180692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.181490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.357808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.372926 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-75167764-9380-4895-be4b-500e995fa871 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1513 microversion: 2.1 time: 0.222541 Oct 04 18:47:40.374169 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1942/6034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.403085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:40.404573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.415909 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.416692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.417495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.418622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.419527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.420262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.499497 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dff3e8b9-9a6d-4875-b086-302bc35118aa tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "POST /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78/action" status: 204 len: 0 microversion: 2.1 time: 0.103150 Oct 04 18:47:40.500218 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4093/6035] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:40 2022] POST /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78/action => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:40.514605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.515923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.526727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.527383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.527858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.529190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.529640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.530081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.791661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.805980 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1ce8232b-1f92-40d1-8ce1-ac2afad38e8e tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1513 microversion: 2.1 time: 0.298073 Oct 04 18:47:40.823359 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1943/6036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:41.841800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.842626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.854262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.854987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.855765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.857668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.858401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.859233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.052844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.066386 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a607ed48-217f-44e9-86d3-a8f42b4b2df0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1513 microversion: 2.1 time: 0.229295 Oct 04 18:47:42.067548 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4094/6037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:42.938609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "name": "network-vif-plugged", "status": "completed", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:42.952444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.952937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.953382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.965745 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] Creating event network-vif-plugged:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h1-831193-17 Oct 04 18:47:42.972731 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2504591d-c732-4509-8516-248d4c9c6f92 req-bc18d338-dfa2-4c8c-9077-5d33cca5f5af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041857 Oct 04 18:47:42.974129 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1944/6038] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:43.104093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.104714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.114503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.115003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.115486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.116192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.116652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.117087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.266632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.274883 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-50542c67-4af1-4b0d-94df-ed64e5b3e2bf tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1505 microversion: 2.1 time: 0.174612 Oct 04 18:47:43.275434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4095/6039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:43.299739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.300501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.307109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.307623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.308084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.308820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.309306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.309829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.479826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.488706 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1ca70d3e-5dc6-4355-a38c-634bca6c4581 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1505 microversion: 2.1 time: 0.194496 Oct 04 18:47:43.489315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1945/6040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:43.511400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.512242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.519062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.519609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.520031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.520738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.521193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.521620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.671847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.679909 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c5a5eeda-76ac-4113-a7c0-c68b17fc451a tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1505 microversion: 2.1 time: 0.172734 Oct 04 18:47:43.680594 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4096/6041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:43.703971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.704495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.710891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.711446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.711913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.712647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.713125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.713603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.741801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:43.835894 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e29ec4ac-5472-4514-a417-1f47d4044bdb tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 204 len: 0 microversion: 2.1 time: 0.136225 Oct 04 18:47:43.836791 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1946/6042] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:43 2022] DELETE /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:43.861046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.861480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.868068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.868568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.869077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.869787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.870246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.870678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.909593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:43.974050 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.compute.api [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Instance is already in deleting state, ignoring this request Oct 04 18:47:43.974916 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-868573b1-a870-4284-b04a-a287c0d0bb95 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 204 len: 0 microversion: 2.1 time: 0.119097 Oct 04 18:47:43.975545 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4097/6043] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:43 2022] DELETE /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:43.984860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.985586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.993030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.993554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.994012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.994738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.995245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.995791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.150721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.160501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a1ae37bb-c254-4e3d-a363-842817f5221d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1511 microversion: 2.1 time: 0.179992 Oct 04 18:47:44.161130 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1947/6044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:45.187078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.188090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.198345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.199178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.199803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.200924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.201636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.202303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.385159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3340b4fc5b564f709c822dc7f0ff99e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5761d3e4a69b484cbbab3858b6c760f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.396131 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-beec504b-d1d7-453d-91a0-699f4a05eef2 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 200 len: 1511 microversion: 2.1 time: 0.215292 Oct 04 18:47:45.396740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4098/6045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.582720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72a3c35-e013-49cd-995e-fc13ffcfec78", "name": "network-vif-deleted", "tag": "cc8276aa-4143-4fa3-a805-4f7e5075baac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:45.596220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.596726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.597419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.611570 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] Creating event network-vif-deleted:cc8276aa-4143-4fa3-a805-4f7e5075baac for instance a72a3c35-e013-49cd-995e-fc13ffcfec78 on n-h1-831193-17 Oct 04 18:47:45.617340 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a7ce5b8b-88b5-4e7b-944b-d3db5fbf47cf req-694f504b-b155-4c41-88ea-6f5953963afc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Oct 04 18:47:45.618063 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1948/6046] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:46.427790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.428344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: a72a3c35-e013-49cd-995e-fc13ffcfec78] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.435781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.436279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.436720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.437424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.437877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.438336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.455598 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] HTTP exception thrown: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Request method failure captured: Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 HTTP/1.1 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH9qiOSwAZlT82nDO6TamNuH0c0y8Pb8zh_O95lCv-o3KVmg5e6FJKpSocCBxKMlRNO6TH32S9CGGy50wrUE1-bDFudfvZJVd-eOfXOlS7GMFDVjSjkaQLgCjUU37qVgGdvmKcVSWYVaHlExYJmwb5_haKAJVbgz0eAXfSQrks7lDYA Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3340b4fc5b564f709c822dc7f0ff99e1 Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a72a3c35-e013-49cd-995e-fc13ffcfec78'} Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.457275 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Returning 404 to user: Instance a72a3c35-e013-49cd-995e-fc13ffcfec78 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:46.461725 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26dcd3bc-b2fc-4332-87f8-ee3c8ca8e4c9 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78" status: 404 len: 111 microversion: 2.1 time: 0.034917 Oct 04 18:47:46.462422 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4099/6047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/a72a3c35-e013-49cd-995e-fc13ffcfec78 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:46.468215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-983b9c27-b5bc-40e1-ad5c-ba5f596e043f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '.version_select at 0x7f6345d70c10>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.492704 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-983b9c27-b5bc-40e1-ad5c-ba5f596e043f tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567775626" status: 202 len: 0 microversion: 2.1 time: 0.028748 Oct 04 18:47:46.493298 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1949/6048] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 18:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567775626 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:47.135899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.136537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.143093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.143588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.144030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.144731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.145208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.145622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.163707 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] HTTP exception thrown: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Request method failure captured: Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 HTTP/1.1 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH9qiOSwAZlT82nDO6TamNuH0c0y8Pb8zh_O95lCv-o3KVmg5e6FJKpSocCBxKMlRNO6TH32S9CGGy50wrUE1-bDFudfvZJVd-eOfXOlS7GMFDVjSjkaQLgCjUU37qVgGdvmKcVSWYVaHlExYJmwb5_haKAJVbgz0eAXfSQrks7lDYA Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3340b4fc5b564f709c822dc7f0ff99e1 Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '94d0ae86-1c3f-4747-b2a3-411e10f58fb0'} Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:47.165370 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Returning 404 to user: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12c02670-3474-4d70-a547-3fdea4ab1eb0 tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 404 len: 111 microversion: 2.1 time: 0.034934 Oct 04 18:47:47.171491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4100/6049] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:47 2022] DELETE /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:47.177077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.177842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] [instance: 94d0ae86-1c3f-4747-b2a3-411e10f58fb0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.186609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.187182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.187663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.188401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.188879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.189406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.204695 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] HTTP exception thrown: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Request method failure captured: Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 HTTP/1.1 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH9qiOSwAZlT82nDO6TamNuH0c0y8Pb8zh_O95lCv-o3KVmg5e6FJKpSocCBxKMlRNO6TH32S9CGGy50wrUE1-bDFudfvZJVd-eOfXOlS7GMFDVjSjkaQLgCjUU37qVgGdvmKcVSWYVaHlExYJmwb5_haKAJVbgz0eAXfSQrks7lDYA Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5761d3e4a69b484cbbab3858b6c760f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 5761d3e4a69b484cbbab3858b6c760f6 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-230885417 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3340b4fc5b564f709c822dc7f0ff99e1 Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerDiskConfigTestJSON-230885417-project Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '94d0ae86-1c3f-4747-b2a3-411e10f58fb0'} Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.206977 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] Returning 404 to user: Instance 94d0ae86-1c3f-4747-b2a3-411e10f58fb0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d93c00c9-5564-4264-9389-3db832b4976d tempest-ServerDiskConfigTestJSON-230885417 tempest-ServerDiskConfigTestJSON-230885417-project] 10.222.0.33 "GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0" status: 404 len: 111 microversion: 2.1 time: 0.035685 Oct 04 18:47:47.211675 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1950/6050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/94d0ae86-1c3f-4747-b2a3-411e10f58fb0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:57.182025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=19 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:57.183145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:57.354683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-32db8bef-127a-46fe-b13f-3b2d47991bbf tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: .version_select at 0x7f63419f29d0>, body: {"keypair": {"name": "tempest-keypair-1293913442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe9/cT7/ukw8vU49YpGnFEv1sIi3JI4QYO8HsGM3KRRYyiQaS8AH1VrdnYhig8A7/qXbw/GYEp5M0c+MAZnR5ESA18ZyDcpcwAzcod6/TFeZXwKsiOcC75NjgpDdDSocQ=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:57.378846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-32db8bef-127a-46fe-b13f-3b2d47991bbf tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:57.386660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-32db8bef-127a-46fe-b13f-3b2d47991bbf tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:57.435072 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-32db8bef-127a-46fe-b13f-3b2d47991bbf tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258574 Oct 04 18:47:57.435686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4101/6051] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:47:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:59.038138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2133572547", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d3587db-13fd-4567-b184-c491042dddf2"}], "security_groups": [{"name": "tempest-securitygroup--1610525623"}], "key_name": "tempest-keypair-1293913442", "user_data": "}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:59.048844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:59.049686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:59.192170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] validate_networks() for [('2d3587db-13fd-4567-b184-c491042dddf2', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:59.923438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:59.924298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:59.925280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:59.926074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:59.926869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:59.953949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.955458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.956495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.958002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.958913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.959807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.996695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:00.003903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:00.024208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:00.027141 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:00.103019 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e49f68b-a2c8-40b4-b557-24e495d5d5b2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.068686 Oct 04 18:48:00.115106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1951/6052] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:00.125255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-db624590-fee0-4e03-8d16-f8ac27a92dac tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.127213 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-db624590-fee0-4e03-8d16-f8ac27a92dac tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.222691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-db624590-fee0-4e03-8d16-f8ac27a92dac tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.237580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-db624590-fee0-4e03-8d16-f8ac27a92dac tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1239 microversion: 2.1 time: 0.119594 Oct 04 18:48:00.239745 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4102/6053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1239 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.271311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.272083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.291434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.292180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.292748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.293611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.294547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.294990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.375578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.385416 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c56873ce-801c-4c9e-864a-c7ff3ea25433 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1291 microversion: 2.1 time: 0.118822 Oct 04 18:48:01.399825 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1952/6054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1291 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.414080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.415329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.422714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.423561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.424269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.425286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.425856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.426388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.606661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.615593 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92fb3f80-80da-4aff-ae39-8028f6390b0f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.205930 Oct 04 18:48:02.616901 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4103/6055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.179698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:03.197669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.198918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.199506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.213726 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] Creating event network-changed:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h1-831193-17 Oct 04 18:48:03.220364 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-009c1a1b-7ffa-4de0-9cac-8c1add8b7fe0 req-d6f4c69b-efd6-4f2b-90e0-c7b183d52d5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044514 Oct 04 18:48:03.221133 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1953/6056] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:03.645019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.645881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.658477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.659117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.659637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.660619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.661424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.662014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.813257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.821381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d15f1c45-42e0-4112-a81c-7e1d67c28d0e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.180765 Oct 04 18:48:03.822236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4104/6057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.861737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.862486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.869114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.869635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.870109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.870945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.871342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.871829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.019100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.027414 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b80c9fc6-6211-4015-9873-87bbc39aa395 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.173804 Oct 04 18:48:05.027955 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1954/6058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:06.051468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.052522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.058997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.059642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.060431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.061623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.062440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.062966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.216711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:06.224896 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca35745f-241e-44d4-9678-12ecb7acec11 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.177417 Oct 04 18:48:06.225489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4105/6059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.248709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.249359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.260049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.260561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.261015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.261733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.262204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.263369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.402355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.410974 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-77b37bc5-920a-4bf3-9138-f355ec5f891f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.166488 Oct 04 18:48:07.411918 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1955/6060] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:08.437098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.437720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.445233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.445723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.446171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.446882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.447383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.447817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.594889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.602848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d5eae4a-ccf9-4de6-8d6a-ace4859f76ce tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.170530 Oct 04 18:48:08.603455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4106/6061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.046646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "name": "network-vif-plugged", "status": "completed", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:09.058198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.058695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.059268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.074504 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] Creating event network-vif-plugged:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h1-831193-17 Oct 04 18:48:09.080650 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-740f3b5b-a0da-4ba6-bcc4-0d8614deec6f req-f12cadfb-fb88-4322-bf22-66c996029211 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Oct 04 18:48:09.081341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1956/6062] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:09.627349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.628081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.635341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.635916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.636363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.637075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.637531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.637961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.785714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.794175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f305ad50-13fe-4a21-9d74-9ef38a6e4121 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1365 microversion: 2.1 time: 0.170179 Oct 04 18:48:09.794774 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4107/6063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:10.815070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:10.815898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:10.821177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:10.821962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:10.829998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.830504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.830963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.831724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.832196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.832637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.983482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:10.991464 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0ab4ae9b-3f71-4326-9f67-559869597019 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1551 microversion: 2.1 time: 0.177384 Oct 04 18:48:10.992048 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1957/6064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:11.015500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.016093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.017943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:11.024123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.024623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.025073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.025788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.026258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.026693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.111075 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-173bdf79-46b3-49fd-85a3-fda690bb427b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100230 Oct 04 18:48:11.111687 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4108/6065] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:12.455089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:12.467865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.468488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.469011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.481242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] Creating event network-changed:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h1-831193-17 Oct 04 18:48:12.487116 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-20d50731-78d3-4bf4-bc9b-d3519b479cde req-f57b5113-7474-43ba-a2b1-343de336c680 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035478 Oct 04 18:48:12.487759 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1958/6066] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:46.894033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:46.894878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=34 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:46.900206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:46.900820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:46.909413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.910087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.910529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.911272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.911735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.912162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.051439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.059159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-73bbf817-a54e-40d7-bef3-f08f6f853d8d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.167103 Oct 04 18:48:47.059749 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4109/6067] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:46 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.083432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.084088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.086517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:47.087410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:47.097621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.098125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.098576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.099321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.099792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.100230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.236974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.244964 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca810566-31a3-429f-81db-343bb18a059e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.166049 Oct 04 18:48:47.245556 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1959/6068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.268404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.269021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.275576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.276068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.276528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.277207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.277664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.278123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.416247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.424772 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd3597b8-637e-40c3-8c1f-23c8c31efeeb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.160401 Oct 04 18:48:47.425353 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4110/6069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.447151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:47.449537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.455614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.456116 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.456570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.457278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.457746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.458215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.487944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.493621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:48:47.500238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:47.500670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:47.501190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:47.501614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:47.502045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:47.566496 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a82d776a-90ec-4235-a84a-0819f4e31c98 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/action" status: 202 len: 0 microversion: 2.1 time: 0.123456 Oct 04 18:48:47.567146 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1960/6070] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:47 2022] POST /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:47.575800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.576420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.582599 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.583121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.583519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.584252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.584713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.585141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.736969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.745360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-aa8303f3-30fa-4f69-99c1-581cf313dd36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1678 microversion: 2.1 time: 0.173985 Oct 04 18:48:47.745968 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4111/6071] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:48.772712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.773238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.781997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.782478 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.782943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.783714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.784190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.784632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.940617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.949518 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-216bf03c-b157-474b-b665-1c6ce365a3be tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1678 microversion: 2.1 time: 0.182212 Oct 04 18:48:48.950380 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1961/6072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:49.973959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.974580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.983263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.983908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.984359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.985108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.985575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.986011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.126820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.134773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-430e3281-7ded-4ae1-96dc-e438785b788d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.164776 Oct 04 18:48:50.135383 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4112/6073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.158949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.159524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.166324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.166827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.167310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.168041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.168513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.168959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.299296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.307356 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-904696cc-4845-4b0f-97ad-a1e7383094df tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.152606 Oct 04 18:48:51.307928 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1962/6074] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.334891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.335683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.343682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.344184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.344628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.345370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.345834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.346268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.480071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.487780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6ee789de-8bd9-42cf-8f33-0c3389d7a740 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.158158 Oct 04 18:48:52.488358 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4113/6075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.510877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.512039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.519181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.519705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.520163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.520874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.521338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.521804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.657794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.666162 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-990b3301-d91d-4161-851b-db2d11b7c9b6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.159154 Oct 04 18:48:53.666670 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1963/6076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:54.690148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.691547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.698120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.698622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.699680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.700413 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.700881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.701320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.839005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.846757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-36fe750f-8c99-46e1-843f-e427b634d68e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.160597 Oct 04 18:48:54.847355 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4114/6077] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:55.870576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.871960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.878479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.878994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.879472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.880253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.880727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.881170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.026667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.035102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-81ae2bcc-dd54-440a-aee4-92306895fd6d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.168551 Oct 04 18:48:56.035704 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1964/6078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:57.059117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.059737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.066724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.067248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.067695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.068402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.068860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.069299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.205663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.213439 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bcfcfc5a-1392-4b9b-8675-7191d633296a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.158327 Oct 04 18:48:57.214014 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4115/6079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:58.237640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.238267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.245662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.246773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.247265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.247999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.248456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.248953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.398999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.408649 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-085cf580-34e4-46f4-86cb-559a42d661fc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.174918 Oct 04 18:48:58.409249 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1965/6080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:59.432837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.433969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.440852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.441341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.441785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.442482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.442943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.443409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.573600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.581382 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ca91f2d9-96af-4fb2-b921-08d24d3801e8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.152817 Oct 04 18:48:59.581957 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4116/6081] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.605186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.605793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.612736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.613233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.613680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.614444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.614911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.615381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.759357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.767603 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-24f93016-b797-4cf6-a1f1-713bc252a127 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.166298 Oct 04 18:49:00.768197 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1966/6082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.793556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.794175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.801143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.801632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.802074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.802772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.803266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.803698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.941139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.949334 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d71afe2-f60e-499c-b3c6-fe8ae39a23d8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.160291 Oct 04 18:49:01.949917 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4117/6083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.976392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.977071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.984757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.985249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.985695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.986398 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.986867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.987333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.142506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.150602 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8671d179-bf9f-4085-a765-0a330f411169 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.178128 Oct 04 18:49:03.151227 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1967/6084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:04.176111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.176683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.185117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.185647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.186087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.186801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.187287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.187812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.335181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:04.343487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8bf8bc2-aaf0-4c44-bd8e-a2a3b9adbfb4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.171824 Oct 04 18:49:04.344087 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4118/6085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.368511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.369135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.376031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.376524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.376971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.377671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.378134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.378571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.514818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.523652 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a509924-bcc6-43c5-a5f9-4d9236c16971 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1683 microversion: 2.1 time: 0.158955 Oct 04 18:49:05.524307 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1968/6086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.548407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.549025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.556196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.556692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.557132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.557838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.558300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.558760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.762604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.773268 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3e05e9a1-4bed-4283-9c84-60a783c0b84f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1682 microversion: 2.1 time: 0.228768 Oct 04 18:49:06.774058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4119/6087] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.776616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "name": "network-vif-unplugged", "status": "completed", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:06.788461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.789329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.790022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.802431 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Creating event network-vif-unplugged:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h2-831193-17 Oct 04 18:49:06.807938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:49:06.820097 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9cc2403e-fc87-467a-b4c2-8d10ba728cc3 req-bd64508b-f229-4165-af19-4ac19f755538 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048485 Oct 04 18:49:06.820379 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1969/6088] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:07.798311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.798971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.806067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.806577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.807056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.807788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.808834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.809394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.949235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.957007 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d4be0bbe-156c-45da-b345-76462fd6a3a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1682 microversion: 2.1 time: 0.162635 Oct 04 18:49:07.957588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4120/6089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.859081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:08.868714 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.869208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.869660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.882265 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Creating event network-changed:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h2-831193-17 Oct 04 18:49:08.888329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:49:08.899679 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-abf48416-1990-423a-b58b-78a7a09ca93e req-e04bfc5e-f66b-4b14-b367-4d2a18a1b02b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045698 Oct 04 18:49:08.900292 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1970/6090] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:08.981513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.982344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.989840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.990349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.990797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.991553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.992025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.992455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.168605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.178530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9692cdbb-4981-4dc2-aec8-6309c1a3ed07 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1680 microversion: 2.1 time: 0.200919 Oct 04 18:49:09.179463 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4121/6091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.206011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.206735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.213085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.213595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.214035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.215401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.215875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.216320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.358287 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.366270 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fbb8972a-300b-40bc-b2da-01a7fef59ab7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1677 microversion: 2.1 time: 0.165507 Oct 04 18:49:10.366859 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1971/6092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:10.390524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:10.391744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.398649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.399451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.399847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.400608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.401245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.401830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.484260 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-518d2a05-bc1b-4036-852f-9330a9f83853 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/action" status: 204 len: 0 microversion: 2.1 time: 0.098120 Oct 04 18:49:10.485439 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4122/6093] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:10 2022] POST /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6/action => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:49:10.493617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.494343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.501006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.501511 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.501964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.502716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.503395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.503852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.644115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.652090 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c638f3c-37c7-41db-8819-4e37e971bb82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1677 microversion: 2.1 time: 0.162377 Oct 04 18:49:10.652688 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1972/6094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.676805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.677702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.685374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.685910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.686429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.687229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.687728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.688169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.842846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.851812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-de4bbede-9da8-410f-a588-60f7ceea077e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1677 microversion: 2.1 time: 0.179459 Oct 04 18:49:11.852408 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4123/6095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.079656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "name": "network-vif-plugged", "status": "completed", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:12.090615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.091178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.091653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.104361 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] Creating event network-vif-plugged:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h2-831193-17 Oct 04 18:49:12.110328 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ccfa2a39-78e4-4694-a02c-8c7560393537 req-a3093ceb-575f-4e21-90c1-293b21a08921 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Oct 04 18:49:12.111309 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1973/6096] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:12.876246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.876875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.884059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.884550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.884992 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.885721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.886171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.887208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.903248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:13.029842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.038245 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-779524b5-52bd-45e3-82b9-14ab85976cc1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.165806 Oct 04 18:49:13.039056 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4124/6097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.062591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.063368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.070135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.070638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.071123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.071841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.072312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.072760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.209324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.217519 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1a2e6067-dfe1-4f3d-82fe-77fe3df04a40 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.159739 Oct 04 18:49:13.218104 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1974/6098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.240667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.241305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.248073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.248562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.249001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.249694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.250147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.250571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.387437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.395196 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4187711e-c677-4fab-bf7a-f08cd57874b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1669 microversion: 2.1 time: 0.158399 Oct 04 18:49:13.395812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4125/6099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.418974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.419439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.425793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.426300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.426752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.427506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.427970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.428459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.447726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:13.456302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:13.543942 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d9f0b9f-42d2-4b04-8f14-2be35e2d0f65 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 204 len: 0 microversion: 2.1 time: 0.128932 Oct 04 18:49:13.545102 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1975/6100] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:13 2022] DELETE /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:13.554836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.554836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.561754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.562248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.562714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.563472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.563928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.564351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.705849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.714519 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9dc066d-0b00-4315-a7aa-eb62ee2b97a7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1675 microversion: 2.1 time: 0.164523 Oct 04 18:49:13.715140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4126/6101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:14.739166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.740377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.748297 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.748789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.749242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.749961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.750434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.750878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.961521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.970063 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50545260-841f-4bf7-92d5-1c91a79bde5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 200 len: 1675 microversion: 2.1 time: 0.235137 Oct 04 18:49:14.970902 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1976/6102] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:15.773597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4a2234-e76d-45fb-9747-916ca0e44db6", "name": "network-vif-deleted", "tag": "54ee61e6-2bd6-416f-8783-02e9edce4ac1"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:15.787489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.788205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.789151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.807934 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] Creating event network-vif-deleted:54ee61e6-2bd6-416f-8783-02e9edce4ac1 for instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 on n-h2-831193-17 Oct 04 18:49:15.813538 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-63eab2af-22df-4a32-abad-8a0157358ce5 req-cb568612-a9d7-4f5e-a7bd-a8cbfa868913 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046386 Oct 04 18:49:15.818480 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4127/6103] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:15.996148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.997039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.004784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.005270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.005720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.006431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.007255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.008045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.035386 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 HTTP/1.1 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2f4a2234-e76d-45fb-9747-916ca0e44db6'} Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:16.038938 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:16.042908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4bdb7250-a9e3-482a-816c-d972b8f5a142 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 404 len: 111 microversion: 2.1 time: 0.050577 Oct 04 18:49:16.044641 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1977/6104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:16.062595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.063466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.071412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.072063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.072688 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.073581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.074756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.075610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.091867 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 HTTP/1.1 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2f4a2234-e76d-45fb-9747-916ca0e44db6'} Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:16.093575 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cde4807-7d12-4a38-b81b-572b72464220 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 404 len: 111 microversion: 2.1 time: 0.037656 Oct 04 18:49:16.097924 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4128/6105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:16.158399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2065638760", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2d3587db-13fd-4567-b184-c491042dddf2"}], "security_groups": [{"name": "tempest-securitygroup--1610525623"}], "key_name": "tempest-keypair-1293913442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:16.271589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] validate_networks() for [('2d3587db-13fd-4567-b184-c491042dddf2', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:16.674174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:16.674971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:16.675636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:16.676081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:16.676520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:16.688308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.689050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.689671 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.690607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.691506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.692282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.717578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:16.723500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:16.738353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:16.740838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:16.790374 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62170e8c-e127-418d-8f75-5b704c63b38d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.636030 Oct 04 18:49:16.791049 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1978/6106] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:16.803118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9e32faa4-2015-455b-91b4-d5dcc3727fa4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.803739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9e32faa4-2015-455b-91b4-d5dcc3727fa4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.867546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9e32faa4-2015-455b-91b4-d5dcc3727fa4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:16.883343 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9e32faa4-2015-455b-91b4-d5dcc3727fa4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1239 microversion: 2.1 time: 0.083777 Oct 04 18:49:16.885226 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4129/6107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:17.912728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:17.913614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:17.918767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:17.922235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.923121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.923580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.924574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.925049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.925560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.025708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:18.035832 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-69ef6a82-b428-4220-984b-9379c938d158 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1299 microversion: 2.1 time: 0.131566 Oct 04 18:49:18.036427 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1979/6108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:17 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.063473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.064800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.071763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=45 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:19.080449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.081038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.081797 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.083114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.083899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.084726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.263860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.274286 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6a55d99-ab19-4cfb-b6f4-24795be98552 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1365 microversion: 2.1 time: 0.218086 Oct 04 18:49:19.274995 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4130/6109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.503444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:19.514915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.515405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.515854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.529209 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] Creating event network-changed:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h1-831193-17 Oct 04 18:49:19.534366 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-19c842e4-30b3-461a-b4ed-76fbbf616611 req-c09e98e0-9136-4146-9c6f-785575ba6507 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035025 Oct 04 18:49:19.534974 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1980/6110] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:20.309443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.310051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.317234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.317730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.318173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.318879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.319400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.319835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.457850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.467789 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-626a5929-2a56-4476-9a5e-f02e0022bb34 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1365 microversion: 2.1 time: 0.162189 Oct 04 18:49:20.468382 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4131/6111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:21.502742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.503960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.512303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.512796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.513955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.515279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.515862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.516344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.672315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.680457 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9d885d3a-3fec-46ca-bc7c-551310b3fe2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1365 microversion: 2.1 time: 0.191677 Oct 04 18:49:21.681031 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1981/6112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.716527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.717158 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.724577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.725077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.725530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.726272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.726720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.727191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.871854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.882612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-edd1b8f0-b27d-4bb0-9c60-e151a4613d39 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1365 microversion: 2.1 time: 0.171939 Oct 04 18:49:22.883221 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4132/6113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.428557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "name": "network-vif-plugged", "status": "completed", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:23.442124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.443460 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.443939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.456368 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] Creating event network-vif-plugged:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h1-831193-17 Oct 04 18:49:23.461579 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-8ce94522-78b7-4632-97da-3f7822280151 req-64297f5f-6066-4e81-a91c-6d5d03ff2dec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037196 Oct 04 18:49:23.462631 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1982/6114] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:23.905779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.906391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.914303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.914807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.915285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.916137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.916595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.917026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.056939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.064925 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cda869f3-61d4-45e2-a19c-15743e832adb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1365 microversion: 2.1 time: 0.163609 Oct 04 18:49:24.065512 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4133/6115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.090009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.090652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.097153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.097660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.098120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.098852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.099359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.099869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.244744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.253446 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-13105fce-f38d-4aa3-8cc2-4174ff6b63ed tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1551 microversion: 2.1 time: 0.168213 Oct 04 18:49:25.254017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1983/6116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.280105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.280672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.287888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.288378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.288811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.289515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.289966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.290393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.371610 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51348aad-4fed-480b-a532-32929a6d148d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094917 Oct 04 18:49:25.372240 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4134/6117] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:26.351910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:26.362387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.362886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.366467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.378080 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] Creating event network-changed:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h1-831193-17 Oct 04 18:49:26.383237 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-96377e2a-9179-48c8-86e6-4808662f907c req-e940f181-51bd-4240-a549-647364f49c8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034969 Oct 04 18:49:26.384053 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1984/6118] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:01.320485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.321436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=9 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.322249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=47 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.326480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:01.333997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.334497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.334940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.361115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Going to try to stop instance {{(pid=128770) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:50:01.405232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8959c3ec-ea76-489b-a5c3-400f0946effb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action" status: 202 len: 0 microversion: 2.1 time: 0.086170 Oct 04 18:50:01.405878 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4135/6119] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:01 2022] POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:01.412548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.413352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.415468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=11 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.416197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.422132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:01.422953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:01.431982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.432504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.432961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.433689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.434206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.434774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.588158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:01.596941 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cf59c37f-8f9c-4b8b-ba7a-68dc30ea3450 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.185314 Oct 04 18:50:01.597538 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1985/6120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:01 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:02.621565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.622317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:02.629816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.630308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.630748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.631559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.632017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.632454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.769286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.777153 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c969871-d191-4d2a-9ca4-3ed7522a1384 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.160621 Oct 04 18:50:02.777730 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4136/6121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:02 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:03.801723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.802286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.809164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.810220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.810674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.811413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.811885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.812326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.956456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:03.964309 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e1b826fe-076f-4837-b3a4-71abe4cdbfa8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.166621 Oct 04 18:50:03.964904 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1986/6122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:04.987398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.988016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.994883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.995402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.995851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.996548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.997619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.998052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.126779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.134832 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d7e7c7cf-9426-4c90-bc89-7667a927a94d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.151391 Oct 04 18:50:05.135448 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4137/6123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:06.157895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:06.158446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:06.165543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.166044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.166494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.167240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.167721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.168166 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.310200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:06.317970 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a7a61e7-03ad-4b94-bff5-9334c1345494 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.164364 Oct 04 18:50:06.318545 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1987/6124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:06 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:07.344463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:07.345084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.352675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.353169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.353611 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.354313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.354775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.355242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.490069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.498044 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-452a7656-0655-4c28-96c7-3f37f0428585 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.158211 Oct 04 18:50:07.498635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4138/6125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:07 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:08.522920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.523954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.529954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.530453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.530910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.531651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.532381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.532824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.663421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.671910 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6ca338f-6ef1-478e-9d8c-0701364f70b3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.154248 Oct 04 18:50:08.672512 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1988/6126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.696519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.697201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.704784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.705212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.705648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.706343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.706799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.707265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.843573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.851414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9da59a7-e10b-4d95-a345-eca06397c958 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.158847 Oct 04 18:50:09.851985 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4139/6127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:10.874971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.875632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.882466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.882959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.883444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.884142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.884611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.885055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.016627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.024847 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a9a31137-8785-4fe5-95a3-5b58417b7a9f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.153763 Oct 04 18:50:11.025412 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1989/6128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.049895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.050561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.057557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.058041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.058479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.059215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.059699 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.060216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.192637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:12.201311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-187593b9-bdba-411e-aec0-4cdce0123f7b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.155307 Oct 04 18:50:12.201896 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4140/6129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:13.225039 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.225669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.234619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.235321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.235790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.237041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.237589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.238379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.380072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.395705 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f2cedfa5-0772-4a29-803b-4897ca08c8a6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.174515 Oct 04 18:50:13.396302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1990/6130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:14.420630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.421453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.428437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.428917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.429347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.430043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.430497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.430918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.578425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.586541 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0effa2d-beb5-4c53-982d-a427dae4ddb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.169967 Oct 04 18:50:14.587156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4141/6131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.609892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.610516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.617481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.617982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.618438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.619185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.619687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.620103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.753864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.761878 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-77f1bb5d-423c-4c4b-b5d3-bcd1625c8c26 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.155904 Oct 04 18:50:15.763074 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1991/6132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:16.786231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.786850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.794138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.794630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.795097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.795881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.796281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.796736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.931105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.939178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1a829e2a-8827-450a-8460-05db02dc069a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1656 microversion: 2.1 time: 0.157060 Oct 04 18:50:16.939766 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4142/6133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:16.962672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:16.965212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.973029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.973530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.973985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.974704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.975212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.975651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.010908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.019921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:50:17.026631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:17.027165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:17.027657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:17.028680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:17.029107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:17.094272 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c4138165-9a14-45f0-bb3b-32dfc366a357 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action" status: 202 len: 0 microversion: 2.1 time: 0.135522 Oct 04 18:50:17.094900 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1992/6134] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:16 2022] POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:17.103476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.104127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.110068 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.110564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.111013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.111742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.112209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.112643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.257606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.265743 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b50262bf-4cb5-4591-81af-534e36286688 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.166607 Oct 04 18:50:17.266386 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4143/6135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.289921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.290483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.297985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.298489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.298945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.299682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.300155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.300599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.435122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.448625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82d88f46-3089-4d0f-be70-de6c97efe98f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1679 microversion: 2.1 time: 0.163550 Oct 04 18:50:18.449255 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1993/6136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.472828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.473482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.481312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.481802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.482253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.483565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.483565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.483879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.629543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.644612 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75d93311-0c26-4ae5-97b3-e6848bf5930a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1684 microversion: 2.1 time: 0.175546 Oct 04 18:50:19.645247 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4144/6137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.670103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.670663 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.677857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.678396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.678847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.679599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.680133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.680538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.825025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.834134 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-36f86f1e-2eeb-4b0b-abe8-bcd9d4259cef tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1684 microversion: 2.1 time: 0.168631 Oct 04 18:50:20.834684 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1994/6138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.345892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "name": "network-vif-unplugged", "status": "completed", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:21.355985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.356473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.356914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.372475 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Creating event network-vif-unplugged:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h2-831193-17 Oct 04 18:50:21.378414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:21.390940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-92d78617-f3cd-4402-aff6-21a76aae356b req-85e2ab76-e0b0-4a13-be00-6c77f9b3e46a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048903 Oct 04 18:50:21.392574 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4145/6139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:21.862101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.863118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.873967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.874482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.874932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.875880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.876545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.877183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.097406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.105376 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d8d11a06-91e7-414c-a7ce-b594e7581f8e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1683 microversion: 2.1 time: 0.249740 Oct 04 18:50:22.106685 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1995/6140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:23.132221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.132836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.140328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.140820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.141257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.141955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.142412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.142841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.277700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.285853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e4cde26-a5e9-45fe-b84a-e4c6fed24732 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1681 microversion: 2.1 time: 0.158157 Oct 04 18:50:23.286430 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4146/6141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:23.434761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:23.447602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.448094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.448545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.461055 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Creating event network-changed:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h2-831193-17 Oct 04 18:50:23.471614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:23.485544 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e64fc80e-a885-4d7a-a3c8-e17f700dac60 req-97d6efc4-6573-46a8-852a-91cc41ebd939 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055001 Oct 04 18:50:23.486165 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1996/6142] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:24.312308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.313602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.325168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.325821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.326361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.327863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.329211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.329723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.553862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.561801 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6a7971b6-31ab-4314-ace2-0679b2360cf9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1677 microversion: 2.1 time: 0.255482 Oct 04 18:50:24.562436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4147/6143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.587432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:24.588077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.595787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.596291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.596745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.597453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.597918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.598470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.659559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c397dd0e-b4a8-4c80-83ef-00e609d26794 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action" status: 204 len: 0 microversion: 2.1 time: 0.077295 Oct 04 18:50:24.660667 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1997/6144] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:24 2022] POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:24.672251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.672577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.680184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.681047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.681773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.683086 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.683774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.685642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.849071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.857135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-33542a0c-9d82-458c-9eb2-ddc1319fef36 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1677 microversion: 2.1 time: 0.190093 Oct 04 18:50:24.857731 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4148/6145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.882783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.883645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.890369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.890899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.891453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.892176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.892651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.893094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.047545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.055402 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6692479-ae81-4efa-b9b3-9b3a72918a45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1656 microversion: 2.1 time: 0.177860 Oct 04 18:50:26.055994 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1998/6146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1656 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.081167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.081965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.088852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.089355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.089804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.091072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.091544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.091980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.230237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.238928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-51093402-c6b9-4333-8b82-151432af420c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1656 microversion: 2.1 time: 0.161811 Oct 04 18:50:26.239663 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4149/6147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.262224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:26.268514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.269021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.269483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.320642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:26.334070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Going to try to start instance {{(pid=128771) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:50:26.380997 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8731f5eb-b108-4685-9ca6-383d137c1d05 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action" status: 202 len: 0 microversion: 2.1 time: 0.122619 Oct 04 18:50:26.381615 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 1999/6148] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:26 2022] POST /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:26.392148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.393033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.400407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.400988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.402163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.404221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.404698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.405143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.434319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "name": "network-vif-plugged", "status": "completed", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:26.450254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.451615 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.452341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.470503 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] Creating event network-vif-plugged:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h2-831193-17 Oct 04 18:50:26.477095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ebbf5b0e-732c-4172-9a62-c0bb0b3b64f3 req-81b644b3-6408-4bda-aa79-133260432ba1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052375 Oct 04 18:50:26.478383 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2000/6149] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:26.650212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.654463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:26.660300 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f30df780-16a6-4b40-ba9b-373da8332b17 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1665 microversion: 2.1 time: 0.272886 Oct 04 18:50:26.660892 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4150/6150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1665 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.685624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.686247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.692725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.693223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.693672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.694386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.694849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.695331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.851047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.859766 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4420fd72-00d8-4e68-94e3-02507e453b9b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1669 microversion: 2.1 time: 0.179306 Oct 04 18:50:27.860354 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2001/6151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.885451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.886312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.896071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.896651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.897129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.897847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.898310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.898745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.928568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:28.020563 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d7f913e-6326-4f3b-b231-20c03cbe2eb1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 204 len: 0 microversion: 2.1 time: 0.140447 Oct 04 18:50:28.021862 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4151/6152] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:27 2022] DELETE /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:28.031340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.031976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.038597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.038998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.039477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.040199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.040676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.041117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.182435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.190579 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-98f724b7-1c8f-4cf5-b8c3-55932e6d03cb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1675 microversion: 2.1 time: 0.163680 Oct 04 18:50:28.191263 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2002/6153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:29.216721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:29.217418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.224151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.224637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.225077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.225773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.226223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.226646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.399266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.408530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b43cdb98-6ea9-40f8-a4b9-bea130a1a119 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 200 len: 1675 microversion: 2.1 time: 0.196788 Oct 04 18:50:29.410326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4152/6154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:29 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:30.204053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51d3a6e-1fd5-4074-ba7d-e07d642f47a0", "name": "network-vif-deleted", "tag": "62ed6ffa-243e-4833-a2d0-398d0ff1daac"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:30.211390 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:50:30.211592 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 18:50:30.217066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.217559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.218011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.230197 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] Creating event network-vif-deleted:62ed6ffa-243e-4833-a2d0-398d0ff1daac for instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 on n-h2-831193-17 Oct 04 18:50:30.235128 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f61e306d-58bb-48a0-baa1-40c8e1e27d17 req-e155812f-50d1-4d26-be58-e6d890180911 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Oct 04 18:50:30.238764 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2003/6155] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:30.434848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.435667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.444215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.444714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.445225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.445932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.446393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.446819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.462094 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 HTTP/1.1 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b51d3a6e-1fd5-4074-ba7d-e07d642f47a0'} Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.463813 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-276f055d-4960-4ba4-9f94-cb83d9b2180d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 404 len: 111 microversion: 2.1 time: 0.036226 Oct 04 18:50:30.472147 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4153/6156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:30.485020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.486249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.497979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.498921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.500036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.501318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.502164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.502931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.527350 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 HTTP/1.1 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'b51d3a6e-1fd5-4074-ba7d-e07d642f47a0'} Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.529711 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ae8516d-f7c1-4210-9388-cc5242fb693b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 404 len: 111 microversion: 2.1 time: 0.053674 Oct 04 18:50:30.537784 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2004/6157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:30.594296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2045582055", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2d3587db-13fd-4567-b184-c491042dddf2"}], "security_groups": [{"name": "tempest-securitygroup--1610525623"}], "key_name": "tempest-keypair-1293913442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:30.714989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] validate_networks() for [('2d3587db-13fd-4567-b184-c491042dddf2', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:31.237365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:31.237858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:31.238337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:31.238749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:31.239216 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:31.252363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.252977 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.253284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.254188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.254659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.255260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.286634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:31.294453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:31.307967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:31.310924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:31.338976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:31.362624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae0297fe-23fa-4b73-967a-7a2c9d84119b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772883 Oct 04 18:50:31.363846 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4154/6158] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:50:31.379760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c55d7583-4d30-4615-8974-e195a2b2b721 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:31.381099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c55d7583-4d30-4615-8974-e195a2b2b721 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.440278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c55d7583-4d30-4615-8974-e195a2b2b721 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.453278 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c55d7583-4d30-4615-8974-e195a2b2b721 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1239 microversion: 2.1 time: 0.081121 Oct 04 18:50:31.464963 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2005/6159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:31 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.478205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.478821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.487115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.487920 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.488922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.491117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.491823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.492385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.588744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.601035 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2581e814-d97a-41ce-9001-2ffae38426f1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1309 microversion: 2.1 time: 0.126299 Oct 04 18:50:32.602090 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4155/6160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:33.628381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.629317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.632454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=49 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:33.638756 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.639306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.639772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.640536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.641018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.641490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.893593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:33.901765 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8339f76f-970e-4a40-b818-e6b2a9a470bb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1365 microversion: 2.1 time: 0.278308 Oct 04 18:50:33.902357 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2006/6161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:34.109907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:34.129428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.130021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.131238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.144861 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] Creating event network-changed:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:50:34.150249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e12bea44-f3a8-405f-945c-9024e37bbe7f req-4bd7e336-9853-4702-a279-8c274cc8b12e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046876 Oct 04 18:50:34.151654 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4156/6162] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:34.927476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:34.928100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:34.935816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.936309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.936759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.937521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.938226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.938924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.079808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.088201 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2d699db-38c9-412d-89ce-de1f15369815 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1365 microversion: 2.1 time: 0.164565 Oct 04 18:50:35.088777 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2007/6163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:34 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.113639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:36.114983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:36.122814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.123341 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.123792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.125044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.125044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.126220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.263948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.271902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d5f10e26-ea37-46c5-839e-808f77f7b7c1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1365 microversion: 2.1 time: 0.162642 Oct 04 18:50:36.272489 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4157/6164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:36 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:37.296078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.296910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.303885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.304384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.304841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.305560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.306033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.306475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.439247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:37.447158 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a82b8440-4ee6-4e36-9ae9-04cafec10b6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1365 microversion: 2.1 time: 0.154942 Oct 04 18:50:37.447755 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2008/6165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:38.463169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-plugged", "status": "completed", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:38.472767 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.473497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.476918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.477936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.478483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.483395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.483935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.484910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.485646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.486122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.486570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.490465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] Creating event network-vif-plugged:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:50:38.496375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-cf38b6e3-9477-48c1-b42a-f0a5d710ec07 req-99e7caab-1d6a-4d6b-8d56-84513a438527 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036865 Oct 04 18:50:38.497003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4158/6166] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:38.687134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.695002 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-237883aa-6d9c-409c-85e2-029ca1c0e054 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1365 microversion: 2.1 time: 0.226960 Oct 04 18:50:38.695625 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2009/6167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:39.719819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.720859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.728558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.728968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.729414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.730325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.731447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.731912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.893819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.902162 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-902f81db-b78e-4ab2-b5a1-4d0c2100e9f9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1552 microversion: 2.1 time: 0.187049 Oct 04 18:50:39.915450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4159/6168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:39.926757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.927596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.935351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.935854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.936312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.937031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.937493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.938081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.040135 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3cd7c917-9a98-48b7-ba81-18707db67001 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117101 Oct 04 18:50:40.040489 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2010/6169] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:41.078717 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:41.089359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.089919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.090926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.102666 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] Creating event network-changed:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:50:41.108432 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-465fb907-b96a-46b4-b198-cff488fa3852 req-ef35b024-31fb-4364-bac9-b94ba79f7a7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Oct 04 18:50:41.109148 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4160/6170] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:15.947732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:15.948642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=9 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:15.950642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:15.961223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:15.963473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:15.971193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.971690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.972169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:15.972870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.973335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.973773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.006595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.012567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:51:16.019727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:16.020162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:16.020651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:16.021073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:16.021495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:16.090749 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-be0066bc-d5ba-4758-af10-a2a0bc62a2c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/action" status: 202 len: 0 microversion: 2.1 time: 0.144754 Oct 04 18:51:16.091577 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2011/6171] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:15 2022] POST /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:16.097217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:16.098215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:16.101043 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:16.101756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:16.107588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:16.108316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:16.117520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.118054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.118532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.119255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.119722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.120165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.329223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.337580 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0cfea739-a920-4787-aba8-69f16a5b9018 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1679 microversion: 2.1 time: 0.241412 Oct 04 18:51:16.338179 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4161/6172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:16 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.362928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.363983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.370676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.371263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.372900 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.373158 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.373637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.374097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.586532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.594992 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f741e610-ef44-48b7-99ac-04b8b6e5617d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1679 microversion: 2.1 time: 0.237167 Oct 04 18:51:17.595601 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2012/6173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.619719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.620339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.628150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.628625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.629072 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.629778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.630236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.630668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.772482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.780400 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bdd4369a-006e-4000-9b90-bc77bffe7912 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.164815 Oct 04 18:51:18.781001 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4162/6174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:19.805129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.805684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.812610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.813104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.813552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.814253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.814723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.815204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.947463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.955372 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d06ff27a-ed64-446d-9705-288e886e0166 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.154263 Oct 04 18:51:19.955956 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2013/6175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.979561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.980175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.987641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.988130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.988605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.989304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.989794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.990245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.144026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.152056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0e91a5d-d93a-4f5a-8132-53775c4c1bd0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.176431 Oct 04 18:51:21.152646 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4163/6176] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:22.177405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.177970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.185543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.186048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.186515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.187266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.187743 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.188190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.328343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.336307 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f0d21f1d-d42f-40e4-9287-b39c050c0624 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.162887 Oct 04 18:51:22.336878 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2014/6177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:23.360343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.361254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.368127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.368618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.369055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.369767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.370224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.370651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.517541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.526289 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a8e3cf63-2395-4734-be08-5359ae8e4323 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.169986 Oct 04 18:51:23.526889 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4164/6178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.551231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.551872 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.558329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.558842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.559324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.560055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.560526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.560968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.697084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.706176 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94542268-4a66-4f66-92cd-ead0b3e7aa97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.159120 Oct 04 18:51:24.706757 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2015/6179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:25.730625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.731985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.739004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.739638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.740089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.740805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.741301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.741728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.876863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.885284 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af3d16bc-ea76-487b-b682-7aca7221bff8 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.158647 Oct 04 18:51:25.886150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4165/6180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:26.910839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.911806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.920064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.920660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.921164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.921882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.922400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.922844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.062169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.070102 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6e236cac-a7f8-4fbf-97c7-31a06885eff5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.163995 Oct 04 18:51:27.070707 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2016/6181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:28.098035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:28.098573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.105877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.107136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.107588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.108307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.109049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.109481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.249059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.257178 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-68d8ceb5-f08e-46db-b296-1b55cedc61dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.163150 Oct 04 18:51:28.257763 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4166/6182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:28 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.282238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.283156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.290449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.290951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.291452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.292157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.292672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.293066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.433833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.441848 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8fd4490-8921-4f84-8f44-421edf1bc885 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.164525 Oct 04 18:51:29.442414 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2017/6183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.467153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.467880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:30.477159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.477800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.478381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.479329 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.479905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.480598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.622001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.629839 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-419306d7-9614-461f-a2a4-87415f27e78b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.167777 Oct 04 18:51:30.630450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4167/6184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:30 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:31.654023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.654962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.662087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.662610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.663095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.663831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.664311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.664811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.812543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.820915 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b7990682-8b48-4894-8da8-c9bd01615a6f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.170780 Oct 04 18:51:31.823000 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2018/6185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:32.844353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.844973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.851978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.852459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.852905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.853613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.854078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.854518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.992449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.001014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9ddc2788-7d07-40ea-87a1-6cab85a3dcf7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.160636 Oct 04 18:51:33.001585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4168/6186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.024805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.025426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.032273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.033053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.033497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.034197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.034669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.035149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.168143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.175860 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-098b8d65-53b8-4eb9-80f3-ba41d8b5b68a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1684 microversion: 2.1 time: 0.154993 Oct 04 18:51:34.176430 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2019/6187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:35.200735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.202732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.211759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.212587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.213065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.214844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.215354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.216182 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.451607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:35.460489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e88fe08b-6143-4b6e-8a53-28eb170214dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1683 microversion: 2.1 time: 0.265234 Oct 04 18:51:35.470577 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4169/6188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1683 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:35.766786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-unplugged", "status": "completed", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:35.781495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.782270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.782989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.796730 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Creating event network-vif-unplugged:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h1-831193-17 Oct 04 18:51:35.803394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] Instance a979160d-2223-4686-9c4b-ea74d278257a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:35.814853 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b802a6d7-382b-4a0c-9d04-25b0263e35fe req-5d59ee21-5a3d-4032-be3a-78576582246e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051815 Oct 04 18:51:35.815815 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2020/6189] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:36.485011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:36.485783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:36.493330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.493749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.494195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.494928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.495720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.496160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.637606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.646169 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0c94b376-d439-4b62-b2cf-beedb3bce1c3 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1683 microversion: 2.1 time: 0.165140 Oct 04 18:51:36.646772 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4170/6190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:36 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.672620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.673339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.679662 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.680168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.680621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.681329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.681800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.682241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.833023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:37.846142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.846689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.847164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.861303 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Creating event network-changed:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h1-831193-17 Oct 04 18:51:37.867695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] Instance a979160d-2223-4686-9c4b-ea74d278257a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:37.879873 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2a312023-a5f5-4dd3-bc57-1c722838b5ac req-4733977e-405f-48bc-98ff-4f6d753117f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050865 Oct 04 18:51:37.880655 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4171/6191] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:38.164650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.181231 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2553d25e-7b92-4c45-9ed9-204cd25866b5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1681 microversion: 2.1 time: 0.513932 Oct 04 18:51:38.182626 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2021/6192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1681 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:39.212792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.213665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.220478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.220967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.221408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.222105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.222561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.222988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.372535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.381084 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1cd36653-f91c-4828-ad92-7f3f0956326f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1678 microversion: 2.1 time: 0.174541 Oct 04 18:51:39.381721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4172/6193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:39.406770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:39.407372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.414814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.415372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.415827 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.416568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.417046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.417493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.460456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.460972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.461443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.462205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.462680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.463211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.486111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:39.491444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:39.617379 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-27ebc5a1-294f-4e84-8c7a-e3c436fc6a82 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/action" status: 202 len: 0 microversion: 2.1 time: 0.214859 Oct 04 18:51:39.618343 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2022/6194] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:39 2022] POST /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:39.631166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.632260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.642702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.643424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.644198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.645092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.645788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.646394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.834643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.844912 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e6a245a5-b76b-421f-9b2d-f54032cfe125 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.220169 Oct 04 18:51:39.854634 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4173/6195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:40.886789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.887229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.903183 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.903771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.904275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.905901 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.906457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.907095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.929625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:41.054560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:41.063330 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc9bd4c6-bc5f-4d3c-8234-31b8f375984b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.181935 Oct 04 18:51:41.063923 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2023/6196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:42.087970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.088608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.097838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.098985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.099668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.100430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.101063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.101653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.200625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-plugged", "status": "completed", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:42.211679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.212557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.213229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.229000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Creating event network-vif-plugged:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h1-831193-17 Oct 04 18:51:42.236751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] Instance a979160d-2223-4686-9c4b-ea74d278257a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:42.248593 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-45f7174f-9592-4820-81e3-7ed821821665 req-c40261d5-d530-4a03-bb31-c6e90b150048 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051397 Oct 04 18:51:42.249564 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2024/6197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:42.259784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.271582 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-439cd566-5af3-4336-ad74-f5a6dc0add37 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.187766 Oct 04 18:51:42.272284 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4174/6198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:42 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.297656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.298443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.304712 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.305214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.305665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.306409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.306878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.307359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.512174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:43.520348 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e5c26918-c4d8-4952-9b29-c5459c9a12f0 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.227748 Oct 04 18:51:43.520968 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2025/6199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.854235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-unplugged", "status": "completed", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:43.867326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.867883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.868316 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.884350 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Creating event network-vif-unplugged:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:51:43.889904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] Instance a979160d-2223-4686-9c4b-ea74d278257a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:43.900710 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-6924bf0e-2b2a-44fa-ba29-fcf7a5a15c9f req-eb5caa94-fd4b-41eb-9a87-26d57af1338c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110182 Oct 04 18:51:43.901335 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4175/6200] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:44.544037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.544674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.552222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.552733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.553192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.553921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.554396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.554843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.787372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:44.795166 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dec15161-765c-4d1a-a00c-f92c308f554e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.255054 Oct 04 18:51:44.795752 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2026/6201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:45.820972 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:45.821671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.828557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.829045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.829480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.830172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.830629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.831070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.923395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:45.934270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.934876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.935426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.950541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Creating event network-changed:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:51:45.959908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] Instance a979160d-2223-4686-9c4b-ea74d278257a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:45.970616 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-cc687d98-015d-47a9-bc78-f7efc7a74621 req-cc75e27b-687a-4854-834f-a7b05a985cba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050981 Oct 04 18:51:45.971294 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2027/6202] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:45.975858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:45.984285 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5876f0c-6342-4a73-8909-c845bc5c8950 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1677 microversion: 2.1 time: 0.168336 Oct 04 18:51:45.995432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4176/6203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:45 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:47.009716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.010518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.012583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:47.018108 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.018687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.019173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.019898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.020369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.020808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.157254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.165603 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-29e0aa14-8b08-4c6a-96de-238d6f63a19e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1670 microversion: 2.1 time: 0.161021 Oct 04 18:51:47.166202 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2028/6204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:47.188116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.188750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.191595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:47.197902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.198766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.199257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.199980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.200452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.200899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.206575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=93 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:47.343968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.351723 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2214623-8331-466c-a25b-1216415b0a61 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1670 microversion: 2.1 time: 0.167496 Oct 04 18:51:47.352305 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4177/6205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:47.374036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.374667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.380800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.381339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.381800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.382512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.382986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.383475 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.512731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.521191 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b6e28c57-22ec-45c6-8f0a-d9f20db6db0c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1670 microversion: 2.1 time: 0.151014 Oct 04 18:51:47.521772 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2029/6206] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:47.544897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.545448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.551536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.552035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.552483 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.553186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.553652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.554085 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.580432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:47.655535 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ec97d785-4348-4365-a7f6-f5e209004c3b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 204 len: 0 microversion: 2.1 time: 0.114121 Oct 04 18:51:47.656231 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4178/6207] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:47 2022] DELETE /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:47.666185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.666822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.673077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.673583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.674044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.674754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.675265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.675720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.814729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.823208 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41835335-37f0-4403-95a1-7a76d687e1dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1676 microversion: 2.1 time: 0.161273 Oct 04 18:51:47.823794 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2030/6208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:48.848730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:48.849633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:48.856940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.857529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.858037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.858833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.859537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.860043 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.879025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-plugged", "status": "completed", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:48.890668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.891396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.892024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.903059 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] Creating event network-vif-plugged:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:51:48.911442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3d0fbac2-c27d-4026-85ff-ad358509ee44 req-f6e21054-9c68-428e-862e-0882657b1bef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092844 Oct 04 18:51:48.912058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4179/6209] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:49.060010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.067987 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22c8d4c3-f475-451f-b431-d7c2595b3465 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1676 microversion: 2.1 time: 0.223888 Oct 04 18:51:49.068570 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2031/6210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:48 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:49.809091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a979160d-2223-4686-9c4b-ea74d278257a", "name": "network-vif-deleted", "tag": "668e95d6-12f2-4c7b-90a2-e177aca9f48e"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:49.830906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.831748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.832380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.845118 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] Creating event network-vif-deleted:668e95d6-12f2-4c7b-90a2-e177aca9f48e for instance a979160d-2223-4686-9c4b-ea74d278257a on n-h2-831193-17 Oct 04 18:51:49.850340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-988ea750-566e-48fb-9bf6-9a2082bfa8f5 req-65b32a80-8bed-4942-9d66-2fefe8502c76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045936 Oct 04 18:51:49.851064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4180/6211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:50.092491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:50.093821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:50.095818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:50.102220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.102770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.103250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.103972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.104436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.104873 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.135979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.136388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.136838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.137296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lazy-loading 'fault' on Instance uuid a979160d-2223-4686-9c4b-ea74d278257a {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:50.180910 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.189330 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a7d8c2b-2ad7-4c01-a2c7-410f672cb71a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 200 len: 1329 microversion: 2.1 time: 0.100731 Oct 04 18:51:50.189919 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2032/6212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:50 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:51.214240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.214970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.221365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.221856 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.222298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.222988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.223473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.223904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.237155 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a HTTP/1.1 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a979160d-2223-4686-9c4b-ea74d278257a'} Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:51.239151 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7d41f7e-4b95-4556-82d9-8d89312d7da2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 404 len: 111 microversion: 2.1 time: 0.031418 Oct 04 18:51:51.244064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4181/6213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:51.257250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.257882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.264623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.265725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.266177 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.266889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.267394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.267841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.281129 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a HTTP/1.1 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a979160d-2223-4686-9c4b-ea74d278257a'} Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:51.282812 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f7e38232-be21-434c-9be2-a1a316198913 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 404 len: 111 microversion: 2.1 time: 0.031319 Oct 04 18:51:51.287357 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2033/6214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:51.333358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1209707741", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "2d3587db-13fd-4567-b184-c491042dddf2"}], "security_groups": [{"name": "tempest-securitygroup--1610525623"}], "key_name": "tempest-keypair-1293913442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:51.437931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] validate_networks() for [('2d3587db-13fd-4567-b184-c491042dddf2', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:51.815767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:51.816205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:51.816689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:51.817110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:51.817533 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:51.826494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.826989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.827466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.828208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.828672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.829106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.845900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:51.851828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:51.864714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:51.867051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:51.921802 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-927609f7-e631-44f7-b2d5-e9b5e7b0e55a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.592173 Oct 04 18:51:51.929586 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4182/6215] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:51.934530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-47f2da7b-f20f-441b-99bf-e438445bc771 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.935240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-47f2da7b-f20f-441b-99bf-e438445bc771 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.999161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-47f2da7b-f20f-441b-99bf-e438445bc771 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.006388 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-47f2da7b-f20f-441b-99bf-e438445bc771 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1239 microversion: 2.1 time: 0.076112 Oct 04 18:51:52.007182 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2034/6216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:53.030522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.031208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.037792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.038285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.038795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.039528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.039990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.040421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.418057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:53.427903 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-954a5d91-03ba-428f-a1f7-2e8c0f0c7118 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1297 microversion: 2.1 time: 0.402026 Oct 04 18:51:53.429109 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4183/6217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:53 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1297 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:54.457804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:54.458466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:54.464810 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.465319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.465774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.466483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.466952 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.467999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.689304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:54.704097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.704591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.705366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.717295 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] Creating event network-changed:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:51:54.724826 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ea559b76-e856-42dc-ac0b-a56488066eef req-9d5d238b-aaaa-4a32-8be4-fbda93ebedfc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038380 Oct 04 18:51:54.725475 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4184/6218] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:54.778710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.787616 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3d8357d6-9a5a-4c8e-9f21-e5a34ac50c06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1365 microversion: 2.1 time: 0.336187 Oct 04 18:51:54.788196 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2035/6219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:54 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:55.812462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.813081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.820273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.820764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.821205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.822090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.822354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.822779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.036208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.043998 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e7813e14-67cc-4cd3-8d67-62ac6e7766c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1365 microversion: 2.1 time: 0.235872 Oct 04 18:51:56.044813 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4185/6220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:57.068191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.068718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.075647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.076278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.076600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.077816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.078288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.078735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.210574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.218819 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-09188e09-e5be-41f2-9bc7-ae103783e868 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1365 microversion: 2.1 time: 0.154784 Oct 04 18:51:57.219553 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2036/6221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:57 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:58.244868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:58.245488 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.252446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.252940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.253386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.254130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.254590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.255023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.388750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.396868 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9bf36fe0-f746-4be4-a4af-268702fd4df4 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1365 microversion: 2.1 time: 0.156054 Oct 04 18:51:58.397439 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4186/6222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:58 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:58.882564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-plugged", "status": "completed", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:58.893458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.893958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.894413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.905896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] Creating event network-vif-plugged:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:51:58.911272 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-4f815b56-2f0a-4768-90b5-29f92520773b req-1c167144-a3df-4de9-b9a6-084fbb8c288c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Oct 04 18:51:58.911954 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2037/6223] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:59.420923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:59.421503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:59.428785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.429269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.429706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.430398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.430857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.431308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.564906 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:59.572838 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12267621-610e-494a-bed6-6dcee14fcd9d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1365 microversion: 2.1 time: 0.156416 Oct 04 18:51:59.573404 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4187/6224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:59 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:00.597731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:00.598448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:00.604667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.605169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.605622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.606327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.606798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.607269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.740965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.749297 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5561822a-40b3-46bc-8a8d-8fe107f2627d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1552 microversion: 2.1 time: 0.156257 Oct 04 18:52:00.749879 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2038/6225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:00 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:00.771936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:00.772473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:00.779231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.779719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.780219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.780918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.781374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.781800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.861046 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5be9cb65-a077-4f52-8424-b9fc742c661c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092904 Oct 04 18:52:00.861650 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4188/6226] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:52:00 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:01.809773 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:01.820596 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.821226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.821851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.833507 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] Creating event network-changed:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:52:01.838885 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-01cd3510-3c4b-479d-9aaf-d7da241a264a req-aae49bcc-837c-4174-a337-7720c0d0eceb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032781 Oct 04 18:52:01.839909 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2039/6227] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:36.100815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.102602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.104942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.105844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.112572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:36.113423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:36.125281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.126199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.126884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.127938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.128530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.129128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.357448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:36.366002 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4c98968-a542-4af6-8164-b63ef57fd106 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1670 microversion: 2.1 time: 0.267842 Oct 04 18:52:36.366600 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4189/6228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:36 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1670 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:36.385705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.388724 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.389396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=78 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:36.394585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e31cc54-39cb-4265-b377-adee8eb06f19"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:36.397078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:36.406181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.406686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.407171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.407899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.408634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.409083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.669680 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62f322f0-d6a2-489b-aad2-94c7054d6c7c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284634 Oct 04 18:52:36.670289 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2040/6229] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:52:36 2022] POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:47.430146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:47.432433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.435294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:47.435960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:47.442083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.442571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.443012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.443767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.444222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.444649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.473671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.479171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Old instance type m1.heat2, new instance type m1.heat {{(pid=128770) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:52:47.486687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:47.487203 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:47.487616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:47.488030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:47.488449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:47.554253 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-89546a4d-157f-406c-b4ab-428acee9ad5e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/action" status: 202 len: 0 microversion: 2.1 time: 0.128171 Oct 04 18:52:47.554884 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4190/6230] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:47 2022] POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:47.561285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:47.562128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:47.567237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:47.567492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.575014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.575557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.576073 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.576932 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.577509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.577966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.722193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.731836 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3466aa2f-93f0-4c34-913c-9b03d493c8c9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1725 microversion: 2.1 time: 0.172516 Oct 04 18:52:47.732402 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2041/6231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:47 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:48.758004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.758939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.766371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.766868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.767333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.768042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.768497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.768940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.278985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.288656 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff18716d-152e-469a-8849-476ee0a550dc tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1725 microversion: 2.1 time: 0.535407 Oct 04 18:52:49.289181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4191/6232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:48 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1725 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:50.313244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.313874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.320711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.321201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.321650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.322350 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.322815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.323278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.452821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:50.461095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-95c17439-e772-4268-b1ef-6c50cb989e92 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.152365 Oct 04 18:52:50.461677 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2042/6233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:51.485616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:51.486228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:51.493073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.493570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.494007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.494694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.495208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.495637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.631822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:51.640127 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8799259-03d5-4839-8fcd-3eaae3fe5090 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.159012 Oct 04 18:52:51.641199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4192/6234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:51 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:52.667400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:52.668392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:52.675415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.675917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.676370 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.677079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.677547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.677990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.810439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.818737 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ea4410b-d27e-4274-9e6f-2841af4ff920 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155405 Oct 04 18:52:52.819564 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2043/6235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:52 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:53.842169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.842837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:53.848904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.849384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.849894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.850585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.851052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.851486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.987832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.996392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-19f6e94a-21b3-414e-80de-836f9fd906a5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.158491 Oct 04 18:52:53.996961 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4193/6236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:55.022105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:55.022801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:55.029563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.030063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.030516 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.031256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.031731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.032179 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.165118 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.173526 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b065e341-4921-4671-8a45-d7dfaac50661 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155403 Oct 04 18:52:55.174106 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2044/6237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:55 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:56.197539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.198168 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.205878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.206376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.206822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.207566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.208034 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.208470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.342674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:56.351760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6ddc4ff-36e8-48a5-9d7a-3cffa3824c51 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.158143 Oct 04 18:52:56.352342 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4194/6238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:57.427372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:57.427989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:57.434069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.434563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.435013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.435732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.436197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.436634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.565799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.574191 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f7c24982-340c-4c4a-93b8-7cd272900789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.202914 Oct 04 18:52:57.574772 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2045/6239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:57 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.598666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.599853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.605987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.606478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.606923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.607661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.608127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.608562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.741567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.750416 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee8d137a-1922-4e2d-ad6f-e3c4ecd20bbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.156271 Oct 04 18:52:58.750998 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4195/6240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:59.775124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:59.775753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:59.783446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.784199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.784647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.785346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.785809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.786273 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.920213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:59.928368 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d62fc175-2495-4173-9bd4-d79f408d353a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.157270 Oct 04 18:52:59.928934 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2046/6241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:59 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:00.951311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.952028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.958963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.959485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.959927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.960635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.961097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.961530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.094150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:01.102643 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c353db20-8c2b-4d81-9d0c-ffb1769b6777 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155329 Oct 04 18:53:01.103251 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4196/6242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.127238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:02.127782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:02.134561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.135077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.135535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.136232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.136696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.137134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.269868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.278203 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c16a3a9c-2582-4c4c-ad92-d8a5a02c7e7f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155522 Oct 04 18:53:02.278777 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2047/6243] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:02 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:03.302643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.303313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.310270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.310760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.311243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.311943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.313073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.313836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.445230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.454146 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3015e4e3-fdfa-42b1-a41c-183c19953a44 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155550 Oct 04 18:53:03.454721 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4197/6244] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:04.477201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.477825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.484813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.485314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.485761 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.486497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.486961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.487428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.620286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.629220 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b946fba-e08a-4408-8372-11adbb6f1fbd tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.155921 Oct 04 18:53:04.629805 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2048/6245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:05.656713 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.657691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.665393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.665886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.666326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.667050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.667520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.667950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.804982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.813513 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fce10b80-05c0-46bf-8e92-1b434f581b04 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.164143 Oct 04 18:53:05.814104 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4198/6246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.838284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:06.838911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:06.845840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.846340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.846790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.847526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.848023 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.848491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.992144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:07.001007 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c97143e-3357-4cf4-ae24-38f86fd056ea tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.167109 Oct 04 18:53:07.001591 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2049/6247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:06 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:08.024537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.025154 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:08.032133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.032624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.033064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.034012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.034469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.034894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.174753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.183516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3832e6bd-4243-494f-9715-970a8201cfe2 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1730 microversion: 2.1 time: 0.162898 Oct 04 18:53:08.184236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4199/6248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:09.211735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.213445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:09.221252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.221820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.222310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.223057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.223535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.223984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.364294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-unplugged", "status": "completed", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:09.376514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.376689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.377973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.379075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.385648 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c0d8baa-d8b4-4ec8-a0bd-e090736c0a52 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1729 microversion: 2.1 time: 0.179824 Oct 04 18:53:09.386277 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2050/6249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:09.394629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Creating event network-vif-unplugged:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h1-831193-17 Oct 04 18:53:09.400307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:09.412360 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-742aa852-4771-4cff-bb2f-e683962dd826 req-4681009a-46dd-4430-a920-ecd8ab1c108e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114679 Oct 04 18:53:09.412979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4200/6250] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:10.410094 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.410637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.417970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.418472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.419266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.419986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.420459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.420902 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.557974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.567071 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4e604281-32c3-4480-9506-7e67ba615792 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.161245 Oct 04 18:53:10.567733 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2051/6251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:11.429405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:11.439465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.439948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.440379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.452299 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Creating event network-changed:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h1-831193-17 Oct 04 18:53:11.458350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:11.469024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1af7ee9c-6110-4a14-ba45-f8dbb4c0783d req-83e127da-a83c-4148-a873-bda123aa18a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044675 Oct 04 18:53:11.469631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4201/6252] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:11.591939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.593456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.602263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.603268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.603893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.605173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.605649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.606252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.845058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.856508 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cc7fdeaa-2344-4461-bdb6-8ba008bb361d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.269321 Oct 04 18:53:11.857123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2052/6253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:12.882957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.883691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.891217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.891716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.892159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.892867 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.893336 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.893766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.038005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:13.047219 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3cdd0cda-ea20-4d26-84d4-8ac2e126e190 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.168767 Oct 04 18:53:13.047863 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4202/6254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:14.072607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:14.073167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:14.079949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.080444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.080893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.081594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.082060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.082495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.222307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.231539 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-071c2c84-abc1-4aea-8cd4-f76d42a3e2e9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.162870 Oct 04 18:53:14.232137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2053/6255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:14 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.256145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.256772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.263766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.264261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.264707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.265446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.265910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.266389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.402848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.412106 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd372782-d45a-483a-8cf6-1f72a752d7f6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.159964 Oct 04 18:53:15.412684 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4203/6256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:16.435993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.436639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.444558 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.445050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.445500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.446260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.446721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.447192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.576221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.584524 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3bf39fa-70fb-49fc-932e-5d82c9d85891 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.152375 Oct 04 18:53:16.585101 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2054/6257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.607966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.608584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.611436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:17.616755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.617249 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.617692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.618400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.618861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.619309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.623492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:17.755512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.763850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-99999505-8ef1-485c-9ad5-d34a33000ab5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.159802 Oct 04 18:53:17.764424 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4204/6258] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:18.788843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.789389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.792098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=29 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:18.797784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.798284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.798757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.799839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.800320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.800764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.803538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=85 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:18.941472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:18.949776 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-604d616c-ab09-4cbe-a035-64bd2a4139b7 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.165344 Oct 04 18:53:18.950366 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2055/6259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:19.975514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.976368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.983827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.984912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.985903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.985903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.986625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.986824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.128027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.136340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42b83319-b3f8-4722-b206-461e606fd328 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.165784 Oct 04 18:53:20.136944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4205/6260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.161693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.162245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.169296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.169795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.170251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.170965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.171603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.172381 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.309719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.321674 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-df144d7e-8974-4816-a46f-fa5dd56b569c tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1727 microversion: 2.1 time: 0.164242 Oct 04 18:53:21.322315 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2056/6261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:22.345505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.346292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.353410 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.353903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.354347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.355073 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.355536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.355967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.490602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.498906 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea6ee9aa-960e-4e9f-b05a-00a16debbd06 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1724 microversion: 2.1 time: 0.157313 Oct 04 18:53:22.500068 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4206/6262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:22.523136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:22.523683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.530409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.530955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.531437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.532181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.532818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.533254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.573632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.574133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.574571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.575335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.575798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.576233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.597993 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:22.603276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Getting quotas for user 0f7440ea65e54142a2cf4fba0d599e66 and project 91a9dc3ff8304d1fb9cd25b61d7ddaee. Resources: {'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:22.710290 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03365d0e-195a-4356-b42c-b469d7420562 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/action" status: 202 len: 0 microversion: 2.1 time: 0.190900 Oct 04 18:53:22.711085 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2057/6263] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:53:22 2022] POST /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:53:22.719528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.720229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.726348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.726939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.727478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.728254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.728898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.729411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.872764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.889372 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75c40f12-e95c-473a-afc2-56bc169b4c5d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.173927 Oct 04 18:53:22.890568 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4207/6264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:23.916804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.917514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.925735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.926235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.926685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.927625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.928095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.928538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.068703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.077156 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cbe291a0-e91d-4278-902b-f85d0e4e5796 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.165810 Oct 04 18:53:24.077731 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2058/6265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:24.574065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-plugged", "status": "completed", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:24.586348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.586978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.587507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.603213 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Creating event network-vif-plugged:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h1-831193-17 Oct 04 18:53:24.613969 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:24.628921 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-0c8953cb-c4d6-4c7c-9fa0-fd80dfe906a8 req-368b74f6-9923-4779-96f6-fc5517a32b16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058585 Oct 04 18:53:24.629550 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4208/6266] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:25.101434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.102229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.109784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.110288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.110742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.111495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.111969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.112447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.264499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.273524 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de5a5896-a7bc-416a-a9b3-0a3d9611bbf6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.175982 Oct 04 18:53:25.274113 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2059/6267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.299125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.299832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.306178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.306681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.307231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.307866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.308327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.308760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.454268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:26.463481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7706b396-25e7-4669-9ddf-019987fc7372 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.169490 Oct 04 18:53:26.464067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4209/6268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.487491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.488124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.495167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.495680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.496138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.496854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.497328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.497780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.732523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.742196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-802bc20c-e66e-47d8-9255-6c7f76cbb0eb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.258497 Oct 04 18:53:27.742908 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2060/6269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:27.918746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-unplugged", "status": "completed", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:27.930922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.931440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.932066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.945536 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Creating event network-vif-unplugged:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:53:27.952019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:27.963479 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-db739ebc-56e8-438f-8135-d02b6104618c req-a45e9bf5-148c-4b38-9276-8788b3a900de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049222 Oct 04 18:53:27.964318 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4210/6270] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:28.767951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.768512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.775360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.775935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.776369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.777109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.777572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.778007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.011017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:29.020622 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f20eac68-de6c-4c10-9d76-1f51e81f0eaa tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.257150 Oct 04 18:53:29.021134 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2061/6271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:30.005126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:30.015253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.015808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.016244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.028685 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Creating event network-changed:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:53:30.035666 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128770) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:30.044247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:30.044962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:30.047470 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-be611bab-ff67-4efe-beae-39ae2047a4f8 req-98c0b9aa-f20f-4350-b790-a3c9117d7821 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047310 Oct 04 18:53:30.048146 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4211/6272] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:30.057292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.061893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.064187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.065797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.066390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.066950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.321321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.333422 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-76ea769b-ec7b-4434-a8a3-e2a064c50d55 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.292872 Oct 04 18:53:30.334185 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2062/6273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:30 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:31.360585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.361300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.368059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.368596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.369041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.369816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.370208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.370632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.522262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.532152 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dcc14aa3-899b-443f-ad8d-ad728ffc3810 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.176728 Oct 04 18:53:31.532690 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4212/6274] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:32.556545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:32.557170 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:32.564947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.565444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.565893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.566602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.567093 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.567568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.590869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:32.707905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.716952 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9df75097-e578-4f50-91c1-afbb2e7f2dda tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.164455 Oct 04 18:53:32.717613 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2063/6275] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:32 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:33.743620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.744501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.753369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.753978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.754597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.755259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.755728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.756162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.901051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.910206 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8655dff9-8ea0-4463-84c3-c8737d7ccedb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.172289 Oct 04 18:53:33.910792 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4213/6276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.934033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.934854 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.942233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.942744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.943225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.943964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.944435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.944883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.077083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.085934 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c934aadb-d470-42b2-ae20-ad61977d9ceb tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.155988 Oct 04 18:53:35.086504 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2064/6277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:36.109904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.110861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.117929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.118412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.118870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.119594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.120051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.120477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.259659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.268623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-abf6b7d8-7e72-4336-9bd3-53c22c493872 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.163270 Oct 04 18:53:36.269211 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4214/6278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:37.294864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.295600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.303315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.303814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.304267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.304978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.305443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.305888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.436466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:37.444767 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-46e4f48d-10af-4465-8c90-f0147feb1e32 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.153938 Oct 04 18:53:37.445346 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2065/6279] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:38.471365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:38.472303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:38.482308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.482980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.483654 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.484908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.485954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.486677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.963128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.971995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c268db83-6dae-493a-ad57-d9a22c9a025b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.507699 Oct 04 18:53:38.972618 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4215/6280] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:38 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:39.996144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:39.996843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:40.004449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.004959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.005418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.006144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.006645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.007117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.149774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:40.159610 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a426213b-a3d2-44b0-a37e-d4eff846cc7e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1723 microversion: 2.1 time: 0.167057 Oct 04 18:53:40.160449 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2066/6281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:41.184372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.184908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.192682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.193171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.193612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.194312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.194770 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.195245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.329352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:41.338103 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e703d45e-b23f-46a1-b7cd-1587593e6520 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1716 microversion: 2.1 time: 0.157674 Oct 04 18:53:41.338697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4216/6282] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:41.361139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.361851 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.368878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.369378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.369838 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.370561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.371051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.371500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.526532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:41.535769 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7de082d6-16bb-475c-840a-05c8ec857b3e tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1716 microversion: 2.1 time: 0.178659 Oct 04 18:53:41.536360 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2067/6283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1716 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:41.558892 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.559535 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.566625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.567146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.567594 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.568298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.568757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.569189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.708839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:41.717595 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5dcaf5d4-2c53-4367-ad82-a0bb00413905 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1716 microversion: 2.1 time: 0.162500 Oct 04 18:53:41.718183 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4217/6284] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:41.742369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.742886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.750584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.751146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.751605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.752331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.752807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.753257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.783279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:41.786595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:41.871010 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-add6c35c-9504-4903-8c9a-252d16e5214b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 204 len: 0 microversion: 2.1 time: 0.132596 Oct 04 18:53:41.871843 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2068/6285] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:41 2022] DELETE /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:41.880623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.881243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.887646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.888149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.888596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.889304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.889768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.890198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.022450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:42.031941 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4bdaed58-a99e-4c17-8a1a-6507dbcd1f87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1722 microversion: 2.1 time: 0.155521 Oct 04 18:53:42.032531 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4218/6286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:43.057424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:43.058147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:43.066140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.066650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.067138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.067874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.068351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.068800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.218128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:43.227651 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0851f549-e09e-4b22-aa69-785bea7a9e6b tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1722 microversion: 2.1 time: 0.174458 Oct 04 18:53:43.228260 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2069/6287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:43 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:43.575540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-plugged", "status": "completed", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:43.588395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.589149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.589773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.608175 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] Creating event network-vif-plugged:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:53:43.615370 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ac18c1e2-f485-4d15-bc26-3d98291d8300 req-74dab3ec-b62e-4efd-a742-d06d5702fbec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047676 Oct 04 18:53:43.616534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4219/6288] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:44.311746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.312324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.320812 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.321546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.321997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.322717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.323479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.323917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.324328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5600cd07-f605-48e3-b525-a29b27ae7db4", "name": "network-vif-deleted", "tag": "6a521b2b-db09-4f5c-b315-a65fe981981f"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:44.335293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.335843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.337167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.349848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] Creating event network-vif-deleted:6a521b2b-db09-4f5c-b315-a65fe981981f for instance 5600cd07-f605-48e3-b525-a29b27ae7db4 on n-h2-831193-17 Oct 04 18:53:44.354963 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9bba1c31-e124-42de-a1c0-2ad7fbab5b2d req-5c13274b-3906-4e0b-b4cb-a92880cf0802 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 Oct 04 18:53:44.355666 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4220/6289] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:44.399098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:44.408259 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dd671723-d0e1-435d-a9c6-e8d39c4fa789 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1654 microversion: 2.1 time: 0.100626 Oct 04 18:53:44.423589 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2070/6290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:44 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1654 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:45.434021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:45.434849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:45.444306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.444910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.445351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.446227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.446532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.447093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.517568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:45.526019 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cc0eb936-48db-49cc-a796-846159420ed5 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1370 microversion: 2.1 time: 0.096180 Oct 04 18:53:45.526588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4221/6291] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:45 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:46.549940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:46.550569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:46.557608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:46.558114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:46.558565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:46.559294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:46.559762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:46.560201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:46.625211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:46.634121 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e10423ac-1a68-4ab5-9efa-64fc0f430531 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1370 microversion: 2.1 time: 0.088082 Oct 04 18:53:46.634710 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2071/6292] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:46 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:47.658135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:47.658865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:47.662440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:47.667932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:47.668433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:47.668876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:47.669975 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:47.670070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:47.670452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:47.674019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=94 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:47.738345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:47.747115 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ae2c9d02-fbcd-4d66-880f-90e2cd15586a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1370 microversion: 2.1 time: 0.092927 Oct 04 18:53:47.747657 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4222/6293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:47 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:48.770345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:48.770986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:48.778007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.778509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.778964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.779707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.780268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.780727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.809079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:48.813708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.814212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.814678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.815195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lazy-loading 'fault' on Instance uuid 5600cd07-f605-48e3-b525-a29b27ae7db4 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:48.862836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f7440ea65e54142a2cf4fba0d599e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9dc3ff8304d1fb9cd25b61d7ddaee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:48.871874 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-11df0d57-af5e-40db-be55-389e1046db45 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 200 len: 1375 microversion: 2.1 time: 0.105883 Oct 04 18:53:48.872811 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2072/6294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:48 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 1375 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:49.896366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:49.896915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:49.903925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.904418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.904862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:49.905568 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.906035 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.906621 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:49.920919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 HTTP/1.1 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '5600cd07-f605-48e3-b525-a29b27ae7db4'} Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:49.922695 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4c5d7e87-35a3-4a7d-ad74-a0ce93648a97 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 404 len: 111 microversion: 2.1 time: 0.031869 Oct 04 18:53:49.926845 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4223/6295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:49 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:49.986905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:49.989263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:49.995995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.996488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.996940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:49.997637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.998098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.998532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:50.011435 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-volume_attachments HTTP/1.1 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '5600cd07-f605-48e3-b525-a29b27ae7db4'} Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:50.013102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9bb05e79-6145-4c95-a30e-5e44a1b25e08 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031667 Oct 04 18:53:50.018027 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2073/6296] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:53:49 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.366198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.366774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.373355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.373851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.374298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.375112 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.376115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.376545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.394574 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 HTTP/1.1 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '5600cd07-f605-48e3-b525-a29b27ae7db4'} Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.396300 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.400990 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2361435f-f208-4ec7-b1f7-522a905da3b9 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 404 len: 111 microversion: 2.1 time: 0.035856 Oct 04 18:53:53.402843 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4224/6297] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:53 2022] DELETE /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.406257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.407480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 5600cd07-f605-48e3-b525-a29b27ae7db4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.415074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.415573 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.416022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.416734 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.417197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.417633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.431886 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 HTTP/1.1 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '5600cd07-f605-48e3-b525-a29b27ae7db4'} Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.433440 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 5600cd07-f605-48e3-b525-a29b27ae7db4 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.438856 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d536eb05-dd2d-4947-9057-5237933f2d94 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4" status: 404 len: 111 microversion: 2.1 time: 0.032403 Oct 04 18:53:53.439777 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2074/6298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/5600cd07-f605-48e3-b525-a29b27ae7db4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:53:53.444751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.445261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.451698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.452197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.452646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.453784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.454266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.454711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.468684 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a HTTP/1.1 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'a979160d-2223-4686-9c4b-ea74d278257a'} Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.470578 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d86fd24-2ad9-4f3c-8a25-f5c5d9d40c96 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 404 len: 111 microversion: 2.1 time: 0.031279 Oct 04 18:53:53.474660 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4225/6299] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:53 2022] DELETE /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.486608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.487373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: a979160d-2223-4686-9c4b-ea74d278257a] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.493435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.493930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.494375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.495096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.495562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.496000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.513839 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a HTTP/1.1 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'a979160d-2223-4686-9c4b-ea74d278257a'} Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.515410 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance a979160d-2223-4686-9c4b-ea74d278257a could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ed4e2905-55ce-424c-8df1-3f17050d736a tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a" status: 404 len: 111 microversion: 2.1 time: 0.039078 Oct 04 18:53:53.519775 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2075/6300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/a979160d-2223-4686-9c4b-ea74d278257a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.526938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.526938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.533144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.533633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.534368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.535129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.535586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.536009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.552411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 HTTP/1.1 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b51d3a6e-1fd5-4074-ba7d-e07d642f47a0'} Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.554386 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3abc66a0-24ad-471c-b3f3-0c8d9da64e2d tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 404 len: 111 microversion: 2.1 time: 0.033720 Oct 04 18:53:53.561903 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4226/6301] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:53 2022] DELETE /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.568707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.569371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: b51d3a6e-1fd5-4074-ba7d-e07d642f47a0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.575744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.576255 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.577190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.577419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.578112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.578554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.593245 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 HTTP/1.1 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'b51d3a6e-1fd5-4074-ba7d-e07d642f47a0'} Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.594867 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9912d1a9-b4af-4a45-935c-87041ac809c6 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0" status: 404 len: 111 microversion: 2.1 time: 0.031601 Oct 04 18:53:53.598622 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2076/6302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/b51d3a6e-1fd5-4074-ba7d-e07d642f47a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.604927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.605500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.612317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.612887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.613411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.614195 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.614707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.615170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.629889 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 HTTP/1.1 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '2f4a2234-e76d-45fb-9747-916ca0e44db6'} Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.631409 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1aa03fe0-7a04-4efb-9c62-d6027bdea0b1 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 404 len: 111 microversion: 2.1 time: 0.031808 Oct 04 18:53:53.635278 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4227/6303] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:53 2022] DELETE /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.641689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.642311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [instance: 2f4a2234-e76d-45fb-9747-916ca0e44db6] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:53.648347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.648842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.649292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.649987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:53.650449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:53.650997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:53.664837 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] HTTP exception thrown: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Request method failure captured: Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 HTTP/1.1 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPH_dCq7KRrx6AULKt6K_PzTRzaMvZLhjeV_vUCODRT6oxFYfvdlwXjHWdzkwPhdo0AQgO-JvcnFjLo55w3andsf429J9bRXegI9tERWzo61EYZR60nEt0jPFsxHxrWpcKU2pzR2TBVZr8X4nsYwSF430RLubMbi2dJBGVc9JhCmJ4fM Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91a9dc3ff8304d1fb9cd25b61d7ddaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 91a9dc3ff8304d1fb9cd25b61d7ddaee Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServerActionsTestJSON-794065462 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 0f7440ea65e54142a2cf4fba0d599e66 Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServerActionsTestJSON-794065462-project Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2f4a2234-e76d-45fb-9747-916ca0e44db6'} Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:53.666507 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Returning 404 to user: Instance 2f4a2234-e76d-45fb-9747-916ca0e44db6 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-49351109-482e-41e6-a5c7-1c7a1f800c87 tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6" status: 404 len: 111 microversion: 2.1 time: 0.030318 Oct 04 18:53:53.679088 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2077/6304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/2f4a2234-e76d-45fb-9747-916ca0e44db6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:53.680332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dd82d0e1-c00a-4d3e-aa16-40325d73348f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] Calling method '.version_select at 0x7f63400cf280>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.684730 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd82d0e1-c00a-4d3e-aa16-40325d73348f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:53:54.692379 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd82d0e1-c00a-4d3e-aa16-40325d73348f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] [e104498b-1290-4287-9f95-4ef83b0e84e5] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 58218. Oct 04 18:53:54.714686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dd82d0e1-c00a-4d3e-aa16-40325d73348f tempest-ServerActionsTestJSON-794065462 tempest-ServerActionsTestJSON-794065462-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293913442" status: 202 len: 0 microversion: 2.1 time: 1.038229 Oct 04 18:53:54.715585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4228/6305] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 18:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293913442 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:04.147751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=11 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:04.149083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:04.296974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2146521595", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "b68e8add-3ccf-4676-a920-8699dde2c999"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:04.355758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] validate_networks() for [('b68e8add-3ccf-4676-a920-8699dde2c999', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:04.822431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:04.822542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:04.822961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:04.823416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:04.823850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:04.834824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.835356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.835809 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.836570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.837035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.837476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.855303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Getting quotas for project fb44a5b4ca184cde93fc11aadcad81af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:04.860664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Getting quotas for user c788aec96ae64b41869902677b0f1e74 and project fb44a5b4ca184cde93fc11aadcad81af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:04.873240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:04.875498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:04.920651 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [b6fa956a-222c-4fe7-83ec-d2ad5f50e420] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:54:05.928759 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [b6fa956a-222c-4fe7-83ec-d2ad5f50e420] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 58300. Oct 04 18:54:05.932712 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4299e1d-74eb-4d29-b1ac-1857257416bc tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786233 Oct 04 18:54:05.933388 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2078/6306] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:05.945008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fa8f6f34-3b9e-4cd7-be44-df578561e347 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:05.945640 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fa8f6f34-3b9e-4cd7-be44-df578561e347 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:05.948926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:05.949893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:06.006055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fa8f6f34-3b9e-4cd7-be44-df578561e347 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:06.013727 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fa8f6f34-3b9e-4cd7-be44-df578561e347 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1217 microversion: 2.1 time: 0.072491 Oct 04 18:54:06.014326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4229/6307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:05 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:07.040363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-52429417-6fdc-4206-968c-d9ec21a1bbb3 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.041611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-52429417-6fdc-4206-968c-d9ec21a1bbb3 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:07.100977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-52429417-6fdc-4206-968c-d9ec21a1bbb3 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:07.108702 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-52429417-6fdc-4206-968c-d9ec21a1bbb3 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1217 microversion: 2.1 time: 0.073425 Oct 04 18:54:07.109413 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2079/6308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:07 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:08.132571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:08.133192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.141284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.141787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.142231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.142944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.143429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.143863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.210952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:08.220599 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88723748-6616-47a7-af08-9edaf872ea54 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1221 microversion: 2.1 time: 0.091628 Oct 04 18:54:08.221358 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4230/6309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:08 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:09.243790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:09.245092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:09.252602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.253303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.253996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.254735 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.255243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.255694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.341927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:09.350563 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ae5a1c16-6f4b-46fe-b9af-fa8ffda52aed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1275 microversion: 2.1 time: 0.110730 Oct 04 18:54:09.355933 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2080/6310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:09 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:10.375556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.376391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.384005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.384520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.385150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.385873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.386337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.386805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.606486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.615220 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c02f726b-dbce-47db-a269-69636128bf70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.244592 Oct 04 18:54:10.615816 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4231/6311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:10.673928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9986c83-2b80-486f-bfc2-916650d0776c", "tag": "a8f3f90e-57a2-44fe-b845-242e0457adb5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:10.685721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.686351 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.686869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.699091 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] Creating event network-changed:a8f3f90e-57a2-44fe-b845-242e0457adb5 for instance e9986c83-2b80-486f-bfc2-916650d0776c on n-h2-831193-17 Oct 04 18:54:10.704572 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-73632de8-b5b1-4c83-93f1-1002512a0f39 req-7adb4c4f-e7c4-43ee-9289-332b2f1e31af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034968 Oct 04 18:54:10.705301 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2081/6312] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:11.639555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.640204 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.647722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.648212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.648664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.649363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.649824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.650255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.780822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:11.788922 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1942c7fb-413b-411e-b858-4b8ba7b7fc24 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.153292 Oct 04 18:54:11.789499 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4232/6313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:12.813963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:12.815021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:12.820995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.821497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.822311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.822649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.823142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.823584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.959814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:12.967701 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf84da6c-7dbc-46a2-a0ea-cb5d4b72c4ae tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.159140 Oct 04 18:54:12.968273 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2082/6314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:12 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:13.992639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.993255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.000646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.001135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.001574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.002268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.002728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.003190 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.139971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:14.149059 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8bddfd52-4968-4928-b8a4-f45f06d9e645 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.160378 Oct 04 18:54:14.149644 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4233/6315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:13 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.173090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.173721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.176618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.182314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.182818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.183300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.184050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.184545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.184984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.317530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:15.325250 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-704ec3d1-c2b7-4a29-b939-f34b47238e9a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.156129 Oct 04 18:54:15.325816 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2083/6316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.588661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9986c83-2b80-486f-bfc2-916650d0776c", "name": "network-vif-plugged", "status": "completed", "tag": "a8f3f90e-57a2-44fe-b845-242e0457adb5"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:15.600794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.601305 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.601744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.614381 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] Creating event network-vif-plugged:a8f3f90e-57a2-44fe-b845-242e0457adb5 for instance e9986c83-2b80-486f-bfc2-916650d0776c on n-h2-831193-17 Oct 04 18:54:15.619601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4fd2d593-f187-4eb3-853f-bbb8b96bf944 req-7570003b-97a1-4c90-bd71-d747bb51f72f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 Oct 04 18:54:15.620229 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4234/6317] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:16.349355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:16.349980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:16.357042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.357537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.357994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.358702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.359806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.360245 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.400179 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:54:16.400422 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 18:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c (ip 10.222.0.33) !!! Oct 04 18:54:16.498947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:16.506835 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8b761229-cdb7-4541-962c-660a26e2452c tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1317 microversion: 2.1 time: 0.161374 Oct 04 18:54:16.507455 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2084/6318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:16 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.526873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:17.533103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.533803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.540938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.541424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.541868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.542581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.543060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.543490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.688973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.697030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf9d050f-b395-454c-ac3a-ae19813c141d tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.171128 Oct 04 18:54:17.697621 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4235/6319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.762814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-333183915", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "b68e8add-3ccf-4676-a920-8699dde2c999"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:17.771954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:17.821211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] validate_networks() for [('b68e8add-3ccf-4676-a920-8699dde2c999', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:18.512247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:18.512687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:18.513182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:18.513607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:18.514035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:18.523418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.523913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.524366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.525483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.525960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.526428 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.549718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Getting quotas for project fb44a5b4ca184cde93fc11aadcad81af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:18.555414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Getting quotas for user c788aec96ae64b41869902677b0f1e74 and project fb44a5b4ca184cde93fc11aadcad81af. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:18.567957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:18.570266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:18.615673 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9584fa06-93c5-4be9-934e-d2ce7980d462 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856626 Oct 04 18:54:18.616335 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2085/6320] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:18.627752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b0eca27a-4f3e-4bda-95fb-73bb48450c3a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:18.628395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b0eca27a-4f3e-4bda-95fb-73bb48450c3a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:18.686735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b0eca27a-4f3e-4bda-95fb-73bb48450c3a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:18.693949 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b0eca27a-4f3e-4bda-95fb-73bb48450c3a tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1216 microversion: 2.1 time: 0.070233 Oct 04 18:54:18.694540 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4236/6321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:18 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:19.718521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:19.719883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:19.727483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.728294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.729167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.730134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.730927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.731440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.818657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:19.829422 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a3279930-3b5b-4adb-879b-7ea578eacaf7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1276 microversion: 2.1 time: 0.115605 Oct 04 18:54:19.831113 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2086/6322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:19 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:20.853866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:20.854600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:20.863540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.864083 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.864549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.865659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.866136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.866573 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.017372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.026578 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-023b7a2e-a0d3-4ba8-b80f-9aed0f64ee6f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1316 microversion: 2.1 time: 0.176575 Oct 04 18:54:21.027473 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4237/6323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:20 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.100950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4cb409b-fb6d-4969-b7da-eae5bef583a3", "tag": "32350119-4d68-4e1b-af20-62eb97127fae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:21.114717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.117427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.117427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.129031 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] Creating event network-changed:32350119-4d68-4e1b-af20-62eb97127fae for instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 on n-h1-831193-17 Oct 04 18:54:21.133938 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-af58fa57-9383-48da-8f0e-4f7bffb55dbc req-57d4e0a5-9c8f-4610-8d6d-45fcb961554e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041319 Oct 04 18:54:21.134547 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2087/6324] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:22.049950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.050486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.057409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.057898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.058347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.059055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.059526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.059958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.197846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.207530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-41b6a43f-037c-43e3-b840-1a807bb80e10 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1316 microversion: 2.1 time: 0.161420 Oct 04 18:54:22.208132 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4238/6325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:23.233881 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:23.235159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:23.242582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.243134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.243598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.244333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.244815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.245265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.380811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:23.389062 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-28e785fb-5ae3-4993-a8aa-1f61898dca58 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1316 microversion: 2.1 time: 0.160515 Oct 04 18:54:23.389650 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2088/6326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:23 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.413066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.413753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.420095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.420581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.421019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.422222 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.422690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.423121 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.562188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:24.570233 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e71ab51d-2d50-4282-a3bd-535c8ebc90fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1316 microversion: 2.1 time: 0.161318 Oct 04 18:54:24.570817 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4239/6327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.879445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cb409b-fb6d-4969-b7da-eae5bef583a3", "name": "network-vif-plugged", "status": "completed", "tag": "32350119-4d68-4e1b-af20-62eb97127fae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:24.890557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.891284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.891737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.903191 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] Creating event network-vif-plugged:32350119-4d68-4e1b-af20-62eb97127fae for instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 on n-h1-831193-17 Oct 04 18:54:24.908896 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c237e350-b5e8-484d-ae6e-f55385cc3502 req-82319b76-2140-4fec-8280-10cb50ec7114 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Oct 04 18:54:24.909744 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2089/6328] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:25.593673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:25.594406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:25.601350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.601837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.602274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.602973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.603450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.603877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.731990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:25.739829 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a1280d7-f684-4ab1-98fc-993ab2c9acd1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1316 microversion: 2.1 time: 0.150561 Oct 04 18:54:25.740410 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4240/6329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:25 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:26.763497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:26.764218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:26.770467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.770966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.771449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.772153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.772622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.773065 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.916257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:26.924752 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5b444dfd-2e66-4738-acf1-7bb025e45365 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1505 microversion: 2.1 time: 0.166419 Oct 04 18:54:26.925325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2090/6330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:26 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:26.947424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:26.947958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:26.954788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.955307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.955741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.956429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.956884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.957308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.992394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:27.070969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4fe03216-7714-4740-ab43-d52e8d033a69 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 204 len: 0 microversion: 2.1 time: 0.127360 Oct 04 18:54:27.071651 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4241/6331] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:26 2022] DELETE /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:27.079930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.080563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:27.086512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.087013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.087501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.088208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.088684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.089122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.225860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:27.233534 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-80cf5957-d4b3-4c6f-8366-d9e627000ebf tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1511 microversion: 2.1 time: 0.157593 Oct 04 18:54:27.234110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2091/6332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:28.257838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.258681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:28.266367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:28.266896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:28.267419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:28.268628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:28.269377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:28.270036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:28.407767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:28.415779 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-66a97e0b-8be5-49bb-bb64-4d87f03ec11f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 200 len: 1511 microversion: 2.1 time: 0.162264 Oct 04 18:54:28.416360 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4242/6333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:28 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:28.787155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cb409b-fb6d-4969-b7da-eae5bef583a3", "name": "network-vif-deleted", "tag": "32350119-4d68-4e1b-af20-62eb97127fae"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:28.797968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:28.799556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:28.802231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:28.802975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:28.803637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:28.819295 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] Creating event network-vif-deleted:32350119-4d68-4e1b-af20-62eb97127fae for instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 on n-h1-831193-17 Oct 04 18:54:28.825235 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6358d82a-6b33-42c6-b319-b072bb3d43d8 req-5c2fd81a-889d-4590-b504-2fdcd0f09791 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041979 Oct 04 18:54:28.826535 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2092/6334] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:29.439589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.440214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.442130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:29.448377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.448869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.449310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.450012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.450470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.450902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.465145 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 HTTP/1.1 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c4cb409b-fb6d-4969-b7da-eae5bef583a3'} Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.466859 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 404 to user: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8d29316b-7fc8-4cf1-9a30-b9a3b018a081 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 404 len: 111 microversion: 2.1 time: 0.032890 Oct 04 18:54:29.471955 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4243/6335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:29.481091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.481805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.491334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.491839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.492293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.493009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.493477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.493920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.624162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:29.632041 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4dca514d-354d-42de-8e8a-af8e3b377b06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.155141 Oct 04 18:54:29.632617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2093/6336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:29.655165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:29.658162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: 89cc0c0e-244b-4233-96f9-d29bd37446e9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.663944 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/89cc0c0e-244b-4233-96f9-d29bd37446e9/action HTTP/1.1 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 32 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: {"resize": {"flavorRef": "452"}} Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '89cc0c0e-244b-4233-96f9-d29bd37446e9', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:29.665489 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 404 to user: Instance 89cc0c0e-244b-4233-96f9-d29bd37446e9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3375ec69-2d44-49d2-9214-601e13453ce1 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "POST /compute/v2.1/servers/89cc0c0e-244b-4233-96f9-d29bd37446e9/action" status: 404 len: 111 microversion: 2.1 time: 0.015728 Oct 04 18:54:29.670214 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4244/6337] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:29 2022] POST /compute/v2.1/servers/89cc0c0e-244b-4233-96f9-d29bd37446e9/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:29.675272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.675896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.681784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.682271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.682713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.683433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.683896 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.684331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.812490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:29.820763 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63e92797-f5ac-4779-bb65-fcd3455ffd26 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.149302 Oct 04 18:54:29.822302 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2094/6338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:29.844281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.844940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.852227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.852712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.853151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.854047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.854501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.854929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.987936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:29.995653 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-63473a62-70d1-4676-bac0-d271950383ed tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.155347 Oct 04 18:54:29.996225 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4245/6339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:30.019154 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "c37eaf61-08b7-47f6-820e-4352c629f8d5"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:30.021389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.027467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.027958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.028407 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.029102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.029565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.030003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.058574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.063918 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: request: POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action HTTP/1.1 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 65 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: {"resize": {"flavorRef": "c37eaf61-08b7-47f6-820e-4352c629f8d5"}} Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: exception: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'e9986c83-2b80-486f-bfc2-916650d0776c', 'body': {'resize': {'flavorRef': 'c37eaf61-08b7-47f6-820e-4352c629f8d5'}}} Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:30.065820 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 400 to user: Flavor c37eaf61-08b7-47f6-820e-4352c629f8d5 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-993d76fd-438e-4e08-875a-80f1a71bdc06 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action" status: 400 len: 107 microversion: 2.1 time: 0.052814 Oct 04 18:54:30.070176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2095/6340] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:30 2022] POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:30.076193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.076816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.083550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.084046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.084489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.085191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.085651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.086080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.220325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.228845 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d91dbaab-f557-48be-b20f-7c965f321aa4 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.156575 Oct 04 18:54:30.229421 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4246/6341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:30.253226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.253852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.259870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.260393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.260837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.261533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.261996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.262431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.393998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.401899 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63af48f8-bb7f-4ad5-b503-498f54045c7e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.153322 Oct 04 18:54:30.402475 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2096/6342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:30.425405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e635980-76e3-4218-8fa6-8b4659aeb14f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e635980-76e3-4218-8fa6-8b4659aeb14f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: request: POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action HTTP/1.1 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 29 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: {"resize": {"flavorRef": ""}} Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e9986c83-2b80-486f-bfc2-916650d0776c', 'body': {'resize': {'flavorRef': ''}}} Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi '' Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.429020 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2e635980-76e3-4218-8fa6-8b4659aeb14f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2e635980-76e3-4218-8fa6-8b4659aeb14f tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action" status: 400 len: 113 microversion: 2.1 time: 0.009550 Oct 04 18:54:30.433311 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4247/6343] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:30 2022] POST /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:30.439594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.440219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.446190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.446678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.447151 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.447850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.448312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.448751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.581717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.589639 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-05dd16f4-2bce-4776-9e0b-bbf4ad6ff7e7 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1506 microversion: 2.1 time: 0.154452 Oct 04 18:54:30.590147 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2097/6344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:30.617201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.617711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.624954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.625447 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.625894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.626603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.627087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.627528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.640712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 HTTP/1.1 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'c4cb409b-fb6d-4969-b7da-eae5bef583a3'} Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:30.642268 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 404 to user: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-86bc1232-b7e4-4a89-9e43-fc17f3b571fb tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 404 len: 111 microversion: 2.1 time: 0.031210 Oct 04 18:54:30.646607 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4248/6345] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:30 2022] DELETE /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:54:30.652328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.652991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: c4cb409b-fb6d-4969-b7da-eae5bef583a3] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.659800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.660304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.660758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.661467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.661941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.662388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.678405 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 HTTP/1.1 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'c4cb409b-fb6d-4969-b7da-eae5bef583a3'} Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:30.679987 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 404 to user: Instance c4cb409b-fb6d-4969-b7da-eae5bef583a3 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3e783dc7-0e3a-4f81-ad69-7d6ba36d0e70 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3" status: 404 len: 111 microversion: 2.1 time: 0.032952 Oct 04 18:54:30.684476 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2098/6346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/c4cb409b-fb6d-4969-b7da-eae5bef583a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:30.690066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.690560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.696624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.697107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.697546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.698231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.698684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.699132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.724551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:30.727241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:30.808348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01dacf60-9898-4b92-832f-7b4a8101dec9 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 204 len: 0 microversion: 2.1 time: 0.121871 Oct 04 18:54:30.809058 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4249/6347] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:30 2022] DELETE /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:54:30.817869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:30.818672 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:30.825878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.826447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.826962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.827760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.828588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.828817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.960343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.968069 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9a581ba2-4c12-4c88-8f55-9a4799a36d52 tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1512 microversion: 2.1 time: 0.154139 Oct 04 18:54:30.969493 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2099/6348] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:30 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:31.993055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:31.993763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:32.000854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:32.001353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:32.001794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.002500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:32.002960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:32.003424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.195431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c788aec96ae64b41869902677b0f1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb44a5b4ca184cde93fc11aadcad81af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:32.203411 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5bc85ddc-faf6-4962-a22f-dff6a88d18ce tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 200 len: 1512 microversion: 2.1 time: 0.215277 Oct 04 18:54:32.204024 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4250/6349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:31 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:32.585495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9986c83-2b80-486f-bfc2-916650d0776c", "name": "network-vif-deleted", "tag": "a8f3f90e-57a2-44fe-b845-242e0457adb5"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:32.600492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:32.600985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:32.601608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.616364 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] Creating event network-vif-deleted:a8f3f90e-57a2-44fe-b845-242e0457adb5 for instance e9986c83-2b80-486f-bfc2-916650d0776c on n-h2-831193-17 Oct 04 18:54:32.623147 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f7ba276b-d8c4-4d37-be70-b7f1fd9474a9 req-50c3398f-d46c-46f8-840b-69f68ef412cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040828 Oct 04 18:54:32.623902 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2100/6350] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:33.230194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:33.230808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] [instance: e9986c83-2b80-486f-bfc2-916650d0776c] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:33.237672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.238157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.238600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.239318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.239775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.240199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.253410 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] HTTP exception thrown: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Request method failure captured: Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c HTTP/1.1 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIFMBXltX_FGkvXzuwfaNsPw5PxFIHI8N6VxhQvG7YDQmw7MALzerrE8D39OgRJO8nxb3u1mS97SQFnbhWnS5Cw_Hbp86SO_3eP26GfXlfRWbdgxxAx5xkQU2a_yldCUGVVlpa-ghlH31CB7A1FQBuskZRGI-1v4pMK31icln6DIzNw Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb44a5b4ca184cde93fc11aadcad81af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: fb44a5b4ca184cde93fc11aadcad81af Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-ServersNegativeTestJSON-653438142 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: c788aec96ae64b41869902677b0f1e74 Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-ServersNegativeTestJSON-653438142-project Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'e9986c83-2b80-486f-bfc2-916650d0776c'} Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:33.255065 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] Returning 404 to user: Instance e9986c83-2b80-486f-bfc2-916650d0776c could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e078edc1-6851-43df-9f71-834e2db1a16e tempest-ServersNegativeTestJSON-653438142 tempest-ServersNegativeTestJSON-653438142-project] 10.222.0.33 "GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c" status: 404 len: 111 microversion: 2.1 time: 0.030251 Oct 04 18:54:33.259552 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4251/6351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:33 2022] GET /compute/v2.1/servers/e9986c83-2b80-486f-bfc2-916650d0776c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:04.532479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.533698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=98 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.713605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db43ce0b-0c0a-43e2-89a6-80f76d1e259a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: .version_select at 0x7f6341725700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-123743134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqbLkfYsAgAwGkbTk08CvqiQ7eayXz1EsH+FpFCz42N8+qGbZY1Vjt9/M/egvri9nKHG+qEclZ0JyO7bnH3Lt55dcrJx2V+TzJHvnSsUljdtxq7elg83TGNbEjCRLLSWQ=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:04.729717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-db43ce0b-0c0a-43e2-89a6-80f76d1e259a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:04.735965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-db43ce0b-0c0a-43e2-89a6-80f76d1e259a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:04.767670 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db43ce0b-0c0a-43e2-89a6-80f76d1e259a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.240885 Oct 04 18:55:04.768411 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2101/6352] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:55:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:04.825337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-457460761", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-123743134", "networks": [{"uuid": "15a6d1a8-7e79-490a-9487-b2d6c96a7f3a"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:04.835323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.836177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.884897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] validate_networks() for [('15a6d1a8-7e79-490a-9487-b2d6c96a7f3a', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:05.277472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:05.277899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:05.278403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:05.278840 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:05.279301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:05.290322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.290800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.291268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.291996 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.292453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.292879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.309908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:05.315163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:05.327751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:05.330748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:05.376856 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:55:06.385811 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 58688. Oct 04 18:55:06.390075 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7added54-e47a-48c5-aa87-edcfd061dd17 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568619 Oct 04 18:55:06.390971 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4252/6353] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:06.402408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-440af7df-c0a7-42ee-8b5b-b200b90d2d16 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:06.403646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-440af7df-c0a7-42ee-8b5b-b200b90d2d16 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:06.462192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-440af7df-c0a7-42ee-8b5b-b200b90d2d16 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.471224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-440af7df-c0a7-42ee-8b5b-b200b90d2d16 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1261 microversion: 2.1 time: 0.073084 Oct 04 18:55:06.471880 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2102/6354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:06 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1261 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:07.494695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:07.495339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:07.504151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.504940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.505435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.506378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.507009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.507635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.637957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.656340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-138a42c8-b34b-4ef6-ad25-df3416c538cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1331 microversion: 2.1 time: 0.157499 Oct 04 18:55:07.657446 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4253/6355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:07 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:08.684895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.685802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.698001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.698653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.699134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.699923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.700414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.700850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.929102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.936884 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bfbaa6ba-efca-49d2-893d-a9c89e2b2307 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.258824 Oct 04 18:55:08.937468 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2103/6356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:09.043897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54cf9476-1e5f-47e5-988f-b05ab12c093f", "tag": "62dc1030-50f1-49cc-9e43-b191fffd3869"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:09.055368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.056091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.056524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.068418 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] Creating event network-changed:62dc1030-50f1-49cc-9e43-b191fffd3869 for instance 54cf9476-1e5f-47e5-988f-b05ab12c093f on n-h2-831193-17 Oct 04 18:55:09.073652 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f44794b0-7791-437d-a7fc-0842317157ea req-828beb4c-e898-4348-ac35-345a178f29c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Oct 04 18:55:09.074264 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4254/6357] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:09.960335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.960967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.968512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.969026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.969627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.970358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.970828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.971363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.100813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.109029 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82536e72-2487-4cab-89b6-077967616c5a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.152653 Oct 04 18:55:10.109609 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2104/6358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:11.133842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.134552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.141492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.141991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.142433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.143173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.143636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.144074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.273956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:11.281747 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5fcef7e7-5c21-41be-aae1-8ddb5e5376d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.153045 Oct 04 18:55:11.282336 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4255/6359] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:12.304678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:12.305316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:12.312196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.312744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.313196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.313906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.314375 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.314816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.447307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.455692 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-474820c3-8079-4ae2-a7d3-7b309125d49b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.154947 Oct 04 18:55:12.456267 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2105/6360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:12 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.479617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:13.480318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:13.487772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.488262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.488697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.489422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.489882 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.490314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.624130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:13.632163 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-488c1ac3-5a48-4305-a439-4437a49b26a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.156484 Oct 04 18:55:13.632738 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4256/6361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:13 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.833815 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54cf9476-1e5f-47e5-988f-b05ab12c093f", "name": "network-vif-plugged", "status": "completed", "tag": "62dc1030-50f1-49cc-9e43-b191fffd3869"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:13.845328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.845821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.846278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.858585 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] Creating event network-vif-plugged:62dc1030-50f1-49cc-9e43-b191fffd3869 for instance 54cf9476-1e5f-47e5-988f-b05ab12c093f on n-h2-831193-17 Oct 04 18:55:13.863750 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-7453e3eb-7821-4706-b923-3d2421909f44 req-025aea76-a1ed-4c5e-9bc5-aba6b3e51416 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033923 Oct 04 18:55:13.864350 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2106/6362] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:14.655819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:14.656449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:14.663552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.664038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.664478 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.665174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.665649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.666061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.800129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:14.808040 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-733487bd-6087-40bd-93f0-8649d17b6f34 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1361 microversion: 2.1 time: 0.156808 Oct 04 18:55:14.808629 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4257/6363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:14 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:15.832953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.833681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.839953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.840453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.840907 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.841609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.842095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.843063 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.978953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:15.986892 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c6dfba6d-37ac-4f6e-ae33-f277c688aaa9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1553 microversion: 2.1 time: 0.159163 Oct 04 18:55:15.987504 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2107/6364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:15 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:16.009125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:16.009733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:16.011730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:16.012394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:16.019719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.020289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.020728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.021423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.021879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.022300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.151333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.159732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54b85135-e92f-4650-be40-958962b50c8f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1553 microversion: 2.1 time: 0.154412 Oct 04 18:55:16.160562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4258/6365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:16 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:17.838494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2948b48d-bffc-4cc9-a388-a1904767b6fc"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:17.841016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:17.843020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:17.849688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.850190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.850646 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.851445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.852028 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.852290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.095729 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e4388cdc-d2eb-46e0-a727-29d61be1f931 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261087 Oct 04 18:55:18.096371 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2108/6366] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:55:17 2022] POST /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:28.820718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:28.821319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:28.823642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:28.824433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=34 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:28.831049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.831550 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.831998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.832703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.833167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.833584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.917042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'services' on Instance uuid 54cf9476-1e5f-47e5-988f-b05ab12c093f {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:28.990459 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6c5f64d-43ce-4a06-81c8-e0cf32fce2fc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments/2948b48d-bffc-4cc9-a388-a1904767b6fc" status: 202 len: 0 microversion: 2.1 time: 0.173703 Oct 04 18:55:28.991088 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4259/6367] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:55:28 2022] DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments/2948b48d-bffc-4cc9-a388-a1904767b6fc => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:28.997990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:28.998880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:29.004260 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:29.006816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:29.015574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.019654 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.020168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.020926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.021436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.021891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.054043 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b06c792c-8c9e-426c-8d76-0fd93e915b2c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057948 Oct 04 18:55:29.054622 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2109/6368] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:28 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:30.067745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:30.070091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:30.076587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.077014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.077452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.078646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.079118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.079543 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.110645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbb090c4-4883-409c-8a5f-a3f13717e46f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Oct 04 18:55:30.111244 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4260/6369] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:30 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:31.123162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:31.125964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.132845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.133341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.133785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.134480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.134944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.135537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.166289 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a65fd6d-b6dd-4855-87d8-0ff8ef0e6254 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Oct 04 18:55:31.167083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2110/6370] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:31 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:32.178961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:32.181180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:32.189615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.190246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.190695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.191431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.191891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.192343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.223790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c7ef776-919b-4431-9422-2d3ccde554fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Oct 04 18:55:32.224287 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4261/6371] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:32 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:55:33.236733 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:33.238962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:33.245940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.246446 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.246912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.247656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.248126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.248566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.279916 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f7bfbd4-87bd-4b23-8e04-4083e64e6e22 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047670 Oct 04 18:55:33.280768 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2111/6372] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:33 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:34.292430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.294838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.302461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.302951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.303419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.304118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.304572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.304997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.333289 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2eabefb6-2fc8-4567-b37b-dbd2542b2102 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045439 Oct 04 18:55:34.333850 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4262/6373] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:34 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:55:34.344992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.345479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.352631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.353127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.353575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.354278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.354739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.355209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.432298 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f is not attached to volume 2948b48d-bffc-4cc9-a388-a1904767b6fc Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments/2948b48d-bffc-4cc9-a388-a1904767b6fc HTTP/1.1 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f is not attached to volume 2948b48d-bffc-4cc9-a388-a1904767b6fc Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '54cf9476-1e5f-47e5-988f-b05ab12c093f', 'id': '2948b48d-bffc-4cc9-a388-a1904767b6fc'} Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2948b48d-bffc-4cc9-a388-a1904767b6fc. Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f is not attached to volume 2948b48d-bffc-4cc9-a388-a1904767b6fc Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:34.443335 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f is not attached to volume 2948b48d-bffc-4cc9-a388-a1904767b6fc Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f is not attached to volume 2948b48d-bffc-4cc9-a388-a1904767b6fc {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-496d5c71-b96e-4b67-ae68-fb24344adcd4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments/2948b48d-bffc-4cc9-a388-a1904767b6fc" status: 404 len: 154 microversion: 2.1 time: 0.104368 Oct 04 18:55:34.448510 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2112/6374] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:55:34 2022] DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f/os-volume_attachments/2948b48d-bffc-4cc9-a388-a1904767b6fc => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:37.813746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.814257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.821863 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.822374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.822822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.823580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.824048 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.824485 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.854777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:37.940645 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cd42b39b-1250-461d-acdc-a565a224b2bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 204 len: 0 microversion: 2.1 time: 0.130629 Oct 04 18:55:37.941202 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4263/6375] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:37 2022] DELETE /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:37.949701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.950342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.960824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.961328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.961788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.962505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.962981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.963452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.097766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:38.105881 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e51a7e7d-6d05-4385-a4d2-66faaff6ee42 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1559 microversion: 2.1 time: 0.160078 Oct 04 18:55:38.106496 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2113/6376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:37 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:39.129995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:39.130637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:39.137536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.138021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.138460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.139302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.139643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.140578 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.274106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.282561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-626f5f5e-c9be-40a4-8e27-f9e5620415b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1559 microversion: 2.1 time: 0.156942 Oct 04 18:55:39.283150 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4264/6377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:39 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:39.869135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54cf9476-1e5f-47e5-988f-b05ab12c093f", "name": "network-vif-deleted", "tag": "62dc1030-50f1-49cc-9e43-b191fffd3869"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:39.884441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.885036 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.885561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.897684 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] Creating event network-vif-deleted:62dc1030-50f1-49cc-9e43-b191fffd3869 for instance 54cf9476-1e5f-47e5-988f-b05ab12c093f on n-h2-831193-17 Oct 04 18:55:39.903220 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-543a2b57-eb7b-4088-9f01-436010509ed0 req-caad2e50-c9dc-4ff5-8f5a-a6e875fa3d0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Oct 04 18:55:39.903836 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2114/6378] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:40.307176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:40.307910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:40.337544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.338248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.338976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.339873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.340500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.340938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.391829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.392646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.393558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.394743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'fault' on Instance uuid 54cf9476-1e5f-47e5-988f-b05ab12c093f {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:40.770260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:40.778311 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f724ba2-f45b-4d4d-b304-9bf269317fd0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 200 len: 1351 microversion: 2.1 time: 0.476018 Oct 04 18:55:40.778921 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4265/6379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:40 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 1351 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:41.804469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.805236 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 54cf9476-1e5f-47e5-988f-b05ab12c093f] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.813374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.813874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.814419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.815168 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.815643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.816086 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.831182 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f HTTP/1.1 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '54cf9476-1e5f-47e5-988f-b05ab12c093f'} Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.832878 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 54cf9476-1e5f-47e5-988f-b05ab12c093f could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e359bebc-da18-46ef-8746-58edd8c1b9d0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f" status: 404 len: 111 microversion: 2.1 time: 0.035630 Oct 04 18:55:41.837452 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2115/6380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/54cf9476-1e5f-47e5-988f-b05ab12c093f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:41.843078 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8b23ade3-799f-40b1-8b71-8b860fb8651c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '.version_select at 0x7f63400cff70>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.863717 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8b23ade3-799f-40b1-8b71-8b860fb8651c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-123743134" status: 202 len: 0 microversion: 2.1 time: 0.024400 Oct 04 18:55:41.864470 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4266/6381] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-123743134 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:41.885147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a37f21c4-619e-4bd8-a892-4fc58feb1e9a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: .version_select at 0x7f6341ab0af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1810705913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyhi/od9Z2CC+9hZaSPN5mfV10cH139UpfZIEY33hHAbvqK4m82V8I/Ge28Onh85ED0uCrneKC6LamHjFivuMmMqQkoyzTIGEDXB5eaLujKFYK6MRu2vyJtlB7TttkYEA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.901206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a37f21c4-619e-4bd8-a892-4fc58feb1e9a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:41.906561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a37f21c4-619e-4bd8-a892-4fc58feb1e9a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:41.932332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a37f21c4-619e-4bd8-a892-4fc58feb1e9a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051160 Oct 04 18:55:41.932960 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2116/6382] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:41.984401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1454098889", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1810705913", "networks": [{"uuid": "15a6d1a8-7e79-490a-9487-b2d6c96a7f3a"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:42.038956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] validate_networks() for [('15a6d1a8-7e79-490a-9487-b2d6c96a7f3a', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:42.502032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:42.502459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:42.502960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:42.503412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:42.503825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:42.512571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.513049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.513484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.514284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.514750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.515209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.532661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:42.538113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:42.551054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:42.553323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:42.599910 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-04488def-48dc-4c0e-8c5f-6c9a0c97b5b5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619869 Oct 04 18:55:42.600574 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4267/6383] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:42.612466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d9382f13-afce-4313-841f-4b428d12c469 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:42.613095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d9382f13-afce-4313-841f-4b428d12c469 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:42.669344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d9382f13-afce-4313-841f-4b428d12c469 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:42.678299 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d9382f13-afce-4313-841f-4b428d12c469 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1263 microversion: 2.1 time: 0.070234 Oct 04 18:55:42.679073 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2117/6384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:42 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:43.701059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:43.701674 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:43.710505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.711342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.711848 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.712645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.713302 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.713925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.778915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:43.787355 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2ac337b0-bb88-445f-96c0-ee43a7575fb1 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1323 microversion: 2.1 time: 0.090300 Oct 04 18:55:43.800184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4268/6385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:43 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:44.812359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:44.813207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:44.822916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.823790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.824536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.825621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:44.826338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:44.827019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.970664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:44.978660 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5026f713-9ad1-4168-8eaf-c65a0c5f88a2 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1363 microversion: 2.1 time: 0.170609 Oct 04 18:55:44.979531 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2118/6386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:44 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:45.056639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900e53c5-929c-47db-a280-db376954c750", "tag": "35649cd0-8798-4a22-a845-8f771713076c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:45.066999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.067529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.068151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.080392 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] Creating event network-changed:35649cd0-8798-4a22-a845-8f771713076c for instance 900e53c5-929c-47db-a280-db376954c750 on n-h1-831193-17 Oct 04 18:55:45.085619 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-941a1ae8-237c-45df-9f85-8b3800472764 req-8b6fc8e9-6687-4be5-9bb4-5270d41ef2e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Oct 04 18:55:45.086631 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4269/6387] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:46.006467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:46.007180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:46.014079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.014576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.015062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.015759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.016257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.016698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.146645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:46.154433 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6aeec0b-32c1-415c-92ac-18a62c087264 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1363 microversion: 2.1 time: 0.151837 Oct 04 18:55:46.155004 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2119/6388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:46 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:47.180025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:47.180834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:47.187408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.187979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.188510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.189289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.189821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.190322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.339828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.348674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8e29e0d3-053b-48a2-ba6a-a3094364cd5e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1363 microversion: 2.1 time: 0.173882 Oct 04 18:55:47.349266 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4270/6389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:47 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:48.371670 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.372288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.379766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.380259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.380708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.381412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.381877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.382312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.518363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:48.526028 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a7912c9-f571-4c8d-8204-8c3e24607f9c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1363 microversion: 2.1 time: 0.158266 Oct 04 18:55:48.526594 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2120/6390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:49.210956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900e53c5-929c-47db-a280-db376954c750", "name": "network-vif-plugged", "status": "completed", "tag": "35649cd0-8798-4a22-a845-8f771713076c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:49.221656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.222343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.222788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.234592 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] Creating event network-vif-plugged:35649cd0-8798-4a22-a845-8f771713076c for instance 900e53c5-929c-47db-a280-db376954c750 on n-h1-831193-17 Oct 04 18:55:49.239629 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-9d133544-deda-44cd-93fa-fdb31aede920 req-753762d0-7671-444a-b243-66dd872fc418 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Oct 04 18:55:49.240400 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4271/6391] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:49.551322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.551967 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.559359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.559855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.560309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.561019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.561480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.561918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.702868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.710641 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62e30100-a5ae-46a7-a921-91fc0c58d6d4 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1363 microversion: 2.1 time: 0.163943 Oct 04 18:55:49.711296 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2121/6392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:49 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.735227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.735828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.742152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.742639 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.743106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.743813 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.744268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.744697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.888321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.896853 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6824ac2d-da6f-44d6-bf9f-bc051c5243c0 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1555 microversion: 2.1 time: 0.166905 Oct 04 18:55:50.897430 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4272/6393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.919368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.920051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.926919 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.927452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.927899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.928598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.929057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.929493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.059598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.068551 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0c039d59-aea4-4db3-bbbb-435edad97b2d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1555 microversion: 2.1 time: 0.152940 Oct 04 18:55:51.069139 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2122/6394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:52.608419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be4d5ef9-e890-4017-ba01-c1de241027de"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:52.611318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:52.614197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:52.614870 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:52.621173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.621675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.622123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.622851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.623343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.623804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.865791 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-07eb0b8b-405c-4ae9-9648-4974b507eb06 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261162 Oct 04 18:55:52.866500 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4273/6395] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:55:52 2022] POST /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:03.624811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.625352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.627859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:03.629488 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:03.630296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=64 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:03.637468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.637969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.638424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.639176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.639649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.640092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.725085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'services' on Instance uuid 900e53c5-929c-47db-a280-db376954c750 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:03.799886 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cdc01014-2a85-4cdb-9bee-2d4533e0f3a9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments/be4d5ef9-e890-4017-ba01-c1de241027de" status: 202 len: 0 microversion: 2.1 time: 0.178762 Oct 04 18:56:03.800475 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2123/6396] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:03 2022] DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments/be4d5ef9-e890-4017-ba01-c1de241027de => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:03.807707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:03.808603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:03.812931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.816439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.828191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.828810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.829683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.830012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.830407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.830774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.864482 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92bdfd95-fa8c-4bc2-8aca-59ff0ee63153 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059104 Oct 04 18:56:03.865009 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4274/6397] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:04.881306 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:04.884058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:04.890832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.891913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.891913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.893156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.893156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.893432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.930225 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a30e4cd-5493-414f-8f54-921b58885364 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056108 Oct 04 18:56:04.930805 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2124/6398] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:04 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:05.943046 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.945277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.952513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.953012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.953449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.954220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.954679 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.955745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.987810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-068c5ead-159f-44e2-b3e7-a291f467a7cf tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049539 Oct 04 18:56:05.988397 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4275/6399] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:07.000623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:07.003489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:07.010722 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.011331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.011791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.012515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.012981 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.013423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.050654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63e30e61-6b2e-4764-ad5f-42b90ce64ec8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053682 Oct 04 18:56:07.051561 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2125/6400] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:06 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:08.063678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.066468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.073745 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.074234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.074683 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.075426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.075887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.076321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.111415 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c1c45ed5-79a5-4fdf-8d84-8338d8b748fe tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051975 Oct 04 18:56:08.112003 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4276/6401] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:08 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:09.128201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:09.131771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:09.143912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.144720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.145470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.146641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.147453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.148191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.192869 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-60e17be7-c692-4f20-9012-b0ec594f4d07 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071691 Oct 04 18:56:09.193465 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2126/6402] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:09 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:56:09.206689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:09.207285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:09.217878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.218388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.218836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.219596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.221726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.221726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.307695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 900e53c5-929c-47db-a280-db376954c750 is not attached to volume be4d5ef9-e890-4017-ba01-c1de241027de Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments/be4d5ef9-e890-4017-ba01-c1de241027de HTTP/1.1 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 900e53c5-929c-47db-a280-db376954c750 is not attached to volume be4d5ef9-e890-4017-ba01-c1de241027de Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '900e53c5-929c-47db-a280-db376954c750', 'id': 'be4d5ef9-e890-4017-ba01-c1de241027de'} Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be4d5ef9-e890-4017-ba01-c1de241027de. Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900e53c5-929c-47db-a280-db376954c750 is not attached to volume be4d5ef9-e890-4017-ba01-c1de241027de Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:09.309738 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900e53c5-929c-47db-a280-db376954c750 is not attached to volume be4d5ef9-e890-4017-ba01-c1de241027de Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 900e53c5-929c-47db-a280-db376954c750 is not attached to volume be4d5ef9-e890-4017-ba01-c1de241027de {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f220d02-308d-4d51-9e7b-592bd65dd9da tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments/be4d5ef9-e890-4017-ba01-c1de241027de" status: 404 len: 154 microversion: 2.1 time: 0.110857 Oct 04 18:56:09.313963 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4277/6403] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:09 2022] DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750/os-volume_attachments/be4d5ef9-e890-4017-ba01-c1de241027de => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:12.708723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.709595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.717462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.717997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.718803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.719659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.720159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.721265 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.754016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:12.854560 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7f2627ac-a5c1-4a96-bd2b-4e2654530dc7 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 204 len: 0 microversion: 2.1 time: 0.149694 Oct 04 18:56:12.855395 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2127/6404] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:12 2022] DELETE /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:12.864408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.865065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.872932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.873423 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.873860 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.874566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.875021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.875466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.016997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:13.026047 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-007195b0-20d5-4d2b-ac0b-d638bda94f38 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1561 microversion: 2.1 time: 0.166287 Oct 04 18:56:13.026588 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4278/6405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.051709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:14.052431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:14.059729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.060232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.060676 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.061388 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.061850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.062284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.210012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.218388 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-702bf0e6-fcb6-4dd2-b515-6b598bc7c0a8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1561 microversion: 2.1 time: 0.171640 Oct 04 18:56:14.218994 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2128/6406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:14 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.875140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900e53c5-929c-47db-a280-db376954c750", "name": "network-vif-deleted", "tag": "35649cd0-8798-4a22-a845-8f771713076c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:14.895097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.895588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.896028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.909956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] Creating event network-vif-deleted:35649cd0-8798-4a22-a845-8f771713076c for instance 900e53c5-929c-47db-a280-db376954c750 on n-h1-831193-17 Oct 04 18:56:14.917001 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-511e5b55-6b83-4c8e-9678-da1d299452d1 req-538c7db2-cd24-4fa1-8ba1-3d3374db4d13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045413 Oct 04 18:56:14.917821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4279/6407] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:15.244314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.244979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.252830 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.253341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.253792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.254687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.255194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.255637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.290595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.290979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.291464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.291930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'fault' on Instance uuid 900e53c5-929c-47db-a280-db376954c750 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:15.336248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.344737 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-22459470-050f-480f-b5aa-1a71290b122d tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 200 len: 1353 microversion: 2.1 time: 0.104564 Oct 04 18:56:15.359858 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2129/6408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 1353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:16.372766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.373615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 900e53c5-929c-47db-a280-db376954c750] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.381365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.381854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.382294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.383011 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.383512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.383947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.399664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 HTTP/1.1 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '900e53c5-929c-47db-a280-db376954c750'} Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.401374 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 900e53c5-929c-47db-a280-db376954c750 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-13d2b16e-a920-4762-8699-2d24c50d693c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750" status: 404 len: 111 microversion: 2.1 time: 0.034370 Oct 04 18:56:16.406994 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4280/6409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/900e53c5-929c-47db-a280-db376954c750 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:16.412870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7ea77512-cc99-44e9-b14a-c6349710b996 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '.version_select at 0x7f6340ec6dc0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.434546 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7ea77512-cc99-44e9-b14a-c6349710b996 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1810705913" status: 202 len: 0 microversion: 2.1 time: 0.025940 Oct 04 18:56:16.435171 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2130/6410] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 18:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1810705913 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:16.453678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ad07ba41-b35c-46da-89a3-7dbb78c54d7b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: .version_select at 0x7f63416e41f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-244204850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInwihCxOxBvcEbYid62acfzWUdkC1pQPwVVlm8AEuunUIweqUsIe31xx93/65DK57fMCnjUwMYTB0jkWNAT2q2tjx8wr0KtO2L6Xu/U8Pl4bdd0xkbiXxCzEDkUEdC4Og=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:16.471545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ad07ba41-b35c-46da-89a3-7dbb78c54d7b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:16.477224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-ad07ba41-b35c-46da-89a3-7dbb78c54d7b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:16.504006 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ad07ba41-b35c-46da-89a3-7dbb78c54d7b tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054274 Oct 04 18:56:16.504638 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4281/6411] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:56:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:16.596683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1621582418", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-244204850", "networks": [{"uuid": "15a6d1a8-7e79-490a-9487-b2d6c96a7f3a"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:16.650264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] validate_networks() for [('15a6d1a8-7e79-490a-9487-b2d6c96a7f3a', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:17.052508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:17.052949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:17.053448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:17.053876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:17.054305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:17.064366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.064909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.065377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.066138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.066607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.067070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.085317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:17.091171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Getting quotas for user 3e4e0f72d6e94024bb9d910797c2c30a and project 9a80ea40015b48aabb07511942c6912d. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:17.105165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:17.107606 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:17.157068 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-80c3a02a-da57-4abd-b46b-3397cd7bd663 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567849 Oct 04 18:56:17.157930 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2131/6412] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:17.171801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54571e6b-3e54-4e40-bf25-f5b4fbd5759e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:17.172753 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54571e6b-3e54-4e40-bf25-f5b4fbd5759e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:17.347532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54571e6b-3e54-4e40-bf25-f5b4fbd5759e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:17.357487 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54571e6b-3e54-4e40-bf25-f5b4fbd5759e tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1262 microversion: 2.1 time: 0.191429 Oct 04 18:56:17.360402 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4282/6413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:17 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1262 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.383658 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.384559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.391607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.392262 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.393481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.394831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.396659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.397122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.465266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.473731 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a581fdf-e860-48c3-9a35-85b957748276 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1332 microversion: 2.1 time: 0.094985 Oct 04 18:56:18.474446 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2132/6414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.497944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.498529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.506536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.507741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.508192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.508946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.509433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.510103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.654009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.665601 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54f4551f-9277-4941-ab99-beba6b16002f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.171622 Oct 04 18:56:19.666491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4283/6415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.740061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c66667-11f9-49ea-a75c-85047a854aa2", "tag": "183fe1d5-f210-48db-9068-dc6065242c45"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:19.751293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.751711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.752156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.764745 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] Creating event network-changed:183fe1d5-f210-48db-9068-dc6065242c45 for instance 35c66667-11f9-49ea-a75c-85047a854aa2 on n-h1-831193-17 Oct 04 18:56:19.770242 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-956e0e62-7bc9-46cd-8cb9-32f4739807e2 req-e0f3f731-1e31-4ec5-ace6-2bcfa72cb51a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 Oct 04 18:56:19.770861 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2133/6416] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:20.688417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.689030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.696297 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.696721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.697196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.697898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.698380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.698806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.835940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:20.843848 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-697237e5-31c5-415d-be87-3579a2b7b41a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.159303 Oct 04 18:56:20.844436 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4284/6417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:21.869720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.870437 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.876709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.877294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.878373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.879148 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.879639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.880091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.025140 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.033509 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-da374aec-a8a4-4946-b426-6dac971da804 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.168905 Oct 04 18:56:22.034115 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2134/6418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:23.057601 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.058224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.064559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.065561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.065999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.066795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.067328 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.067776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.200521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.209056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44c87147-45aa-49ad-9db8-fed46c2d8773 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.155600 Oct 04 18:56:23.209646 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4285/6419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.233551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.234178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.241181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.241678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.242128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.242831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.243346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.243787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.390319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.398092 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-35d60879-d288-4ee0-9e21-bef258e303bc tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.169370 Oct 04 18:56:24.398658 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2135/6420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:25.406179 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c66667-11f9-49ea-a75c-85047a854aa2", "name": "network-vif-plugged", "status": "completed", "tag": "183fe1d5-f210-48db-9068-dc6065242c45"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:25.417651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.418145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.418589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.423741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:25.424384 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:25.432626 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] Creating event network-vif-plugged:183fe1d5-f210-48db-9068-dc6065242c45 for instance 35c66667-11f9-49ea-a75c-85047a854aa2 on n-h1-831193-17 Oct 04 18:56:25.433317 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.433744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.434197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.434922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.435429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.435874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.437888 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-883ddc8c-87fb-4195-8a5f-bfe7bbe57af1 req-82ad0f65-609b-4f6b-9771-4736e349bf31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035429 Oct 04 18:56:25.438675 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4286/6421] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:25.592634 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:25.600631 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce753fdc-0624-438d-a3d9-be930824a334 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1362 microversion: 2.1 time: 0.182088 Oct 04 18:56:25.601288 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2136/6422] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:25 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.628971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.629673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.636796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.637295 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.638547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.639398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.639930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.640395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.781926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.791757 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-26bd5d16-9b35-47a4-a9be-a5473d8ebf91 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1553 microversion: 2.1 time: 0.168019 Oct 04 18:56:26.792338 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4287/6423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.815453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.816203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.823643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.824225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.824779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.825574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.826120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.826636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.961123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.969240 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a431f416-6ef0-40ed-a5f4-a279578778b9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1553 microversion: 2.1 time: 0.157766 Oct 04 18:56:26.969813 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2137/6424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:28.493262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31809072-c1d9-4a29-acf8-3e3817d62995"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:28.495616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.497564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:28.504094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.504580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.505016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.505735 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.506188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.506628 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.753565 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1081fe6f-4c0c-43a0-a5fa-0fa807833da9 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "POST /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264045 Oct 04 18:56:28.754203 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4288/6425] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:56:28 2022] POST /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:39.514187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.515189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.518376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.520007 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.521580 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.522241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.532054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.532517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.532972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.533695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.534149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.534657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.625787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'services' on Instance uuid 35c66667-11f9-49ea-a75c-85047a854aa2 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:39.711391 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-681a5c66-7eae-4c8a-a4aa-ed1e79fc0d3c tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments/31809072-c1d9-4a29-acf8-3e3817d62995" status: 202 len: 0 microversion: 2.1 time: 0.204584 Oct 04 18:56:39.712364 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2138/6426] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:39 2022] DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments/31809072-c1d9-4a29-acf8-3e3817d62995 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:39.719375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.721349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:39.727759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.731272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.743764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.744442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.745227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.746264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.746964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.747547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.781195 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-95eaebfc-e119-41b3-bd5b-c379f6d11b99 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063984 Oct 04 18:56:39.781962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4289/6427] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:40.796044 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.798543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.805021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.805523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.805973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.806687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.807189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.807632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.839806 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-12cd6a62-b499-4183-a8a9-b4e7794f4443 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049268 Oct 04 18:56:40.840380 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2139/6428] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:41.853240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:41.855487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:41.862506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.863704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.864145 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.864851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.865591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.866021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.896202 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d239ca8c-be11-44a4-884c-816160a3181a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Oct 04 18:56:41.896778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4290/6429] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:41 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:42.908694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.911326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.918469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.918980 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.919464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.920187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.920657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.921107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.958665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2be1bf44-0ca8-453c-947a-caf6a167e4c8 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053893 Oct 04 18:56:42.959297 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2140/6430] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:43.974894 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:43.977169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:43.984420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.984924 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.985367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.986084 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.987219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.987655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.032651 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-806c7adb-7bd8-446c-a85c-d217fb24055a tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062006 Oct 04 18:56:44.033250 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4291/6431] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:43 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:45.045862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.048076 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.055454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.055956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.056415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.057125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.057599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.058046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.087409 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3adb2648-f20c-4a14-a352-460865a291c5 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045525 Oct 04 18:56:45.087900 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2141/6432] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:56:45.098704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.099242 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.106017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.106501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.106943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.107668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.108117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.108538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.188356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 is not attached to volume 31809072-c1d9-4a29-acf8-3e3817d62995 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: request: DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments/31809072-c1d9-4a29-acf8-3e3817d62995 HTTP/1.1 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 is not attached to volume 31809072-c1d9-4a29-acf8-3e3817d62995 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'server_id': '35c66667-11f9-49ea-a75c-85047a854aa2', 'id': '31809072-c1d9-4a29-acf8-3e3817d62995'} Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31809072-c1d9-4a29-acf8-3e3817d62995. Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 is not attached to volume 31809072-c1d9-4a29-acf8-3e3817d62995 Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:45.189960 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 is not attached to volume 31809072-c1d9-4a29-acf8-3e3817d62995 Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 is not attached to volume 31809072-c1d9-4a29-acf8-3e3817d62995 {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-446851d8-05be-4eab-9d5a-e9244d8ca479 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments/31809072-c1d9-4a29-acf8-3e3817d62995" status: 404 len: 154 microversion: 2.1 time: 0.097438 Oct 04 18:56:45.195671 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4292/6433] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:45 2022] DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2/os-volume_attachments/31809072-c1d9-4a29-acf8-3e3817d62995 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:48.569312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.569948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.577750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.578135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.578590 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.579419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.579883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.580493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.609286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:48.693290 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5a8fad5a-0efd-4338-b783-8cea7207f85f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 204 len: 0 microversion: 2.1 time: 0.128583 Oct 04 18:56:48.693938 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2142/6434] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:48 2022] DELETE /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:56:48.702432 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.703459 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.710491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.710980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.711522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.712225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.712680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.713111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.872990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:48.882936 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2994a8a1-3fe0-4c66-a26d-897cf4599217 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1559 microversion: 2.1 time: 0.184322 Oct 04 18:56:48.883572 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4293/6435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:49.907257 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:49.907982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:49.915577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.916071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.916521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.917230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.917697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.918137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.067202 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:50.076647 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1e1abf71-2a33-44f3-b89a-dcbe37e7d66f tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1559 microversion: 2.1 time: 0.173660 Oct 04 18:56:50.082806 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2143/6436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:49 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:50.929795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c66667-11f9-49ea-a75c-85047a854aa2", "name": "network-vif-deleted", "tag": "183fe1d5-f210-48db-9068-dc6065242c45"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:50.941828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.942312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.942749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.958846 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] Creating event network-vif-deleted:183fe1d5-f210-48db-9068-dc6065242c45 for instance 35c66667-11f9-49ea-a75c-85047a854aa2 on n-h1-831193-17 Oct 04 18:56:50.964496 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3215c8bc-7330-4b55-9ffc-5d0e71d8c96a req-e918a4c5-01c1-4774-bf3c-c9d06277e7e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039450 Oct 04 18:56:50.965826 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4294/6437] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:51.113064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.113709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:51.121536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.122102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.122760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.123577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.124054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.124502 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.157379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.157868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.158316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.158777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lazy-loading 'fault' on Instance uuid 35c66667-11f9-49ea-a75c-85047a854aa2 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:51.200366 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4e0f72d6e94024bb9d910797c2c30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a80ea40015b48aabb07511942c6912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:51.208281 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e8ad8b18-d2aa-4ea2-8f81-a30965a2afea tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 200 len: 1352 microversion: 2.1 time: 0.104344 Oct 04 18:56:51.208850 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2144/6438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:51 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:52.233337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:52.234181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] [instance: 35c66667-11f9-49ea-a75c-85047a854aa2] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:52.241415 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.241913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.242360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.243133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.243600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.244066 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.257792 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] HTTP exception thrown: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Request method failure captured: Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 HTTP/1.1 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIGDPRs6Q0qfnEun9VmFirKKSn0Dsof6rFMDJboK7WDqX5am1RuIJITb6GOwnmoXpbve4W4qM4hHs5XfHwO6R8YOtZXiwJvXMI6L6I4ZQRJnOTd4xPaP8V02JMiLvTurOzkS4coVRu4hixMqE-iTSmdhYkEdBMUSAHmBNFgB4_jGWzk Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a80ea40015b48aabb07511942c6912d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a80ea40015b48aabb07511942c6912d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 9a80ea40015b48aabb07511942c6912d Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1847057552 Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3e4e0f72d6e94024bb9d910797c2c30a Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestEncryptedCinderVolumes-1847057552-project Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '35c66667-11f9-49ea-a75c-85047a854aa2'} Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:52.259479 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Returning 404 to user: Instance 35c66667-11f9-49ea-a75c-85047a854aa2 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c32371d6-306d-4d3d-9a16-e58ee5f3bea6 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2" status: 404 len: 111 microversion: 2.1 time: 0.033622 Oct 04 18:56:52.264199 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4295/6439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:52 2022] GET /compute/v2.1/servers/35c66667-11f9-49ea-a75c-85047a854aa2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:52.270069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-655beabd-a271-4fe2-b1c9-91964fe04719 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] Calling method '.version_select at 0x7f6341725550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:52.291921 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-655beabd-a271-4fe2-b1c9-91964fe04719 tempest-TestEncryptedCinderVolumes-1847057552 tempest-TestEncryptedCinderVolumes-1847057552-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-244204850" status: 202 len: 0 microversion: 2.1 time: 0.025577 Oct 04 18:56:52.292513 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2145/6440] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 18:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-244204850 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:57:20.290259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9420957-7e89-4399-8a6b-b312c4379207 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: .version_select at 0x7f633bf75700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-902758818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfd8rnpqaba+7i4QJhoUg1BHR4QMEpg2l3YYW8D9rAStyukkS26conuUQxiEazpPEctOV8ZzBR7SA35qwuEsK8FcbURExWMKVi58Z4trHtypzzfypHJMaNrq1dtr9BdDg=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:20.296325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=14 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:20.297125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=34 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:20.310412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d9420957-7e89-4399-8a6b-b312c4379207 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for project 92ae27faa56d478db9d3a2050480dd89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:20.316214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d9420957-7e89-4399-8a6b-b312c4379207 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for user 567ce92749aa4698bd1666cdb8d2d380 and project 92ae27faa56d478db9d3a2050480dd89. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:20.339791 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9420957-7e89-4399-8a6b-b312c4379207 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053940 Oct 04 18:57:20.340575 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4296/6441] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 18:57:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:20.390567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:20.391373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:20.395364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1056364189", "imageRef": "7a5733d1-6720-47ad-b3c5-28ede9afef80", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-902758818", "networks": [{"uuid": "6f9e4f05-36f0-4b70-984e-88072287ad19"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:20.571059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] validate_networks() for [('6f9e4f05-36f0-4b70-984e-88072287ad19', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:20.973937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:20.974376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:20.974865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:20.975315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:20.975740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:20.984628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.985152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.985603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:20.986364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.987348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.987794 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:21.008197 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for project 92ae27faa56d478db9d3a2050480dd89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:21.013943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for user 567ce92749aa4698bd1666cdb8d2d380 and project 92ae27faa56d478db9d3a2050480dd89. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:21.026418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:21.028775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a5733d1-6720-47ad-b3c5-28ede9afef80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:21.076065 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-28453afd-97c4-4cf7-bb04-a506350194f7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687378 Oct 04 18:57:21.076838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2146/6442] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:57:21.087984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fc768ccb-a2c5-4dfa-b500-dbf85fa2c087 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:21.088598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fc768ccb-a2c5-4dfa-b500-dbf85fa2c087 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:21.145368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fc768ccb-a2c5-4dfa-b500-dbf85fa2c087 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:21.155341 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fc768ccb-a2c5-4dfa-b500-dbf85fa2c087 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1258 microversion: 2.1 time: 0.071052 Oct 04 18:57:21.156295 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4297/6443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:21 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:22.181068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:22.182132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:22.189617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:22.190647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:22.191132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:22.191856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:22.192356 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:22.192983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:22.281983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:22.294292 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b19431c0-48a2-46c0-a93c-65755e76b6d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1318 microversion: 2.1 time: 0.118263 Oct 04 18:57:22.294893 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2147/6444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:22 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:23.318251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:23.318798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:23.326013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.326513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.326956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.327834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.328612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.329264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.512872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:23.523695 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0db9d192-3251-4558-bfc6-9d865a155be4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.209523 Oct 04 18:57:23.524645 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4298/6445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:23 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:24.548541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:24.549389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:24.562046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.563550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.564732 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.567289 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.568281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.568886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.747399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:24.757694 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0dac891f-8864-428d-ab7d-27e8984f2c79 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.212895 Oct 04 18:57:24.758231 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2148/6446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:24 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:25.780512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:25.781140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:25.792811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.793310 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.793754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.794525 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.794930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.795393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.953036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:25.961974 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e76c36a7-b0a5-446f-a947-7fa0d1011876 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.185541 Oct 04 18:57:25.962598 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4299/6447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:25 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:26.985903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:26.986956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:26.994035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.994534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.994983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:26.995737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.996233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.996699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:27.165628 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:27.176895 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-42d710a2-b2a1-4ecc-84a0-164fba12a8a4 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.194459 Oct 04 18:57:27.178913 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2149/6448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:26 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:28.201552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:28.202539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:28.209559 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.210056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.210820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.211724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.212348 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.212784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.360489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:28.369526 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a1ea6ec7-b640-4773-9898-2d1fb042e456 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.172272 Oct 04 18:57:28.384815 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4300/6449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:28 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:29.405014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:29.405647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:29.419216 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.420304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.421031 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.422022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.422498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.422946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.563601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:29.572542 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94ecc239-d0b0-49e1-84b7-3d02677e7a18 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.172548 Oct 04 18:57:29.573137 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2150/6450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:29 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:30.596139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:30.596804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:30.604139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.604644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.605091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.605806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.606265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.606698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.844725 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.852699 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c04902ae-6fe8-41de-9c6d-ad64eb92da04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.260746 Oct 04 18:57:30.853304 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4301/6451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:30 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:30.996943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.021869 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.068021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:31.077976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.078477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.078929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.092445 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] Creating event network-changed:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 18:57:31.098404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-99844ca4-c718-41ec-937a-6d84be129335 req-bf03b3ad-33aa-4bf6-b299-aa72c7f465d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106931 Oct 04 18:57:31.099017 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2151/6452] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:31.879883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:31.881693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:31.883726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.890930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.891460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.891902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.892624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.893748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.894189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:32.031889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:32.040984 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bb43bddb-95ca-4ad1-a0ec-a1d3862d42ea tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.165530 Oct 04 18:57:32.041777 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4302/6453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:31 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:33.066119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:33.066826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:33.074731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.075186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.075684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.076410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.076886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.077333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.214137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:33.222715 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-65e0bcbe-d2cb-441d-ac89-cf7808c5fb2b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.161764 Oct 04 18:57:33.223325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2152/6454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:33 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:34.251223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:34.252161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:34.263936 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:34.264771 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:34.265723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.266866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:34.267572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:34.268214 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.429956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:34.438584 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3055d5e-d8f5-4564-a5b8-27a52f25fe29 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.194513 Oct 04 18:57:34.441951 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4303/6455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:34 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:34.623315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "name": "network-vif-plugged", "status": "completed", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:34.633239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:34.633799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:34.634247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.646449 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] Creating event network-vif-plugged:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 18:57:34.651486 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e2d16f4b-ee0c-4cb0-8969-e1fdad81670f req-6db1a992-135d-4079-8698-09f5160cf888 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090726 Oct 04 18:57:34.652109 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2153/6456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:35.467402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:35.468044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:35.475359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.475849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.476368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.477089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.477546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.478000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.610965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:35.619216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1d330616-017b-4f98-94b1-74d9defd5d8d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1358 microversion: 2.1 time: 0.155619 Oct 04 18:57:35.619897 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4304/6457] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:35 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:36.646501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:36.647850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:36.654779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.655589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.655776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.656498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.656965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.657417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.796361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:36.804750 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-80afdfb9-4a68-4b72-9bc5-44040f17f94c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1548 microversion: 2.1 time: 0.165524 Oct 04 18:57:36.805323 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2154/6458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:36 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:36.827499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:36.828117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:36.836756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.838985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.839482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.840737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.841217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.841660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.972998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:36.980816 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-257d0686-313a-430b-b9b9-bdf909a6ea3b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1548 microversion: 2.1 time: 0.157148 Oct 04 18:57:36.981534 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4305/6459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:36 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:37.004017 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:37.008882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:37.009668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Searching by: {'deleted': False, 'project_id': '92ae27faa56d478db9d3a2050480dd89'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:57:37.014977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.015496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.015945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.016681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.017146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.017587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.044106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:57:37.071478 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-82c667cb-766f-42a8-a367-08dd4b374aa0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071851 Oct 04 18:57:37.072072 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2155/6460] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 18:57:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:37.083714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:37.084455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:37.090746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.091224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.091673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.092377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.092836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.093263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.533397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:37.541489 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-656a78c2-4d38-42ea-bab1-6818ba7055ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1548 microversion: 2.1 time: 0.461670 Oct 04 18:57:37.542060 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4306/6461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:37 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1548 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:39.097641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "427d2aee-d3ce-41b1-8a4d-6fca701ec157"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:39.100048 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.106917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.107457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.107916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.108629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.109101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.109551 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.364790 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e8d0956-8d2c-4f5f-9469-68dc7a28ddf3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270618 Oct 04 18:57:39.370842 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2156/6462] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 18:57:39 2022] POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:52.464021 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.464673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.468330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:52.469001 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=54 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:52.475088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.475585 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.476030 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.476739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.477275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.477709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.610620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:52.619572 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c62627d6-ce32-4681-a949-92c44457bc31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1594 microversion: 2.1 time: 0.159438 Oct 04 18:57:52.620156 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4307/6463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:54.564570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:54.573541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:54.574640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:54.575523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:54.582560 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.583122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.583784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.599438 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] Creating event network-changed:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 18:57:54.605127 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-77893a10-a6e8-4968-b634-8b47d41e8c85 req-25a6f1ae-afd6-431b-b279-37dbdad58040 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044555 Oct 04 18:57:54.606447 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2157/6464] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:55.761698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1708406275"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:55.762246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:55.771838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.772343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.772788 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.773503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.774092 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.774542 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.909055 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Adding security group 6f5f658e-275e-4d99-9fe2-795f131dd33c to port f99ccd77-acae-4cf0-b966-20b6a98f66ea Oct 04 18:57:56.224031 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bddb64a3-e214-43a2-9d27-b59c29191ecc tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.466509 Oct 04 18:57:56.224694 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4308/6465] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:55 2022] POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:56.240632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:56.247473 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.247990 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.255826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.256347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.256800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.257537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.258011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.258463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.263784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.264324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.264767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.281080 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] Creating event network-changed:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 18:57:56.297201 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1983542c-fc06-42ca-ba5b-f5dee5be576f req-1291f5a5-b625-40de-9d1c-2d922e5fce5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060798 Oct 04 18:57:56.300935 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4309/6466] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:56.525538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:56.535148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d11d6cf6-09d4-43d2-8f9f-f875f1229845 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1759 microversion: 2.1 time: 0.305513 Oct 04 18:57:56.535977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2158/6467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1759 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:34.089210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:34.089950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:34.096637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:34.098900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:34.105671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.106152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.106589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.107307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.107762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.108189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.184024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cb849a91-0242-40f9-9690-5ed7012f1e97 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.096874 Oct 04 18:59:34.185455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4310/6468] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 18:59:34 2022] POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:59:34.192829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:34.193689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:34.198477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:34.199165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:34.209019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.209539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.210418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.211173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.211655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.212100 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.467644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:34.476274 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4664da9e-a25b-46c5-823b-d1367473c5ff tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1761 microversion: 2.1 time: 0.285861 Oct 04 18:59:34.476844 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2159/6469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:34 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1761 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:35.503888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:35.504592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:35.511905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.512394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.512839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.514040 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.514504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.514931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.664880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:35.673840 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d6fbccc5-4362-4d60-842c-0fa86d178cdb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1759 microversion: 2.1 time: 0.174201 Oct 04 18:59:35.674414 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4311/6470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:35 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:48.353650 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:00:48.354457 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:00:48.355420 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:00:48.355571 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action (ip 10.222.0.33) !!! Oct 04 19:00:48.357355 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:00:48.357489 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action (ip 10.222.0.33) !!! Oct 04 19:00:48.358434 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:00:48.358549 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action (ip 10.222.0.33) !!! Oct 04 19:00:48.359531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:48.360293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:48.365494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1708406275"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:48.366176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:48.377978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.378468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.378914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.379642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.380107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.380626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.509838 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.network.security_group_api [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Removing security group 6f5f658e-275e-4d99-9fe2-795f131dd33c from port f99ccd77-acae-4cf0-b966-20b6a98f66ea Oct 04 19:00:48.812804 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c7be064a-8794-4834-aa51-2e118f8bcfd0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action" status: 202 len: 0 microversion: 2.1 time: 0.461018 Oct 04 19:00:48.817423 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2160/6471] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:00:48 2022] POST /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:48.821617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:48.822716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:48.826635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:48.841318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.841950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.842451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.856947 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] Creating event network-changed:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 19:00:48.862399 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f5635d41-1d5c-4734-9fbe-c294db4b32e3 req-ab4e4a18-680e-4c6a-a26c-1615ec49d4c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043002 Oct 04 19:00:48.863492 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4312/6472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:50.083939 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59536. Oct 04 19:00:50.084916 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59534. Oct 04 19:00:50.126677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:50.127425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:50.134280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.134846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.135395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.136167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.136633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.137059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.161224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:50.172965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.173512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.173962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.185152 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] Creating event network-changed:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 19:00:50.192096 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5bd23075-facf-40c9-ac7a-89cbc2240ae6 req-5b596b6f-cf6b-4abc-a6e8-0b3b4079b269 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127875 Oct 04 19:00:50.193040 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2161/6473] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:50.232089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lazy-loading 'services' on Instance uuid 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:50.326807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-518cc5fb-9070-4849-ace5-57936052c32d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments/427d2aee-d3ce-41b1-8a4d-6fca701ec157" status: 202 len: 0 microversion: 2.1 time: 0.207993 Oct 04 19:00:50.328041 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4313/6474] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 19:00:50 2022] DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments/427d2aee-d3ce-41b1-8a4d-6fca701ec157 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:00:50.337753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:50.340673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:50.349087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.349944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.350665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.351667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.352201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.352804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.395327 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fc29bd80-8a03-425e-b4f2-13cdcf376beb tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061768 Oct 04 19:00:50.400826 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2162/6475] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:50 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:51.409352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:51.411678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:51.419266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.419767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.420215 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.420927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.421391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.421826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.451368 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f955db48-8a06-4d18-95f1-48fb60524603 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 Oct 04 19:00:51.451944 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4314/6476] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:51 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:52.464393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:52.466552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:52.473962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.474456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.474908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.475644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.476104 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.476535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.506154 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6910ab38-e863-4322-85fc-cd675377716c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Oct 04 19:00:52.506717 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2163/6477] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:52 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:53.521231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:53.523487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:53.529539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.530031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.530474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.531199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.531660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.532088 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.561715 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0b4bcc89-2e08-4497-ae7b-b7e4793b27cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Oct 04 19:00:53.562285 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4315/6478] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:53 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:54.574855 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:54.577064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:54.584522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.585027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.585480 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.586194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.586960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.587124 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.617627 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-41525462-65ee-448d-847c-00c17f42c086 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046764 Oct 04 19:00:54.618199 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2164/6479] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:54 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:55.630248 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:55.632460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:55.639339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.639832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.640275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.640971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.641429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.641904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.671249 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c42c0842-3c58-4582-b53c-e7bbd22eec3f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044993 Oct 04 19:00:55.671812 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4316/6480] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:55 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:00:55.683175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:55.683678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:55.690554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.691079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.691539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.692249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.692723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.693175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.768945 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] HTTP exception thrown: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 is not attached to volume 427d2aee-d3ce-41b1-8a4d-6fca701ec157 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Request method failure captured: Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments/427d2aee-d3ce-41b1-8a4d-6fca701ec157 HTTP/1.1 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIIAkDn75ymdlbmnD1qaCwQ-iSqmam_fXO72_YOVhxg3tr-zsRAGwACYCFKwvwng3IKkAufMQWg6XDzTOK2rh52m8KwQG2jzC8OOkCYkgeygFEMUgPQFH-WBf6GJ9a9JJUokPeSzCIP0yZHAWbWVwAKrQuKyGLxpp5gbAdfV5dV-v_w Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 567ce92749aa4698bd1666cdb8d2d380 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 is not attached to volume 427d2aee-d3ce-41b1-8a4d-6fca701ec157 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0', 'id': '427d2aee-d3ce-41b1-8a4d-6fca701ec157'} Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 427d2aee-d3ce-41b1-8a4d-6fca701ec157. Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 is not attached to volume 427d2aee-d3ce-41b1-8a4d-6fca701ec157 Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:55.771102 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 is not attached to volume 427d2aee-d3ce-41b1-8a4d-6fca701ec157 Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Returning 404 to user: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 is not attached to volume 427d2aee-d3ce-41b1-8a4d-6fca701ec157 {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3a45b0e3-8adb-49bb-9df0-39f1339ac282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments/427d2aee-d3ce-41b1-8a4d-6fca701ec157" status: 404 len: 154 microversion: 2.1 time: 0.093480 Oct 04 19:00:55.775224 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2165/6481] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 19:00:55 2022] DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0/os-volume_attachments/427d2aee-d3ce-41b1-8a4d-6fca701ec157 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:59.031135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:59.031676 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:59.039324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.039821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.040264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.040979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.041434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.041865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.070185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:59.146486 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b5d094bc-943c-4495-b9b2-89a565f84970 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 204 len: 0 microversion: 2.1 time: 0.118886 Oct 04 19:00:59.147142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4317/6482] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:59 2022] DELETE /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:59.156209 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:59.156960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:59.165481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.165985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.166461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.167238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.167704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.168204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.306988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.315191 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c42f3193-38bf-4431-911a-aa6fa50e8470 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1554 microversion: 2.1 time: 0.162871 Oct 04 19:00:59.315773 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2166/6483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:59 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:00.339059 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.339696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.347362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.347849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.348281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.348973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.349427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.349857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.479781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:00.487664 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1372bbf1-55aa-4f02-aa6c-959655662f04 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1554 microversion: 2.1 time: 0.153023 Oct 04 19:01:00.488250 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4318/6484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:00 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:01.162694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0", "name": "network-vif-deleted", "tag": "f99ccd77-acae-4cf0-b966-20b6a98f66ea"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:01.173913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.174400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.174846 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.186655 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] Creating event network-vif-deleted:f99ccd77-acae-4cf0-b966-20b6a98f66ea for instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 on n-h2-831193-17 Oct 04 19:01:01.192263 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3b221c6f-489c-4ced-9a58-2430ffdde6a0 req-46ccf8d4-41f4-4bd0-b0e9-729ca9c3da3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Oct 04 19:01:01.192872 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2167/6485] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:01.511376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:01.512226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:01.519445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.519956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.520401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.521123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.521584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.522022 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.558404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.558897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.559373 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.559834 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lazy-loading 'fault' on Instance uuid 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:01.609609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:01.618239 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-67531629-6440-47d4-bfcd-696d8ad0fe22 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 200 len: 1348 microversion: 2.1 time: 0.110742 Oct 04 19:01:01.619435 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4319/6486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:01 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 1348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:02.642972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.643741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:02.649947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.650441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.650891 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.651623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.652092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.652532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.666194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] HTTP exception thrown: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Request method failure captured: Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 HTTP/1.1 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIIAkDn75ymdlbmnD1qaCwQ-iSqmam_fXO72_YOVhxg3tr-zsRAGwACYCFKwvwng3IKkAufMQWg6XDzTOK2rh52m8KwQG2jzC8OOkCYkgeygFEMUgPQFH-WBf6GJ9a9JJUokPeSzCIP0yZHAWbWVwAKrQuKyGLxpp5gbAdfV5dV-v_w Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 567ce92749aa4698bd1666cdb8d2d380 Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0'} Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:02.667899 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Returning 404 to user: Instance 60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f6bb85ef-0373-45e6-b40f-da6da6b73282 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0" status: 404 len: 111 microversion: 2.1 time: 0.031471 Oct 04 19:01:02.672470 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2168/6487] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:02 2022] GET /compute/v2.1/servers/60c0d438-8ea6-466b-bcdb-4edd8ab8b2c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:02.678930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f292c15b-83d5-4e4d-8343-34411ad6812b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '.version_select at 0x7f63400b3ee0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.699898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f292c15b-83d5-4e4d-8343-34411ad6812b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-902758818" status: 202 len: 0 microversion: 2.1 time: 0.024748 Oct 04 19:01:02.700485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4320/6488] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 19:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-902758818 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:01:11.904803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6da316a-0a4f-4c64-9c81-fd64e58b2e8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: .version_select at 0x7f6340f27ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-65882069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkEj4IHo/2c1wBEJFrhHFg06AMmPRMgVmA8x6GAll7wbAOWy9Cew7gUkTrQDQrUe6JFAGerB5Lin+EtbGg/4l/Qa+ehNLJWD5AxZsTCexeq3ja1zSCmW5UVGC5aeMveOA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:11.921997 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a6da316a-0a4f-4c64-9c81-fd64e58b2e8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for project 92ae27faa56d478db9d3a2050480dd89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:11.927653 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-a6da316a-0a4f-4c64-9c81-fd64e58b2e8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for user 567ce92749aa4698bd1666cdb8d2d380 and project 92ae27faa56d478db9d3a2050480dd89. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:11.954646 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6da316a-0a4f-4c64-9c81-fd64e58b2e8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.053401 Oct 04 19:01:11.955433 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2169/6489] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:01:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:12.010641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:12.014715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1010218570", "imageRef": "f1ae55f9-70af-4329-8e0c-44d8b251ed77", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-65882069", "networks": [{"uuid": "6f9e4f05-36f0-4b70-984e-88072287ad19"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:12.068307 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] validate_networks() for [('6f9e4f05-36f0-4b70-984e-88072287ad19', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:12.502528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:12.502953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:12.503458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:12.503874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:12.504284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:12.512862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.513337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.513767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.514490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.514941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.515402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.536539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for project 92ae27faa56d478db9d3a2050480dd89. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:12.541931 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Getting quotas for user 567ce92749aa4698bd1666cdb8d2d380 and project 92ae27faa56d478db9d3a2050480dd89. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:12.554477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:12.556740 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1ae55f9-70af-4329-8e0c-44d8b251ed77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:12.600864 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:01:13.608481 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59690. Oct 04 19:01:13.612337 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f6a4c936-f317-46eb-93d6-fb80c30c75f0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603544 Oct 04 19:01:13.613035 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4321/6490] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:13.621161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=40 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:13.626824 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f47d09cd-7645-4e9c-82bc-dd6af78e9d7c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:13.627505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f47d09cd-7645-4e9c-82bc-dd6af78e9d7c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:13.682098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f47d09cd-7645-4e9c-82bc-dd6af78e9d7c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.689625 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f47d09cd-7645-4e9c-82bc-dd6af78e9d7c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1257 microversion: 2.1 time: 0.069283 Oct 04 19:01:13.690196 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2170/6491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:13 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:14.715418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f5ed23d3-9962-4959-b1d6-ad3d971670ba tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:14.716041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f5ed23d3-9962-4959-b1d6-ad3d971670ba tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:14.770470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f5ed23d3-9962-4959-b1d6-ad3d971670ba tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:14.777843 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f5ed23d3-9962-4959-b1d6-ad3d971670ba tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1257 microversion: 2.1 time: 0.067812 Oct 04 19:01:14.778432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4322/6492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:14 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:15.801075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b820a29-24a3-42a2-aa22-0b6e8a030cf2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:15.801796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b820a29-24a3-42a2-aa22-0b6e8a030cf2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:15.861409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b820a29-24a3-42a2-aa22-0b6e8a030cf2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.868504 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b820a29-24a3-42a2-aa22-0b6e8a030cf2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1257 microversion: 2.1 time: 0.071640 Oct 04 19:01:15.869173 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2171/6493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:15 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:16.893387 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62bed2f3-a3ae-4ef1-a87c-e6d72e0f35b9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:16.894007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-62bed2f3-a3ae-4ef1-a87c-e6d72e0f35b9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:16.947313 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-62bed2f3-a3ae-4ef1-a87c-e6d72e0f35b9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.954671 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62bed2f3-a3ae-4ef1-a87c-e6d72e0f35b9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1257 microversion: 2.1 time: 0.065137 Oct 04 19:01:16.955485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4323/6494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:16 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:17.978777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.979423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.986642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.987194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.987644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.988341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.988804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.989240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:18.052994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:18.061188 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c9b8af4b-86e4-47bd-be5d-39a84009af25 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1261 microversion: 2.1 time: 0.086243 Oct 04 19:01:18.061709 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2172/6495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:19.086389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.087773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:19.106347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:19.108396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.109159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.109913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.110923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.111748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.112433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.305342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:19.317728 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-044a3026-9cc9-427d-bfc4-b32b2e31e8a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1315 microversion: 2.1 time: 0.235707 Oct 04 19:01:19.319026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4324/6496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:19 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:20.342533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:20.343298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:20.349203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:20.351019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.351564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.352102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.352825 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.353299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.353923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.519291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.529224 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6e24655a-9a11-4f67-8402-10945e55d8da tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.190920 Oct 04 19:01:20.529832 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2173/6497] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:20 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:21.552778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:21.554264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:21.562020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:21.562512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:21.562946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.563703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:21.564226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:21.564839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.712282 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:21.723902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-01c3c8cb-2e9f-4580-973a-1e0b78ef56a7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.174896 Oct 04 19:01:21.724500 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4325/6498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:21 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:22.749429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:22.751206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.758850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.759394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.759850 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.760592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.761054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.761513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.915947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.924060 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b4ad7187-5cd7-4590-b4bc-538643f3b855 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.179626 Oct 04 19:01:22.924837 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2174/6499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:22 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:23.947580 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.948405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.950304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:23.957399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.957902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.958345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.959081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.962600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.963054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.109124 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.117659 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83011076-e889-4384-a38f-90bf87855191 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.174417 Oct 04 19:01:24.118227 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4326/6500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.144316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.144890 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.151886 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.152382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.152829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.153537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.153998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.154432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.306925 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:25.316770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9e8eabb9-1a70-4831-8abf-04e42207c78f tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.176327 Oct 04 19:01:25.317374 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2175/6501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:26.343147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:26.343790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:26.350686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.351200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.351663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.352371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.352930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.353299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.492267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.500092 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c3b4612d-1ffe-480f-9bd3-5629e467e272 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.160874 Oct 04 19:01:26.501181 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4327/6502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:26 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:27.516493 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:27.523677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:27.524665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:27.533868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:27.536190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:27.542053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.542546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.542983 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.544372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.544883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.545343 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.546067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.546532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.546976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.555617 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] Creating event network-changed:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:01:27.560921 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f784471b-c4c7-47f4-8faa-04351b5c7e06 req-b71d427b-e1e9-4989-996e-84c7544d4f32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048430 Oct 04 19:01:27.562022 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2176/6503] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:27.690877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.699481 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fcd156fe-5eb9-4e97-90a2-b1cdcf6dba31 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.179726 Oct 04 19:01:27.700079 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4328/6504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:27 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:28.724764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.725483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.731816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.732315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.732772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.733481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.733947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.734390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.871329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.879660 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d9743d4b-5ad0-4f8c-9b98-6da3062282c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.160074 Oct 04 19:01:28.880222 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2177/6505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.902643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.903311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.910818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.911342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.911791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.912490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.912952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.913414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.044361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.052558 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-afe9f64d-da6b-4613-bb5e-dbe32f9ad61d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.153855 Oct 04 19:01:30.053146 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4329/6506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:31.075383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:31.075927 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:31.083414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.083915 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.084367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.085068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.085536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.085977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.223479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:31.231891 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-411eeb92-e5e9-4932-b6a5-3d5149d9a8a6 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.160509 Oct 04 19:01:31.232473 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2178/6507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:31 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:32.254928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:32.255536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:32.263186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.263675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.264117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.264812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.265276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.265703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.397276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.405034 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e695bcc3-2da1-4388-bd5d-6d30e2d4a34a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.154041 Oct 04 19:01:32.405611 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4330/6508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:32 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:33.428122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.428742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.435753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.436247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.436693 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.437389 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.437853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.438307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.568621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:33.576341 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6955096a-2096-4f7a-b53f-e3ca1f7163ec tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.152149 Oct 04 19:01:33.576927 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2179/6509] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:34.599704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:34.600315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:34.607206 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.607690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.608128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.608817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.609272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.609702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.746948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.755493 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ff776fd-5caa-4e82-a376-ec8843c2470c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.159601 Oct 04 19:01:34.756287 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4331/6510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:34 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:34.800421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "name": "network-vif-plugged", "status": "completed", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:34.811935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.812308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.812758 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.827842 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] Creating event network-vif-plugged:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:01:34.833244 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6baa7017-df59-4d5d-a464-b7ce21794a97 req-036b6ef8-1585-4343-8867-a95c32083f2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037144 Oct 04 19:01:34.834065 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2180/6511] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:35.780901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.781512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.788697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.789455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.789908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.790610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.791075 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.791504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.927378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:35.935902 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-14f14cc6-d12a-4694-9de1-e0ddffcfcd8a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1357 microversion: 2.1 time: 0.158817 Oct 04 19:01:35.936477 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4332/6512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:36.967230 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.967951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.974303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.974791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.975275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.975986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.976464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.976898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.112793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.121227 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2ddcde72-900f-4fb5-a95f-3bcf44ee4bc2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1547 microversion: 2.1 time: 0.159133 Oct 04 19:01:37.121847 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2181/6513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:36 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:37.144118 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.144733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.151622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.152110 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.152555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.153259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.153721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.154160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.287496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.295876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-409a9fa1-2e7c-44ae-b079-d0696dc61dc0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1547 microversion: 2.1 time: 0.155571 Oct 04 19:01:37.296467 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4333/6514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:37.319888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.324585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.325369 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Searching by: {'deleted': False, 'project_id': '92ae27faa56d478db9d3a2050480dd89'} {{(pid=128771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:01:37.330913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.331448 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.331892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.332626 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.333081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.333522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.358181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.multi_cell_list [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:01:37.388360 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1702d7ed-bc9c-4d47-a986-519c40c458b8 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072798 Oct 04 19:01:37.388874 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2182/6515] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:37.400950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.401570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.407837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.408335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.408783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.409486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.409951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.410404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.564005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.572900 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3d83467f-126f-4d4d-b1df-a23da2d4fcda tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1547 microversion: 2.1 time: 0.175658 Oct 04 19:01:37.573624 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4334/6516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:39.113412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d38b62c-80ad-42d2-9df2-e1b64e87708b"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:39.115836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:39.122795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.123322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.123777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.124522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.124991 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.125435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.372781 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9892a81d-6c50-449c-af84-30b74f5fdd96 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263916 Oct 04 19:01:39.373397 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2183/6517] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 19:01:39 2022] POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:50.237747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:50.238438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:50.241765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=21 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:50.243227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=68 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:50.248527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.249023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.249462 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.250252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.250709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.251171 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.389149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:50.398930 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-79c4e9bb-02ec-4a78-a22a-6f4e884ccec0 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1593 microversion: 2.1 time: 0.165697 Oct 04 19:01:50.399560 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4335/6518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:50 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:52.112970 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:52.113883 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=21 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:52.114655 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:52.119969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:52.132271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:52.132803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:52.133254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:52.147161 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] Creating event network-changed:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:01:52.152854 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a6b03c5b-c599-424e-acbf-98ee2ecf0902 req-450cb21e-8708-41fa-b191-8435637494dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042064 Oct 04 19:01:52.153469 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2184/6519] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:53.416974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1271926588"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:53.417577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:53.423900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.424394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.424845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:53.425591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.426056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.426487 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:53.569638 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.network.security_group_api [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Adding security group 41e83d5f-5da7-431a-85a2-629f344c53ee to port 9620aa64-7cf7-427a-b5ec-add20210650b Oct 04 19:01:53.909742 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-183e0908-4b33-469f-a7a9-a42361a127ab tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.497125 Oct 04 19:01:53.910524 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4336/6520] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:01:53 2022] POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:01:53.920462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:53.921288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:53.928068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.928806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.929275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:53.930000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:53.930627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:53.931261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.094361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:54.102806 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9851e8d-ebdc-4f5a-8d99-de346020555c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1758 microversion: 2.1 time: 0.187358 Oct 04 19:01:54.103430 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2185/6521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:53 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:54.169153 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:54.178858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.179383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.179822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.194318 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] Creating event network-changed:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:01:54.199534 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-3508d126-3b45-4fb6-b990-02310e77f1c3 req-b13bb37a-d97d-43ed-a9fa-ab2530ba7411 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035547 Oct 04 19:01:54.200390 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4337/6522] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:09.100921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:09.103200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.106106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:09.106776 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:09.113444 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.113974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.114458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.115192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.115664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.116160 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.192180 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-3db40bdb-7e8e-469b-9eaf-01cef2fca0cf tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.095146 Oct 04 19:02:09.192831 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2186/6523] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:09 2022] POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:09.199966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:09.200723 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:09.205346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.206665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.213899 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.214396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.214841 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.215672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.216134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.216570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.367236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:09.375544 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8513c75e-f890-40c6-9188-c2e0ef5ce325 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1750 microversion: 2.1 time: 0.177800 Oct 04 19:02:09.376142 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4338/6524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:10.445320 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:10.446030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:10.452292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.452785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.453233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.453930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.454394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.454831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.598046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:10.606704 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-12933381-eec3-4b09-b70a-69f41876149e tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.210991 Oct 04 19:02:10.607316 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2187/6525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:10 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:11.630097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:11.630710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:11.637765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.638253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.638693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.639419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.639878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.640308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.789503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:11.797875 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fcb2b73d-44b5-4ee4-9016-a9fda6efc1fd tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.171690 Oct 04 19:02:11.798455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4339/6526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:11 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:12.826552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:12.827665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:12.834601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.835263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.835739 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.836477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.836941 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.837380 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.980730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:12.989414 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b35a0185-c664-4f43-81d3-0414e1d7f5c9 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.170039 Oct 04 19:02:12.989977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2188/6527] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:12 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:14.013161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:14.013779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:14.020702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.021192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.021643 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.022347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:14.022816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:14.023270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:14.177029 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:14.187696 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6d5de6f2-6ae3-41b2-ab7c-788abf0922d1 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.178308 Oct 04 19:02:14.188225 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4340/6528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:14 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:15.211816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:15.212442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:15.219301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.219823 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.220274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:15.220982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:15.221449 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:15.221889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:15.362001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:15.371332 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6d77f908-2815-4081-a86e-7bbe3f9ef271 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.163318 Oct 04 19:02:15.371933 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2189/6529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:15 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:16.393803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:16.394519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:16.401358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:16.401868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:16.402286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:16.402982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:16.403466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:16.403896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:16.544989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:16.553744 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-31212f51-7007-40eb-b823-071287d41be3 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.163861 Oct 04 19:02:16.554348 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4341/6530] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:16 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:17.577856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:17.578471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:17.585972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.586463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.586911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:17.587645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:17.588110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:17.588546 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:17.738117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:17.746620 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d1537731-089b-453b-8773-53972db8d8c2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.172616 Oct 04 19:02:17.747219 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2190/6531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:17 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:18.771576 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:18.772231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:18.779160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.779652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.780094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.780794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.781253 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.781684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.923968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:18.932216 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d988a19f-438a-4951-b28f-a36d478fe593 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.165188 Oct 04 19:02:18.932799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4342/6532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:18 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:19.955549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:19.956180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:19.963785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.964284 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.964740 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:19.965476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.965973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.966419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.160344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:20.170190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e0664abe-6f4a-488f-afe6-b22662d2c61c tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1755 microversion: 2.1 time: 0.218441 Oct 04 19:02:20.170760 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2191/6533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:19 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:21.198791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:21.199600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:21.207792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.208293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.208729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.209442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.209895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.210320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.360696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:21.369079 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4b365d9d-91db-475a-ae47-1f931638243a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1758 microversion: 2.1 time: 0.179126 Oct 04 19:02:21.369661 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4343/6534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:21 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:53.721308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1271926588"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:53.722079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.724995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:53.725842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:53.733974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.733974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.733974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.733974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.740268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.740268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.882939 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.network.security_group_api [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Removing security group 41e83d5f-5da7-431a-85a2-629f344c53ee from port 9620aa64-7cf7-427a-b5ec-add20210650b Oct 04 19:02:54.518530 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-71482284-2644-4e0e-9040-15e822700638 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.801066 Oct 04 19:02:54.523343 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2192/6535] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:53 2022] POST /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:54.529907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=12 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:54.532805 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:54.606593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:54.622827 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.623441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.623997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.637954 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] Creating event network-changed:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:02:54.651406 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ab0e03df-849f-4d0c-8ad8-6276cd75678a req-067cbea7-36cf-43e9-b614-59ff3169822e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126804 Oct 04 19:02:54.653855 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4344/6536] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:55.688097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.688652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.695143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.695640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.696087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.696795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.697256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.697690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.787518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lazy-loading 'services' on Instance uuid 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:55.890693 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d7c63911-2968-4540-b6e2-ead61e81437b tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments/5d38b62c-80ad-42d2-9df2-e1b64e87708b" status: 202 len: 0 microversion: 2.1 time: 0.206254 Oct 04 19:02:55.891923 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2193/6537] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 19:02:55 2022] DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments/5d38b62c-80ad-42d2-9df2-e1b64e87708b => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:55.911861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.916957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.928721 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.929547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.930563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.931807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.932829 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.933794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.971248 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b3c87ff1-1ece-4d7d-a570-394ba7b00180 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072389 Oct 04 19:02:55.975229 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4345/6538] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:56.675430 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.697792 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.699592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.700268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.716952 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] Creating event network-changed:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:02:56.724095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-db38f6ac-7c15-4501-be4a-bed900f55bd7 req-cd0dd645-3e2f-4c83-8c86-73b276402d0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056074 Oct 04 19:02:56.725026 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2194/6539] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:56.987105 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:56.990166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:56.999226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.000273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.001912 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.002987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.003825 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.004386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.059733 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f013ecc3-3fb5-43da-b0ed-c7b2b1cf7741 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078180 Oct 04 19:02:57.061196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4346/6540] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:02:56 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:58.073523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.076049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.085937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.086435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.087171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.087633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.088112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.088555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.140483 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ad5e649d-68fc-4a66-a4c2-69efb33ffac2 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071467 Oct 04 19:02:58.141660 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2195/6541] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:59.152698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:59.154801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:59.161734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.162239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.163465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.163465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.163866 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.164365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.198020 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-dda41eef-c916-434d-a5c9-bda9fd7fd349 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049380 Oct 04 19:02:59.198623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4347/6542] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:02:59 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:00.216779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.218986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.226833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.227447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.228072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.228641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.229113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.229559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.264221 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a634bbfd-5910-4762-a435-4241bbe0c62a tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051663 Oct 04 19:03:00.265541 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2196/6543] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:01.277500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.279852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.286695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.287223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.287670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.288386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.289003 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.289444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.319380 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e002320f-a864-41ea-95d7-4169f259770d tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045783 Oct 04 19:03:01.319962 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4348/6544] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:03:01.331602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.332137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.339085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.339593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.340051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.340799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.341270 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.341745 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.419287 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] HTTP exception thrown: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 is not attached to volume 5d38b62c-80ad-42d2-9df2-e1b64e87708b Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Request method failure captured: Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: request: DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments/5d38b62c-80ad-42d2-9df2-e1b64e87708b HTTP/1.1 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIIAkDn75ymdlbmnD1qaCwQ-iSqmam_fXO72_YOVhxg3tr-zsRAGwACYCFKwvwng3IKkAufMQWg6XDzTOK2rh52m8KwQG2jzC8OOkCYkgeygFEMUgPQFH-WBf6GJ9a9JJUokPeSzCIP0yZHAWbWVwAKrQuKyGLxpp5gbAdfV5dV-v_w Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 567ce92749aa4698bd1666cdb8d2d380 Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 is not attached to volume 5d38b62c-80ad-42d2-9df2-e1b64e87708b Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'server_id': '866aa79a-fd40-47a3-8cf0-c058e0fb0ab7', 'id': '5d38b62c-80ad-42d2-9df2-e1b64e87708b'} Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5d38b62c-80ad-42d2-9df2-e1b64e87708b. Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 is not attached to volume 5d38b62c-80ad-42d2-9df2-e1b64e87708b Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.420976 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 is not attached to volume 5d38b62c-80ad-42d2-9df2-e1b64e87708b Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Returning 404 to user: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 is not attached to volume 5d38b62c-80ad-42d2-9df2-e1b64e87708b {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-681e4020-ab6e-4c8b-8845-726418b42b41 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments/5d38b62c-80ad-42d2-9df2-e1b64e87708b" status: 404 len: 154 microversion: 2.1 time: 0.095700 Oct 04 19:03:01.425145 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2197/6545] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 19:03:01 2022] DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7/os-volume_attachments/5d38b62c-80ad-42d2-9df2-e1b64e87708b => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:04.684137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.684638 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.692388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.692885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.693330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.694044 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.694504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.694939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.720739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:04.807981 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d96b7325-c2ca-413e-aae7-b4f1278ebe89 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 204 len: 0 microversion: 2.1 time: 0.126980 Oct 04 19:03:04.808788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4349/6546] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:04 2022] DELETE /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:04.817186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.817888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.827514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.828138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.828847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.829797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.830527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.831201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.983675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:04.992253 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0290c800-dacc-4a3d-80db-2792b319c740 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1553 microversion: 2.1 time: 0.179279 Oct 04 19:03:04.992852 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2198/6547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:04 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:06.017146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:06.017855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:06.028399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.028890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.029339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.030052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.030519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.030952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.171959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:06.181428 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ba4e71e1-d9dd-4f5c-add5-cf283505abc7 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1553 microversion: 2.1 time: 0.168591 Oct 04 19:03:06.182054 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4350/6548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:06 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:06.915523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866aa79a-fd40-47a3-8cf0-c058e0fb0ab7", "name": "network-vif-deleted", "tag": "9620aa64-7cf7-427a-b5ec-add20210650b"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:06.929410 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.929916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.930372 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.943504 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] Creating event network-vif-deleted:9620aa64-7cf7-427a-b5ec-add20210650b for instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 on n-h1-831193-17 Oct 04 19:03:06.949371 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a20fd80d-aa1e-4d0c-a4f4-36a61c76f614 req-f0cca139-efdb-41bd-8d47-4fb2d21246f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038026 Oct 04 19:03:06.949997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2199/6549] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:07.205140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:07.206617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:07.214115 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.214615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.215087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.215811 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.216272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.216705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.250201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.250692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.251162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.251625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lazy-loading 'fault' on Instance uuid 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:07.304039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567ce92749aa4698bd1666cdb8d2d380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ae27faa56d478db9d3a2050480dd89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:07.312624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-038e2bab-938b-425d-b293-2c1d8bb837a5 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 200 len: 1347 microversion: 2.1 time: 0.111350 Oct 04 19:03:07.327415 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4351/6550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:08.339808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.340522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] [instance: 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:08.347718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.348214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.348665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.349361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.349835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.350367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.365993 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] HTTP exception thrown: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Request method failure captured: Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 HTTP/1.1 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIIAkDn75ymdlbmnD1qaCwQ-iSqmam_fXO72_YOVhxg3tr-zsRAGwACYCFKwvwng3IKkAufMQWg6XDzTOK2rh52m8KwQG2jzC8OOkCYkgeygFEMUgPQFH-WBf6GJ9a9JJUokPeSzCIP0yZHAWbWVwAKrQuKyGLxpp5gbAdfV5dV-v_w Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92ae27faa56d478db9d3a2050480dd89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 92ae27faa56d478db9d3a2050480dd89 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-558642678 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 567ce92749aa4698bd1666cdb8d2d380 Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestMinimumBasicScenario-558642678-project Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '866aa79a-fd40-47a3-8cf0-c058e0fb0ab7'} Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:08.367659 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Returning 404 to user: Instance 866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0300b113-c57b-4266-87d5-caead3370592 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7" status: 404 len: 111 microversion: 2.1 time: 0.033550 Oct 04 19:03:08.372443 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2200/6551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:08 2022] GET /compute/v2.1/servers/866aa79a-fd40-47a3-8cf0-c058e0fb0ab7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:08.380235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83535f81-f62c-42c8-9695-8b1785cca177 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] Calling method '.version_select at 0x7f63400d38b0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.400038 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83535f81-f62c-42c8-9695-8b1785cca177 tempest-TestMinimumBasicScenario-558642678 tempest-TestMinimumBasicScenario-558642678-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65882069" status: 202 len: 0 microversion: 2.1 time: 0.024146 Oct 04 19:03:08.400619 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4352/6552] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 19:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-65882069 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:17.951396 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-08f96be0-048f-4bd5-b105-0723642855fb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: .version_select at 0x7f6340f6e670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-570766910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxiEVQCOEmUVtSDhY6wFKzMGRCFottjuaRV7uKiLHDJE/4JbJWuhY5QXYd56LlZv8H2DXv9Iy7m5hEK2wVe1HbUMvClDcSqQiHqutZItfiTXu0Q7aCSZ7P3XPDZg/e+DA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:17.967228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-08f96be0-048f-4bd5-b105-0723642855fb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:17.973222 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-08f96be0-048f-4bd5-b105-0723642855fb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:18.000108 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-08f96be0-048f-4bd5-b105-0723642855fb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.234761 Oct 04 19:03:18.000731 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2201/6553] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:03:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:24.914450 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-639315183", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "39c70502-f8cf-45b0-bea8-21532054770a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-570766910", "security_groups": [{"name": "tempest-secgroup-smoke-22613420"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:24.926778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:24.928309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:25.082923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] validate_networks() for [('39c70502-f8cf-45b0-bea8-21532054770a', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:25.540708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:25.541255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:25.541737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:25.542151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:25.542570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:25.552293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.552795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.553231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.553955 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.554412 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.554850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.572522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:25.577842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:25.592477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:25.594790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:25.646615 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6f4657fb-715b-4145-ac98-96322070d080 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.736297 Oct 04 19:03:25.653899 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4353/6554] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:25.656565 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:25.662333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f03ad6b-8816-421d-95e4-ca270c4c2a00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.663509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1f03ad6b-8816-421d-95e4-ca270c4c2a00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.665882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:25.734519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1f03ad6b-8816-421d-95e4-ca270c4c2a00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.744561 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f03ad6b-8816-421d-95e4-ca270c4c2a00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1265 microversion: 2.1 time: 0.088885 Oct 04 19:03:25.746123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2202/6555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:26.771684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:26.772241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:26.779437 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.780293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.780844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.781690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.782263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.782798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.852591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.865240 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c00d061d-fea0-4627-a5a7-aefc34224da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1317 microversion: 2.1 time: 0.098967 Oct 04 19:03:26.870491 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4354/6556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:26 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1317 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:27.894553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.898829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.919060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.923908 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.924494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.926689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.927206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.927977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.222934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.239513 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c0944aa4-6d63-493d-ad09-14a11161bc8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.354034 Oct 04 19:03:28.244803 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2203/6557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:28.760506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b13870-23ec-4c6a-b6be-ad3870dc3d61", "tag": "cf898b5c-8065-417b-bec8-2ea407ab2136"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:28.787555 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.788243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.789319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.805872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] Creating event network-changed:cf898b5c-8065-417b-bec8-2ea407ab2136 for instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 on n-h2-831193-17 Oct 04 19:03:28.813492 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f73d24e4-b431-4682-b475-47a3363fc742 req-efcf74bc-e383-420e-979d-ad877fc51759 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060586 Oct 04 19:03:28.815005 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4355/6558] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:29.262716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:29.263416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:29.270947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.271482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.271946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.272667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.273149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.273600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.411083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:29.419209 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d518eb4f-9e20-4577-a9d6-9707f5691aec tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.160394 Oct 04 19:03:29.419819 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2204/6559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:29 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:30.445050 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:30.445762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:30.452751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.453272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.453789 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.454539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.455069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.456082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.601285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.609188 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e566538a-f39e-4276-9aff-00fcd6db8e78 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.170063 Oct 04 19:03:30.609778 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4356/6560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:30 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:31.633311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:31.633934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:31.641074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.641574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.642274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.643791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.644268 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.644707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.779791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.787871 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-86e09371-5dd9-4be9-abed-a0852cfcf15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.158396 Oct 04 19:03:31.788452 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2205/6561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:31 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:32.811534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.812063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.819180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.819775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.820228 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.820949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.821416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.821847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.961193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.968807 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-91921a0a-4975-46d7-b420-b31895894d45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.161248 Oct 04 19:03:32.969389 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4357/6562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:33.993090 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:33.993736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.000631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.001126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.001575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.002280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.002747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.003227 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.137659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:34.147214 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54b6762f-0cb5-4a6a-bd01-ca404e078d23 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.157883 Oct 04 19:03:34.147932 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2206/6563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:33 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:34.343918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b13870-23ec-4c6a-b6be-ad3870dc3d61", "name": "network-vif-plugged", "status": "completed", "tag": "cf898b5c-8065-417b-bec8-2ea407ab2136"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:34.354342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.354711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.355147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.366898 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] Creating event network-vif-plugged:cf898b5c-8065-417b-bec8-2ea407ab2136 for instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 on n-h2-831193-17 Oct 04 19:03:34.371919 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ed76a9a0-b402-4ac3-8a68-04fcbb51705d req-8556d1c3-99b2-47d1-ad0c-de86aa121de2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095095 Oct 04 19:03:34.372526 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4358/6564] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:35.174730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.175386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.182447 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.182948 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.183429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.184143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.184611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.185047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.327536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:35.336522 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-75162354-1275-41b9-aaa5-874855dd6433 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1389 microversion: 2.1 time: 0.166184 Oct 04 19:03:35.337214 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2207/6565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:36.357976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:36.359434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:36.364102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:36.365019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:36.372782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.373321 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.373762 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.374508 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.375186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.375623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.512229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.520975 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-34f3c6ba-c0f3-4d2d-aa14-9298df7d97a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1561 microversion: 2.1 time: 0.164879 Oct 04 19:03:36.521557 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4359/6566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:36 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:36.543687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:36.544324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:36.546178 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:36.552744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.553250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.553706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.554415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.554884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.555466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.688898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.697253 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0eb4ae83-e931-42c9-9d8c-db05500e3b65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1561 microversion: 2.1 time: 0.157942 Oct 04 19:03:36.697824 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2208/6567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:36 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:38.656944 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b13870-23ec-4c6a-b6be-ad3870dc3d61", "tag": "cf898b5c-8065-417b-bec8-2ea407ab2136"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:38.662180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:38.663223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:38.670285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.671102 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.671625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.671770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.672133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.672776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.673696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.675261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.675904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.684508 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] Creating event network-changed:cf898b5c-8065-417b-bec8-2ea407ab2136 for instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 on n-h2-831193-17 Oct 04 19:03:38.689870 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ffb7a0f3-47d0-449a-bb54-63cc9554799c req-0c70784a-9915-4727-abc7-e5251bbaabfb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036622 Oct 04 19:03:38.690832 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2209/6568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:38.911419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:38.919782 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d79c1a15-16ef-42dd-9c9a-78d1c897fbde tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1561 microversion: 2.1 time: 0.268570 Oct 04 19:03:38.920375 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4360/6569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:38 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:00.214491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=17 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:00.215277 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=38 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:00.219651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:00.221920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:00.228924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.229424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.229876 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.230588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:00.231075 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:00.231521 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.284457 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9e778bb0-7d1f-463b-9119-9286726d0491 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action" status: 200 len: 24570 microversion: 2.1 time: 0.071927 Oct 04 19:04:00.285375 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2210/6570] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:00 2022] POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:04:11.317411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:11.318004 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:11.320012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:11.320675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:11.327376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.327971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.328416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.329111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.329572 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.330000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.396186 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2fc97617-80f3-4e8c-b21b-e07fa7974239 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action" status: 202 len: 0 microversion: 2.1 time: 0.083524 Oct 04 19:04:11.397057 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4361/6571] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:11 2022] POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:11.406053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:11.406804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:11.409918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:11.411217 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:11.420897 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.421406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.421945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.422667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.423165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.423609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.563419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:11.572523 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2b60ea60-9311-4839-9046-e3117b59bc9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1685 microversion: 2.1 time: 0.170724 Oct 04 19:04:11.573128 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2211/6572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:11 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:12.603567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:12.604259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:12.611303 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:12.611790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:12.612232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.612922 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:12.613496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:12.613938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.746353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:12.754223 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a71c5f57-7a24-442b-9507-f4c260643c6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1665 microversion: 2.1 time: 0.154895 Oct 04 19:04:12.754802 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4362/6573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:12 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:13.853136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:13.855343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.863019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.864136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.864613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.865314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.865793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.866235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.915995 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bf86c1e6-6249-47c6-88ec-498349053041 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action" status: 200 len: 32640 microversion: 2.1 time: 0.066300 Oct 04 19:04:13.916885 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2212/6574] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:13 2022] POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action => generated 32640 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:04:13.929261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:13.929799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.936704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.937193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.937630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.938320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.938775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.939236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.005942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-405a494a-de49-444f-ae48-612c347d0c73 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action" status: 202 len: 0 microversion: 2.1 time: 0.081148 Oct 04 19:04:14.006605 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4363/6575] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:13 2022] POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:14.015489 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:14.016187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:14.024205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.024717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.025193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.025998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.026472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.026923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.164354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:14.172609 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9e695a1c-4db6-402a-ba39-2ca238464218 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1672 microversion: 2.1 time: 0.161325 Oct 04 19:04:14.173187 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2213/6576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:14 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:15.198211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:15.198982 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:15.205180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:15.205668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:15.206107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:15.206798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:15.207280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:15.207798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:15.341306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:15.349552 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6126f0fe-d3b7-4539-a8dc-a264c7e01455 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1680 microversion: 2.1 time: 0.156382 Oct 04 19:04:15.350116 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4364/6577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:15 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:15.449034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:15.451187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:15.461290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:15.461795 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:15.462252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:15.462966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:15.463526 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:15.463986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:15.515285 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a2abb44d-daa5-40cf-8d70-19697b6d6403 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action" status: 200 len: 38431 microversion: 2.1 time: 0.069994 Oct 04 19:04:15.516247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2214/6578] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:15 2022] POST /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61/action => generated 38431 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:04:16.494902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:16.495444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:16.498119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b13870-23ec-4c6a-b6be-ad3870dc3d61", "tag": "cf898b5c-8065-417b-bec8-2ea407ab2136"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:16.502547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.503156 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.503800 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.505180 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.505708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.506395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.509789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.510280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.510717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.522662 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] Creating event network-changed:cf898b5c-8065-417b-bec8-2ea407ab2136 for instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 on n-h2-831193-17 Oct 04 19:04:16.528143 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-e4641cbf-4d24-4381-9cbf-fc2256af4082 req-0a21e8dd-f211-4f2c-814e-c9e3d9778902 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034193 Oct 04 19:04:16.529019 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2215/6579] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:16.533157 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:16.616665 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bd529936-1524-485a-8471-bec05d3f9d09 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 204 len: 0 microversion: 2.1 time: 0.125244 Oct 04 19:04:16.617984 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4365/6580] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:16 2022] DELETE /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:16.627279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:16.628338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:16.637015 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.637514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.637969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.638684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.639308 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.639781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.807441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:16.815657 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-25672545-8f0c-463c-a624-293892e0d8bb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1686 microversion: 2.1 time: 0.193075 Oct 04 19:04:16.816331 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2216/6581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:16 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:17.841917 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:17.842635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:17.850712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:17.851492 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:17.851946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:17.852665 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:17.853127 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:17.853554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.001120 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:18.010077 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8564d117-722e-4e2a-bd73-12d071cac10c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1686 microversion: 2.1 time: 0.172695 Oct 04 19:04:18.010686 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4366/6582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:17 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:18.987673 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b13870-23ec-4c6a-b6be-ad3870dc3d61", "name": "network-vif-deleted", "tag": "cf898b5c-8065-417b-bec8-2ea407ab2136"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:18.998692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.999228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.999679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.015284 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] Creating event network-vif-deleted:cf898b5c-8065-417b-bec8-2ea407ab2136 for instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 on n-h2-831193-17 Oct 04 19:04:19.022286 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-2182823f-f897-4f77-9f49-ebf2667aa70f req-d8f43a4f-705a-4913-baad-b8331046c793 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038099 Oct 04 19:04:19.023522 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2217/6583] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:19.035070 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:19.035697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:19.043803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.044233 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.044680 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.045396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.046593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.047053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.121907 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:19.130624 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-92803405-79af-4687-820c-5df420ec355f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 200 len: 1350 microversion: 2.1 time: 0.100014 Oct 04 19:04:19.134647 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4367/6584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:19 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:20.155415 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:20.156045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 54b13870-23ec-4c6a-b6be-ad3870dc3d61] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:20.162892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.163483 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.163933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.164637 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.165098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.165949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.179110 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] HTTP exception thrown: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Request method failure captured: Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 HTTP/1.1 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIN149M0YRYwkaKXmZLy6-lql7RvdxnkhEUAGWxbad1UF4y033nzOxL7K09ol9VKleGKt8Vh_103zQOlQd0qUEsULGnYTm177kSlD5YIb8kO1QPciSpdu9dK-nqbt1IBAGJdVrPQQ4GWKAUN4E1MWoX0hlZkjGZlBrYqw0QzpyYkRlE Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b8bb873e93f748c38823ac7262556d72 Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '54b13870-23ec-4c6a-b6be-ad3870dc3d61'} Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:04:20.180731 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Returning 404 to user: Instance 54b13870-23ec-4c6a-b6be-ad3870dc3d61 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-094ccb52-56d1-4b47-82be-be69ce5143f9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61" status: 404 len: 111 microversion: 2.1 time: 0.032081 Oct 04 19:04:20.185304 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2218/6585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:20 2022] GET /compute/v2.1/servers/54b13870-23ec-4c6a-b6be-ad3870dc3d61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:23.196220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3fc2f85-c478-480b-9f4e-5cf8664683b2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '.version_select at 0x7f633bf4e3a0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:23.216854 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3fc2f85-c478-480b-9f4e-5cf8664683b2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-570766910" status: 202 len: 0 microversion: 2.1 time: 0.025472 Oct 04 19:04:23.217460 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4368/6586] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 19:04:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-570766910 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:04:23.240903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-68212ce6-8107-48d2-b1ca-0413e5f4fb44 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: .version_select at 0x7f6341725c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1813274435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApUtS0vDB0rNd7gUVsE7LgBG8qlOmca+I15u9u8lt22r3Baip2BOTHfefGBQyyB07H9GNrvFjv7BLrf5gsHlNXrd1UmEZOyaM/HcdgWMxR17QXfFiJ+ymdKLeUUbgSx+w=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:23.258414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-68212ce6-8107-48d2-b1ca-0413e5f4fb44 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:23.263629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-68212ce6-8107-48d2-b1ca-0413e5f4fb44 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:23.287404 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-68212ce6-8107-48d2-b1ca-0413e5f4fb44 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050946 Oct 04 19:04:23.288009 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2219/6587] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:04:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:29.339540 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:29.344446 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1105546821", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "1f3e4617-db69-4cb9-896d-fd0b92dd3325"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1813274435", "security_groups": [{"name": "tempest-secgroup-smoke-1424221334"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:29.465365 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] validate_networks() for [('1f3e4617-db69-4cb9-896d-fd0b92dd3325', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:29.932458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:29.932887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:29.933366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:29.934000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:29.934217 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:29.948116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.951097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.951593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.952393 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.952865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.954661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.986934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:29.995675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:30.011060 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:30.013405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:30.065770 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-289d7a6f-db73-4468-949f-20a1d9113cf2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728182 Oct 04 19:04:30.073506 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4369/6588] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:30.078548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-00de6697-3475-450d-babb-9ea0e4a8f2d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.080021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-00de6697-3475-450d-babb-9ea0e4a8f2d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.169385 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-00de6697-3475-450d-babb-9ea0e4a8f2d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:30.177374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:30.181406 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-00de6697-3475-450d-babb-9ea0e4a8f2d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1267 microversion: 2.1 time: 0.106441 Oct 04 19:04:30.182629 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2220/6589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:31.212465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:31.213704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:31.227362 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.227869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.228312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.229054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.229553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.229986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.322080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:31.330911 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b77f1d39-9b5d-4810-aca4-028bdc5e3897 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1327 microversion: 2.1 time: 0.128249 Oct 04 19:04:31.331623 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4370/6590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:31 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:32.357536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.358312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.372892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.373709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.374305 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.375103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.375764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.376377 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.549888 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.558908 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2d43197d-c4e2-4d49-88d4-86209c9cd8aa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.208276 Oct 04 19:04:32.559521 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2221/6591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:32.893803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2864cd4d-af55-422b-8d8e-2ecb5a911453", "tag": "ee3c8c91-678f-4bb1-8ff3-78bd7b358d82"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:32.906930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.907660 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.908149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.924473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] Creating event network-changed:ee3c8c91-678f-4bb1-8ff3-78bd7b358d82 for instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 on n-h1-831193-17 Oct 04 19:04:32.929995 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-5770be85-8ebe-4c4f-b8ff-ba146f46b1e3 req-398b413c-3030-4ab3-a606-411f255001c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040649 Oct 04 19:04:32.930970 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4371/6592] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:33.584121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.584674 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.591617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.592129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.592593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.593310 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.593818 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.594272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.729599 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:04:33.729857 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 (ip 10.222.0.33) !!! Oct 04 19:04:33.733870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.743219 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-78a37cda-9cf7-4562-86a4-30161c3d5712 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.163096 Oct 04 19:04:33.743801 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2222/6593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.768532 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.770371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.779795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.780293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.780736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.781451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.781915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.782409 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.924434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.932414 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c23cd383-6fd6-4ad3-bc3b-c796531085ed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.168610 Oct 04 19:04:34.932997 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4372/6594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.957368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.957996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.965281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.965793 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.966250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.966994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.967501 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.967950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.107349 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:36.115396 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ce4b3f55-0958-45be-91c0-218c4b91fc28 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.162704 Oct 04 19:04:36.115986 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2223/6595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:37.138175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:37.138741 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:37.147275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.147787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.148234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.148964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.149429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.149871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.298052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.306572 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44927e08-da17-4fd9-a56e-cd52f73b3728 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.172489 Oct 04 19:04:37.307169 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4373/6596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:37 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:37.741252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2864cd4d-af55-422b-8d8e-2ecb5a911453", "name": "network-vif-plugged", "status": "completed", "tag": "ee3c8c91-678f-4bb1-8ff3-78bd7b358d82"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:37.752840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.753355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.755341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.767144 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] Creating event network-vif-plugged:ee3c8c91-678f-4bb1-8ff3-78bd7b358d82 for instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 on n-h1-831193-17 Oct 04 19:04:37.772445 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-21c74e71-91ff-41d1-9ec3-d39f433ce6a2 req-c09054b3-cfc1-47bd-b9d6-5f6576b5bdc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035588 Oct 04 19:04:37.773064 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2224/6597] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:38.334093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.334758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.341989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.342495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.342950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.343702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.344169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.344605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.476169 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.483872 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4cd663d1-e884-4385-b68a-4d5580ebe9fe tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1393 microversion: 2.1 time: 0.157736 Oct 04 19:04:38.484454 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4374/6598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:39.509774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:39.510490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.516702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.517195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.517648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.518343 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.518813 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.519275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.666707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.674729 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4bfbc4f9-0f41-4476-a0e9-622399cb9627 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1565 microversion: 2.1 time: 0.170661 Oct 04 19:04:39.675333 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2225/6599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:39 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:39.700719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:39.701484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.709165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.709684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.710131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.710861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.711359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.711988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.860012 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.868682 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c78300df-c79c-4ba6-b487-ea611fdd74d7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1565 microversion: 2.1 time: 0.171853 Oct 04 19:04:39.869277 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4375/6600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:39 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:41.520344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.520888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2864cd4d-af55-422b-8d8e-2ecb5a911453", "tag": "ee3c8c91-678f-4bb1-8ff3-78bd7b358d82"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:41.521243 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.523259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.525565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.526195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.526395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.527993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.532753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.533267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.534312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.535095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.535737 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.536532 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.538360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.538849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.539609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.552503 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] Creating event network-changed:ee3c8c91-678f-4bb1-8ff3-78bd7b358d82 for instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 on n-h1-831193-17 Oct 04 19:04:41.558871 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e954f879-769e-499c-8ab0-fb01b1df3320 req-97fd50b4-c473-4476-9c25-4c258e9a24fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041911 Oct 04 19:04:41.559788 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4376/6601] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:41.690058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.699711 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7f191756-24ae-49ec-90b6-4e736625f511 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1565 microversion: 2.1 time: 0.184879 Oct 04 19:04:41.703659 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2226/6602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.948494 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:04.952901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:04.955172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.962143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.962634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.963099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.963803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.964262 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.964693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.018790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f87daab4-78a2-4fed-b18d-cc1984854bed tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action" status: 200 len: 24563 microversion: 2.1 time: 0.072127 Oct 04 19:05:05.019483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4377/6603] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:04 2022] POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action => generated 24563 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:05:11.360986 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:11.363251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:11.365507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:11.366757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:11.372707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.373211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.373669 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.374383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.374858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.375331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.448333 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2513a52b-43a8-40dd-a702-dc56ccfa620a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action" status: 202 len: 0 microversion: 2.1 time: 0.091043 Oct 04 19:05:11.448972 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2227/6604] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:11 2022] POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:11.457830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:11.458949 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:11.466526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.467020 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.467498 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.468205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.468672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.469104 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.611279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.619967 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0e735720-2854-4a4b-82f3-f68ce401ed3a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1675 microversion: 2.1 time: 0.166336 Oct 04 19:05:11.620555 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4378/6605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:11 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:12.644471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:12.645348 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:12.652928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.653432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.653885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.654594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.655084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.655531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.787117 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:12.795190 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5e7ad03c-b1ad-4807-972a-b493d5caf225 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.154952 Oct 04 19:05:12.795761 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2228/6606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:12 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:13.820812 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:13.821417 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:13.828386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.828875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.829312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.830014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.830468 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.830889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.962039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.969812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-786cd065-8dd9-4a85-b07b-b5a13a3e09b1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.153464 Oct 04 19:05:13.970387 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4379/6607] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:13 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:14.999344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.000016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.008376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.009226 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.009874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.010955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.011678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.012325 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.160992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:15.169929 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-03022672-9e47-4a5b-be5d-b0225f85d6d5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.177709 Oct 04 19:05:15.170504 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2229/6608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:16.193979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:16.195091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.202031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.202527 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.202971 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.203704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.204166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.204598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.335471 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.343247 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3bfc551c-0830-4b57-a309-de4f4819f46d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.153291 Oct 04 19:05:16.343822 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4380/6609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:16 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:17.366778 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.367425 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:17.374314 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.374805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.375282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.375979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.376494 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.376879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.524508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.533828 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0b4c07b8-0d6e-4a04-8350-9a4ebe26f898 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.170733 Oct 04 19:05:17.534617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2230/6610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:17 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:18.562093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.562637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:18.571561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.571880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.572319 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.573039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.573495 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.573925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.712956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:18.721152 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2c32a894-afb4-443a-aa50-76c25dfad1d3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.162932 Oct 04 19:05:18.721737 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4381/6611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:19.745274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:19.745934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:19.752820 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.753321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.753785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.754491 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.754979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.755433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.893392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.901833 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0e328b79-1ae2-470d-8020-718a9ad196ef tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.160797 Oct 04 19:05:19.902391 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2231/6612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:19 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:20.925877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:20.926481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:20.933466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.933966 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.934385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.935106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.935561 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.935986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.074141 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:21.082904 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-28314d81-d5a8-4afd-975e-c3a5ea6bb15f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.160902 Oct 04 19:05:21.083523 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4382/6613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:20 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:22.107387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:22.107920 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:22.114651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.115204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.116309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.117029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.117506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.118005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.252529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.260778 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-538d5063-d141-421f-b285-0ab0f02da0a0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1680 microversion: 2.1 time: 0.157341 Oct 04 19:05:22.261373 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2232/6614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:22 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:23.286225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:23.286835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:23.294472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.294967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.295438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.296136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.296590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.297017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.433062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.440824 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1b7544dc-985e-4625-9801-4a183dbb77a1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1683 microversion: 2.1 time: 0.158643 Oct 04 19:05:23.441411 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4383/6615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:23 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:47.629814 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:47.632643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:47.635592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=12 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:47.636276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:47.641833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.642334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.642790 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.643537 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.644012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.644457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.702023 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ac025c20-2568-4a06-bcf5-b2ddf154547b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action" status: 200 len: 69058 microversion: 2.1 time: 0.075944 Oct 04 19:05:47.702700 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2233/6616] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:47 2022] POST /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453/action => generated 69058 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:05:54.737342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:54.743423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2864cd4d-af55-422b-8d8e-2ecb5a911453", "tag": "ee3c8c91-678f-4bb1-8ff3-78bd7b358d82"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:54.743958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.746571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=15 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:54.753501 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=40 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:54.759445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.760159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.760296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.760707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.760886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.761149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.761778 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.762245 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.762669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.775103 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] Creating event network-changed:ee3c8c91-678f-4bb1-8ff3-78bd7b358d82 for instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 on n-h1-831193-17 Oct 04 19:05:54.780462 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6dd5c2d9-d159-4287-a7e5-eb14d2727c64 req-ffff05e3-b610-4417-ab14-767e97349107 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041068 Oct 04 19:05:54.781424 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2234/6617] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:54.792411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:05:54.877921 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0ab1a1bb-189d-4058-ae29-41110a540986 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 204 len: 0 microversion: 2.1 time: 0.143280 Oct 04 19:05:54.879332 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4384/6618] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:54 2022] DELETE /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:05:54.889534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:54.890259 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.896678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.897169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.898576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.899331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.899805 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.900246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.359913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:55.367915 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-62ce3d53-5576-4a56-a4cf-8ff2d8067faa tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1689 microversion: 2.1 time: 0.483329 Oct 04 19:05:55.368505 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2235/6619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:54 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1689 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:56.393258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:56.394629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:56.403602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:56.404102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:56.404546 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:56.405258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:56.405749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:56.406176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:56.551871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:56.560352 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80d34d8c-2447-43d9-9255-0baa2681679c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1689 microversion: 2.1 time: 0.171452 Oct 04 19:05:56.560940 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4385/6620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:56 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:57.583693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:57.584371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:57.590333 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2864cd4d-af55-422b-8d8e-2ecb5a911453", "name": "network-vif-deleted", "tag": "ee3c8c91-678f-4bb1-8ff3-78bd7b358d82"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:57.593505 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.594008 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.594490 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.595241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.595868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.596327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.604249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.605034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.605675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.620373 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] Creating event network-vif-deleted:ee3c8c91-678f-4bb1-8ff3-78bd7b358d82 for instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 on n-h1-831193-17 Oct 04 19:05:57.626047 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-d434d07c-8cc5-4a09-9de3-737f0702ccba req-fe92d9dc-1a0c-4661-9e2b-3b448e3b2c11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104007 Oct 04 19:05:57.627231 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2236/6621] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:57.669554 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.680379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-71b5bf25-1b50-4b10-8735-2dad9569bdb0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 200 len: 1352 microversion: 2.1 time: 0.100427 Oct 04 19:05:57.680949 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4386/6622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:57 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:58.705874 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:58.706583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 2864cd4d-af55-422b-8d8e-2ecb5a911453] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:58.712757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.713250 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.713698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.714400 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.714885 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.715329 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.729237 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] HTTP exception thrown: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Request method failure captured: Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 HTTP/1.1 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIN149M0YRYwkaKXmZLy6-lql7RvdxnkhEUAGWxbad1UF4y033nzOxL7K09ol9VKleGKt8Vh_103zQOlQd0qUEsULGnYTm177kSlD5YIb8kO1QPciSpdu9dK-nqbt1IBAGJdVrPQQ4GWKAUN4E1MWoX0hlZkjGZlBrYqw0QzpyYkRlE Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b8bb873e93f748c38823ac7262556d72 Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '2864cd4d-af55-422b-8d8e-2ecb5a911453'} Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:05:58.730841 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Returning 404 to user: Instance 2864cd4d-af55-422b-8d8e-2ecb5a911453 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c3681d3e-c7ca-49f5-9638-ba51b9f1ec91 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453" status: 404 len: 111 microversion: 2.1 time: 0.031699 Oct 04 19:05:58.735950 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2237/6623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:58 2022] GET /compute/v2.1/servers/2864cd4d-af55-422b-8d8e-2ecb5a911453 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:01.708678 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c707ed07-2175-4951-99dd-293ffa69dde9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '.version_select at 0x7f633bf85310>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:01.736940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c707ed07-2175-4951-99dd-293ffa69dde9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1813274435" status: 202 len: 0 microversion: 2.1 time: 0.032577 Oct 04 19:06:01.738300 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4387/6624] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 19:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1813274435 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:01.768288 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8a965a63-12e5-4a55-949b-7705341d1e90 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: .version_select at 0x7f6340f27550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-104991400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITWi+3V2Qhpf5DN2EAdD3wVX/8LHVLXCbPKCyRhsvyvjRgnLCvHYf+h0iThRHqmv+86zvHZj8q7Pxf3PL0SZ0hgm8lu+4hiV5pu9OAFToOnrcNhuGsaPFWtPV5iJoCUew=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:01.788418 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8a965a63-12e5-4a55-949b-7705341d1e90 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:01.794049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-8a965a63-12e5-4a55-949b-7705341d1e90 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:01.821782 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8a965a63-12e5-4a55-949b-7705341d1e90 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057084 Oct 04 19:06:01.829937 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2238/6625] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:06:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:07.150704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301174228", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "a6461542-8809-410c-b676-0e3701c40878"}], "key_name": "tempest-TestNetworkAdvancedServerOps-104991400", "security_groups": [{"name": "tempest-secgroup-smoke-450754856"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:07.291146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] validate_networks() for [('a6461542-8809-410c-b676-0e3701c40878', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:07.676326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:08.061315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:08.061747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:08.062225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:08.062641 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:08.063133 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:08.074606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.075152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.075810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.076747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.077211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.077635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.096551 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:08.108276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:08.122090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:08.124427 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:08.172997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d9f53e85-4f72-45d7-9929-e6445911bba1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.028656 Oct 04 19:06:08.174001 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4388/6626] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:08.187803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c20db4dc-e6af-4751-8fcd-3441081d6fdc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:08.189707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c20db4dc-e6af-4751-8fcd-3441081d6fdc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:08.246962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c20db4dc-e6af-4751-8fcd-3441081d6fdc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:08.255024 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c20db4dc-e6af-4751-8fcd-3441081d6fdc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1266 microversion: 2.1 time: 0.072847 Oct 04 19:06:08.255633 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2239/6627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:08 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:09.279062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:09.280433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:09.288709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.289581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.290556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.291396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.292106 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.292760 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.366746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.374833 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-35998a7c-0939-4d41-81f8-3121a21b03a7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1336 microversion: 2.1 time: 0.099617 Oct 04 19:06:09.375486 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4389/6628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:09 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:10.402789 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:10.404077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:10.410006 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=16 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:10.413484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.414293 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.414955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.416193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.416865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.417506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.846707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:10.854947 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0da03910-1c94-4622-a681-8fab6f3b6330 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.456288 Oct 04 19:06:10.855621 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2240/6629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:10 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:11.070461 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:11.083439 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.084039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.084547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.096972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] Creating event network-changed:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h1-831193-17 Oct 04 19:06:11.102340 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ae35bee4-d8c1-455d-9e88-fda2a26df19f req-3302e002-766d-4c82-aa74-a4a5c7a0618b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036345 Oct 04 19:06:11.102958 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4390/6630] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:11.878005 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:11.878649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:11.885636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.886136 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.886581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.887324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.887797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.888234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.020995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:12.031534 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-618729af-45bf-4ab9-9fdc-7ffa3ae30a08 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.157281 Oct 04 19:06:12.032110 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2241/6631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:11 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:13.056702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:13.057429 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.063718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.064200 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.064634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.065354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.065804 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.066226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.203363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:13.211530 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f79d5bad-dcc3-4606-84e9-6491ad6562a8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.160572 Oct 04 19:06:13.212117 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4391/6632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:13 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:14.236012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:14.236595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:14.244061 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.244599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.245057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.245975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.246457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.246905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.381272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:14.389094 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d04a68b3-7117-4fe1-bb97-f7debec1a35f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.157400 Oct 04 19:06:14.389650 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2242/6633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:14 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:15.413416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:15.414117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:15.421304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.421790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.422229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.422918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.423398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.423824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.554685 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:15.562692 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-37c29e71-acb3-4039-a0b0-df879b5e09cd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.153882 Oct 04 19:06:15.563302 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4392/6634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:15 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:16.201324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "name": "network-vif-plugged", "status": "completed", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:16.213026 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.213514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.213963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.225318 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] Creating event network-vif-plugged:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h1-831193-17 Oct 04 19:06:16.230277 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-bf26dbaf-1fe5-433b-8ef9-e77971e71783 req-fd49bc35-794c-4880-913a-221cfa6c4008 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032824 Oct 04 19:06:16.231059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2243/6635] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:16.585757 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:16.586366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:16.593267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.593750 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.594187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.594878 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.595369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.595881 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.731864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:16.739637 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c86c9bbe-89db-46f9-8cfa-cb0337f1a6d9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1391 microversion: 2.1 time: 0.157766 Oct 04 19:06:16.740819 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4393/6636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:16 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:17.764759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:17.765474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:17.768047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:17.774785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.775315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.775781 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.776471 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.776939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.777378 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.912105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:17.920755 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0592dfaf-e092-4b1b-adad-af8e2d26e592 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1562 microversion: 2.1 time: 0.161004 Oct 04 19:06:17.921339 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2244/6637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:17 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:17.945149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:17.945819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:17.953212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.953726 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.954146 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.954847 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.955333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.955767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.085237 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:18.091659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:18.100375 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ee44b6e4-5ecd-43ab-bdd9-6dbe4c25d345 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1562 microversion: 2.1 time: 0.159031 Oct 04 19:06:18.100985 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4394/6638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:17 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:19.729524 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:19.730163 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:19.731861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:19.733191 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:19.737280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:19.739770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.740282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.740957 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.741697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.742172 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.742614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.744835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.745353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.745903 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.758686 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] Creating event network-changed:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h1-831193-17 Oct 04 19:06:19.764159 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-c9f61ea5-707c-4313-996f-d24aba51fcc9 req-6179b515-5dd2-4664-8944-2660da00afab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035900 Oct 04 19:06:19.765182 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4395/6639] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:19.890057 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:19.899193 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6890dc4a-56be-47d8-953f-b7b7c31bb740 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1562 microversion: 2.1 time: 0.174021 Oct 04 19:06:19.900020 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2245/6640] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:19 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:43.157174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:43.159486 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.162708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:43.163500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:43.170833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.171355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.171801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.172520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.173054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.173408 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.231258 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c88c065f-b3dd-458c-90b2-d648f2fc1454 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action" status: 200 len: 24570 microversion: 2.1 time: 0.078739 Oct 04 19:06:43.231920 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4396/6641] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:43 2022] POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:06:49.638205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:49.640472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.642597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:49.643481 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=32 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:49.650252 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.650785 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.651276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.651995 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.652466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.652909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.775960 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.782240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=128771) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:06:49.789522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:49.790220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:49.790711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:49.791162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:49.791592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:49.856047 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d8509624-1df6-4b1c-a7d6-3d4bcd7e9246 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action" status: 202 len: 0 microversion: 2.1 time: 0.221977 Oct 04 19:06:49.856665 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2246/6642] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:49 2022] POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:49.865734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.866591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.874047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.874549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.874993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.875739 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.876247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.876634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.102999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.111214 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-cf54a45d-087a-4889-9cd9-20bf72704341 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1690 microversion: 2.1 time: 0.249846 Oct 04 19:06:50.111805 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4397/6643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:51.137768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:51.138401 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:51.145613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.146120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.146581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.147332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.147804 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.148298 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.292882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.301995 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-37db4bbc-4575-4a20-b8a9-10528cb13968 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1690 microversion: 2.1 time: 0.169785 Oct 04 19:06:51.302583 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2247/6644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:51 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:52.329251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:52.329792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:52.337552 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.338037 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.338503 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.339226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.339682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.340108 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.471376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.479135 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-11ed030d-8d3e-4208-aa47-7ed4706a5caf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.154122 Oct 04 19:06:52.479717 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4398/6645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:52 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:53.504774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.505409 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.512470 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.512974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.513434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.514156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.514638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.515115 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.664069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.672546 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5feef56b-7070-4921-bc2f-512d98830d42 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.171786 Oct 04 19:06:53.673127 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2248/6646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.696251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.696913 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.704229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.704718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.705159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.705858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.706312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.706919 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.840367 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.848113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-20035b64-f16c-4847-8915-a40b04058729 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.156335 Oct 04 19:06:54.848689 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4399/6647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:55.871620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.872242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.879125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.879622 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.880071 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.880768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.881241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.881678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.013591 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.021387 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a208e2fc-fa06-4cdf-9f1a-2dd007623719 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.153631 Oct 04 19:06:56.021950 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2249/6648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:57.045988 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:57.046609 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:57.053456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.053953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.054902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.055626 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.056082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.056511 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.194354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.202741 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-38fe7607-5f19-4255-8c38-0f6be9d6c2cc tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.160651 Oct 04 19:06:57.203356 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4400/6649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:57 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:58.226016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.226666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.233474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.233969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.234423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.235150 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.235616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.236193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.370760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:58.378729 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-31d1c7a7-9fff-4630-af2d-6831e5c4f984 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.156785 Oct 04 19:06:58.379336 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2250/6650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:58 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:59.402743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:59.403392 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:59.410424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.410914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.411394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.412098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.412560 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.413000 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.551414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.559708 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9a136e79-d262-40d5-b0ad-11c8db9693d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.160909 Oct 04 19:06:59.560319 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4401/6651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:59 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:00.583570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:00.584200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:00.591315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.591816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.592267 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.593051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.593514 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.593951 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.732085 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.740257 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e1d89e3f-58ed-4005-9fd0-258d19c2bfc3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.160717 Oct 04 19:07:00.740844 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2251/6652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:00 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:01.764549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.765161 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.772130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.772615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.773054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.773744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.774201 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.774624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.912653 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.921307 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fab3d9e1-f5d4-4cf5-8a8b-66123032c810 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.160634 Oct 04 19:07:01.921926 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4402/6653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:01 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:02.947304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.947959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.954928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.955477 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.955934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.956643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.957111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.957548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.090436 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.098297 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-50645f72-55f4-41fa-b6c5-03233cc80af1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1695 microversion: 2.1 time: 0.155018 Oct 04 19:07:03.098866 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2252/6654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.122648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.123264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.129954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.130445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.130889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.131624 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.132111 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.132537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.346832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.355441 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3b85632a-db84-4eeb-b54d-eb91b705b29d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1694 microversion: 2.1 time: 0.236669 Oct 04 19:07:04.356028 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4403/6655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.365610 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "name": "network-vif-unplugged", "status": "completed", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:04.377916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.378328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.379192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.392612 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Creating event network-vif-unplugged:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h2-831193-17 Oct 04 19:07:04.398657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:07:04.409588 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-461f317a-a24f-4c04-9f76-30234e21f5a4 req-c2838e54-c0cf-4931-a305-3401831c8918 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047675 Oct 04 19:07:04.410203 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2253/6656] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:05.383091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.383708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.390885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.391414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.391854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.392553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.393013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.393438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.834017 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:05.841907 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8a943e55-652b-4f5d-bfd1-f1e93c64419a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1694 microversion: 2.1 time: 0.463622 Oct 04 19:07:05.842712 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4404/6657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1694 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:06.426736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:06.438155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.439128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.439698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.452541 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Creating event network-changed:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h2-831193-17 Oct 04 19:07:06.458131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831193-17', 'n-h1-831193-17'} {{(pid=128771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:07:06.469542 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-565d5be2-b92b-4f8f-84fa-9102bec7cc79 req-e4b27cf8-b0ab-49f5-8a4d-e27a56f07fe6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047735 Oct 04 19:07:06.470162 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2254/6658] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:06.865883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:06.867212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:06.873738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.874583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.875273 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.876194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.876818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.877445 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.095562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.105737 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-16b83ee8-6c08-4404-8c38-7a4f9be269f4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1692 microversion: 2.1 time: 0.243620 Oct 04 19:07:07.106394 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4405/6659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:06 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:08.131688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.132969 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.141451 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.141966 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.142423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.143182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.143665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.144113 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.282865 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.295906 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7de346da-b316-434f-bcb3-87fe3d458ba3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1689 microversion: 2.1 time: 0.169613 Oct 04 19:07:08.296491 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2255/6660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:08.319093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:08.320211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.327137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.327642 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.328090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.328796 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.329260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.329693 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.388060 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-503e0fd7-06d1-485e-98b0-a537dcd957a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action" status: 204 len: 0 microversion: 2.1 time: 0.072543 Oct 04 19:07:08.388762 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4406/6661] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:08 2022] POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:08.397439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.398054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.404152 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.404645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.405034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.405844 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.406316 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.406798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.550923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.559524 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4161f6ed-fd45-484c-aff2-405a3255e2f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1689 microversion: 2.1 time: 0.166043 Oct 04 19:07:08.560105 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2256/6662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:08.583255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.584047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.590309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.590814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.591291 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.592009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.592474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.592915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.760853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.769972 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-accbad5d-3315-42e5-9a57-b5a01d713ce4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1689 microversion: 2.1 time: 0.191002 Oct 04 19:07:08.770603 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4407/6663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:09.795998 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:09.796568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:09.804764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.805264 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.805716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.806431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.806898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.807393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.946677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.954893 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f03345c6-678e-4e92-be63-52b40b5282c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1681 microversion: 2.1 time: 0.162962 Oct 04 19:07:09.955511 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2257/6664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:09 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:11.447126 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "name": "network-vif-plugged", "status": "completed", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:11.457722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.458684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.459152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.473810 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] Creating event network-vif-plugged:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h2-831193-17 Oct 04 19:07:11.478876 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f536c810-1c95-4808-a302-04cdd7c5e9ca req-782ae5bd-546c-436c-9ece-7e8d050462a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036111 Oct 04 19:07:11.479550 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4408/6665] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:32.137831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:32.140010 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:32.142208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=28 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:32.143016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:32.148807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.149304 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.149751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.151001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:32.151486 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:32.151926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.206095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-92b43c51-ed17-43fd-97a1-6e72f39f3527 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action" status: 200 len: 24579 microversion: 2.1 time: 0.072361 Oct 04 19:07:32.206991 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2258/6666] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:32 2022] POST /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff/action => generated 24579 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:39.872109 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:39.875732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.876358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.879597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=26 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:39.880259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:39.893589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.895453 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.896184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.896630 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.897340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.898087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.898795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.899295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.899823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.920357 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] Creating event network-changed:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h2-831193-17 Oct 04 19:07:39.926243 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-50c78ca1-e360-42bc-9e46-4f1793e7c842 req-9b2ec379-e3be-4335-865f-bc439891c8c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058659 Oct 04 19:07:39.927281 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2259/6667] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:39.951794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:40.061012 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1266c29e-8f66-49e7-a0f1-7b4139e24174 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 204 len: 0 microversion: 2.1 time: 0.198311 Oct 04 19:07:40.061933 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4409/6668] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:39 2022] DELETE /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:40.072059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:40.073413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:40.082699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.083683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.084153 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.084913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.085569 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.086290 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.299441 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.307634 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-503c6fc6-cdc6-441c-9390-6557859ad054 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1687 microversion: 2.1 time: 0.240893 Oct 04 19:07:40.308317 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2260/6669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:40 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:41.333227 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:41.333956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:41.340627 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.341117 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.341556 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.342258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.342714 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.343177 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.651581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.660065 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b4b391ad-03dc-4c1b-9922-addc7bcc62f6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 200 len: 1687 microversion: 2.1 time: 0.331129 Oct 04 19:07:41.660651 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4410/6670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:41 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 1687 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:41.943413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c18675a-cae8-49a5-8a3c-0910335af1ff", "name": "network-vif-deleted", "tag": "29f03916-a9e3-46c8-962b-19e5c1b63287"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:41.954097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.954585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.955058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.967162 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] Creating event network-vif-deleted:29f03916-a9e3-46c8-962b-19e5c1b63287 for instance 7c18675a-cae8-49a5-8a3c-0910335af1ff on n-h2-831193-17 Oct 04 19:07:41.972637 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9781cf01-35ce-49fa-94fb-5c5f8ac36298 req-3cd0b475-4dd6-43c5-9651-158b65c937a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Oct 04 19:07:41.973240 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2261/6671] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:42.685164 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.685700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 7c18675a-cae8-49a5-8a3c-0910335af1ff] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.692648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.693143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.693583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.694298 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.694759 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.695226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.708997 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] HTTP exception thrown: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Request method failure captured: Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff HTTP/1.1 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIN149M0YRYwkaKXmZLy6-lql7RvdxnkhEUAGWxbad1UF4y033nzOxL7K09ol9VKleGKt8Vh_103zQOlQd0qUEsULGnYTm177kSlD5YIb8kO1QPciSpdu9dK-nqbt1IBAGJdVrPQQ4GWKAUN4E1MWoX0hlZkjGZlBrYqw0QzpyYkRlE Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: b8bb873e93f748c38823ac7262556d72 Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '7c18675a-cae8-49a5-8a3c-0910335af1ff'} Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:07:42.710701 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Returning 404 to user: Instance 7c18675a-cae8-49a5-8a3c-0910335af1ff could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-46d30ae1-caac-4987-bf9b-f66fad13f0c2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff" status: 404 len: 111 microversion: 2.1 time: 0.031102 Oct 04 19:07:42.716622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4411/6672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/7c18675a-cae8-49a5-8a3c-0910335af1ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:46.106829 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b085b9d-d223-4a1c-bc0b-4125bb355bb8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '.version_select at 0x7f6340eaf550>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.129661 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b085b9d-d223-4a1c-bc0b-4125bb355bb8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-104991400" status: 202 len: 0 microversion: 2.1 time: 0.028635 Oct 04 19:07:46.143888 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2262/6673] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 19:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-104991400 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:07:46.169738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-39ec8eaf-d6b7-439d-88ad-4fe5273edeaf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: .version_select at 0x7f63400d3700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-104462878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdxM2F4Gsq6pK1fDABliCjuMyqoy6aQqPsJP1pOJlFEaGWkgiEb60Ee3GD46g+pVLw3DwyyUcAHlRRGKgSAWkrZVWV15hA55wcCK4pV567rx+xW48QHEgaULYTJbpBmng=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:46.196836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-39ec8eaf-d6b7-439d-88ad-4fe5273edeaf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:46.204470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-39ec8eaf-d6b7-439d-88ad-4fe5273edeaf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:46.236400 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-39ec8eaf-d6b7-439d-88ad-4fe5273edeaf tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.072071 Oct 04 19:07:46.245821 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4412/6674] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:07:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:51.664926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1559223925", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "79fc2d24-2d06-49f8-a553-809131ee123b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-104462878", "security_groups": [{"name": "tempest-secgroup-smoke-1205330164"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:51.776656 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] validate_networks() for [('79fc2d24-2d06-49f8-a553-809131ee123b', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:51.960652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=14 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:52.279694 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:52.280274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:52.280870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:52.281391 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:52.281916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:52.294519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.295379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.297319 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.298334 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.298870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.299412 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.322533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:52.329218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:52.344711 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:52.347682 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:52.420165 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-978e39c5-ffb8-4de8-89cb-d931a0c6c1a3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760252 Oct 04 19:07:52.427114 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2263/6675] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:52.434205 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0f048f1-69bd-435e-8529-79d889b5a5cb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:52.435231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0f048f1-69bd-435e-8529-79d889b5a5cb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:52.504987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0f048f1-69bd-435e-8529-79d889b5a5cb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.513516 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0f048f1-69bd-435e-8529-79d889b5a5cb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1266 microversion: 2.1 time: 0.084988 Oct 04 19:07:52.514324 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4413/6676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:52 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:53.540130 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:53.541933 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:53.549697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.550417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.551234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.552193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.552668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.553114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.638003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.647913 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7eb83d48-4e9c-47ae-9829-750d9a789905 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1326 microversion: 2.1 time: 0.112144 Oct 04 19:07:53.664040 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2264/6677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:53 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:54.674173 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:54.675650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:54.679188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:54.684358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.685808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.686335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.687407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.687953 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.688467 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.153051 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.161617 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-617c5ae0-b7d6-412f-adeb-03deca3856ad tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.492923 Oct 04 19:07:55.162196 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4414/6678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:54 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:55.651716 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c6227f-9b21-4f94-8068-b67d0905bafc", "tag": "df4c13e0-844d-4ddc-9114-6a60da53730d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:55.662860 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.663647 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.664199 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.675525 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] Creating event network-changed:df4c13e0-844d-4ddc-9114-6a60da53730d for instance f5c6227f-9b21-4f94-8068-b67d0905bafc on n-h2-831193-17 Oct 04 19:07:55.680527 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-0d474aa1-e112-4975-a622-49539fee0917 req-075c10c0-e04e-4385-86c0-52dcac489cd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101652 Oct 04 19:07:55.681123 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2265/6679] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:56.185751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:56.186378 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:56.193507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.194002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.194449 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.195225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.195657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.196095 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.336776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.345004 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8dd776c5-9592-497a-915c-ab383441af88 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.163540 Oct 04 19:07:56.345585 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4415/6680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:56 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:57.371330 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:57.372047 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:57.378624 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.379162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.379618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.380328 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.380808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.381232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.514001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:57.522449 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-11301581-01de-416e-bfe1-f9f1422162e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.157318 Oct 04 19:07:57.523046 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2266/6681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:57 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:58.544978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:58.545592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:58.553122 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.553616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.554061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.554761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.555259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.555691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.693681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:58.702430 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a3317a15-77c5-4e28-92b7-c4f96f787687 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.161427 Oct 04 19:07:58.703069 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4416/6682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:58 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:59.725038 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.725675 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:59.732937 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.733442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.733903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.734638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.735134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.735583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.877021 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:59.884851 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9ab679c-68ae-487b-8cdf-d94aec55db00 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.163685 Oct 04 19:07:59.885452 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2267/6683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:59 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:00.908784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:00.909404 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:00.916590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.917082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.917521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.918220 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.918681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.919140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.055625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.064769 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-8c36da28-dabc-4bfc-a9dd-43d69d61adf0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.159659 Oct 04 19:08:01.065434 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4417/6684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:00 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:01.582837 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c6227f-9b21-4f94-8068-b67d0905bafc", "name": "network-vif-plugged", "status": "completed", "tag": "df4c13e0-844d-4ddc-9114-6a60da53730d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:01.594364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.594868 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.595352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.608055 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] Creating event network-vif-plugged:df4c13e0-844d-4ddc-9114-6a60da53730d for instance f5c6227f-9b21-4f94-8068-b67d0905bafc on n-h2-831193-17 Oct 04 19:08:01.613174 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f9d6efc3-f93c-47eb-815e-5501b90e5403 req-2fa862e1-95cb-4341-a01f-94ccb2ef1a92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034172 Oct 04 19:08:01.614149 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2268/6685] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:02.089973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:02.090662 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:02.097586 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.098082 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.098526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.099269 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.099734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.100167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.230826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:02.238583 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-019d3f3a-f74f-4e46-bdc3-f622ee868b8c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1392 microversion: 2.1 time: 0.153172 Oct 04 19:08:02.239182 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4418/6686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:02 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.259324 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:03.260164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:03.265159 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:03.265870 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:03.267975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:03.274405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.274905 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.275424 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.276126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.276594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.277055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.414339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:03.422945 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4fb417f-aaff-48ec-8a3f-9c9cca896e57 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1564 microversion: 2.1 time: 0.164622 Oct 04 19:08:03.423537 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2269/6687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:03 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.446149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:03.446769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:03.448698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:03.454698 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.455225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.455672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.456379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.456844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.457285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.587548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:03.596109 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-004f33e6-3c80-4c0a-97cb-2533f01090c7 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1564 microversion: 2.1 time: 0.153873 Oct 04 19:08:03.596685 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4419/6688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:03 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:05.224049 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c6227f-9b21-4f94-8068-b67d0905bafc", "tag": "df4c13e0-844d-4ddc-9114-6a60da53730d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:05.224768 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.225816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:05.233139 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.233650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.234103 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.234989 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.235390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.236079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.236526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.237636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.238087 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.251450 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] Creating event network-changed:df4c13e0-844d-4ddc-9114-6a60da53730d for instance f5c6227f-9b21-4f94-8068-b67d0905bafc on n-h2-831193-17 Oct 04 19:08:05.256701 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-86aacea6-b211-4bb3-849b-82bfa743d54d req-247244eb-709c-4e20-8af2-6808b90981a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036543 Oct 04 19:08:05.257315 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4420/6689] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:05.472765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:05.482297 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9cff1ed8-9f29-4f49-bda7-4f7c1135d014 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1564 microversion: 2.1 time: 0.262073 Oct 04 19:08:05.483445 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2270/6690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:26.725436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:26.726193 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=38 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:26.779334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:26.781697 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:26.788018 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:26.788509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:26.788956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:26.789930 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:26.790401 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:26.790833 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:26.850650 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a34dbcec-aca6-4395-8e9f-8e80ffd8d74d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action" status: 200 len: 24570 microversion: 2.1 time: 0.127031 Oct 04 19:08:26.851326 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4421/6691] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:26 2022] POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action => generated 24570 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:33.249717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:33.251842 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:33.252506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=36 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:33.258866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.259423 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.259875 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.282547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Going to try to stop instance {{(pid=128771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:08:33.327770 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6ddcc8c4-f778-4e61-beec-9abd55fc7d49 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action" status: 202 len: 0 microversion: 2.1 time: 0.082604 Oct 04 19:08:33.328394 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2271/6692] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:33 2022] POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:08:33.337296 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:33.338101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:33.345871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.346457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.346893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.347668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.348114 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.348548 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.486806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:33.496231 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-44f3185e-882d-4ddf-9543-eb52c9929988 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.163212 Oct 04 19:08:33.496844 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4422/6693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:33 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:34.523801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:34.524788 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:34.532798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.533457 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.533994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.534936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.535509 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.536206 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.768543 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:34.776721 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b265615d-f750-4867-8589-869beb6236d8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.259890 Oct 04 19:08:34.777298 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2272/6694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:34 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:35.801838 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:35.802425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:35.810620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:35.811150 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:35.811600 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:35.812311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:35.812775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:35.813210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:35.951606 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.960030 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f31abfad-8d3b-4cf6-b8c8-3b3ee9a74af9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.162136 Oct 04 19:08:35.960628 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4423/6695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:35 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:36.983536 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:36.984240 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:36.991352 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.991857 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.992318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.993035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.993505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.993947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.149394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:37.159667 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-293e152c-56e5-4c1a-89d7-10d1621dda6a tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.180463 Oct 04 19:08:37.160284 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2273/6696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:36 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:38.184589 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:38.185677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:38.192690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.193186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.193667 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.194379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.194843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.195309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.343775 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.351646 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-529f1e37-1b29-4543-a669-b6ea182b0b9c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.171080 Oct 04 19:08:38.352241 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4424/6697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:38 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:39.378913 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.379562 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.386774 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.387360 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.387772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.390099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.390099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.390099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.527069 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.535494 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a4a814b3-7cb9-442b-b947-35e3c85c5a6c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.160452 Oct 04 19:08:39.536077 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2274/6698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:39 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:40.560160 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.560731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.567934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.568454 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.568873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.569581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.570041 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.570466 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.709651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.718194 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c73c2cc5-39c4-46d5-ab06-8e8d4b61f8e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.162104 Oct 04 19:08:40.718776 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4425/6699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.744528 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.745149 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.752958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.753472 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.753928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.754625 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.757248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.757248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.896704 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.905756 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d2915fa7-e76e-443b-a366-5b2fc683bf55 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.165888 Oct 04 19:08:41.906351 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2275/6700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:42.930385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:42.931006 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:42.938534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.939054 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.939515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.940232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.940734 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.941170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.080184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.088348 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bbf4057c-30c6-474b-8359-304c301696ce tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1693 microversion: 2.1 time: 0.161857 Oct 04 19:08:43.089053 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4426/6701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:42 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:44.112649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:44.113195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.120467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.120958 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.121414 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.122132 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.123193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.123645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.265365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.273467 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d54c3f35-6813-4d47-b294-5b64d1fd2da1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1670 microversion: 2.1 time: 0.164858 Oct 04 19:08:44.274047 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2276/6702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:44 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:45.376027 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:45.380181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:45.387270 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.387768 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.388536 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.389657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.390241 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.390711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.442899 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ff001b0a-a948-473c-b72f-d953b2a89bc5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action" status: 200 len: 35083 microversion: 2.1 time: 0.070923 Oct 04 19:08:45.443582 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4427/6703] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:45 2022] POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action => generated 35083 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:45.455464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:45.462427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.462926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.463411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.487490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Going to try to start instance {{(pid=128771) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:08:45.531435 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f42063fa-e63c-4a1c-b5df-37280d3f81a4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action" status: 202 len: 0 microversion: 2.1 time: 0.079601 Oct 04 19:08:45.532069 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2277/6704] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:45 2022] POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:08:45.541403 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:45.542116 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:45.550320 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.551509 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.551958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.552973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.553433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.553862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.734261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:45.742570 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d460a6f8-c298-473c-aa6b-e4a0d8a369c5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1679 microversion: 2.1 time: 0.205644 Oct 04 19:08:45.743376 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4428/6705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:45 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:46.773603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:46.774961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:46.783940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.784500 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.784968 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.785702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.786180 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.786633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.932479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:46.942535 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7db5457d-22e1-4fec-9c79-e449df21ce40 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1679 microversion: 2.1 time: 0.177473 Oct 04 19:08:46.943153 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2278/6706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:46 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:47.967372 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:47.967989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:47.975646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.976175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.976617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.977314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.977774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.978199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.111229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:48.119014 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-61fd2f0d-9ec2-4966-94c6-7fc5cd6cfd65 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1683 microversion: 2.1 time: 0.156131 Oct 04 19:08:48.119635 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4429/6707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:47 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:10.309137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:10.311439 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:10.313713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=16 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:10.314386 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:10.320219 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.320723 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.321169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.321879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.322342 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.322779 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.377652 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d6d50a33-cdca-434b-beac-8911039d4392 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action" status: 200 len: 59639 microversion: 2.1 time: 0.072581 Oct 04 19:09:10.378332 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2279/6708] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:10 2022] POST /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc/action => generated 59639 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:17.441380 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:17.442057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:17.448850 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=18 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:17.449947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=50 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:17.451727 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.452452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.452990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.453784 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.454354 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.454862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.457018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c6227f-9b21-4f94-8068-b67d0905bafc", "tag": "df4c13e0-844d-4ddc-9114-6a60da53730d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:17.476192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.476707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.478292 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.489398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:17.491022 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] Creating event network-changed:df4c13e0-844d-4ddc-9114-6a60da53730d for instance f5c6227f-9b21-4f94-8068-b67d0905bafc on n-h2-831193-17 Oct 04 19:09:17.496654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-99a4d65a-5cdc-43bf-baf0-cf84920b8a37 req-3104ea51-20e5-4338-8206-8482c17d574c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051850 Oct 04 19:09:17.497717 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2280/6709] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:17.589789 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a582cff-ea48-4367-823b-8dedc56dbc2e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 204 len: 0 microversion: 2.1 time: 0.152772 Oct 04 19:09:17.590768 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4430/6710] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:17 2022] DELETE /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:17.599847 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:17.600570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:17.608600 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.609882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.610527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.611535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.612012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.612462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.773162 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:17.782406 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8c3fe390-30e0-47c6-ac53-e56621327301 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1689 microversion: 2.1 time: 0.186987 Oct 04 19:09:17.782997 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2281/6711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:17 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:18.810821 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:18.812886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:18.826497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.827448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.828831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.829411 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.829958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.830469 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.072422 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:19.081379 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3245b83e-1238-46c0-87f4-f3937f550a24 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1689 microversion: 2.1 time: 0.275145 Oct 04 19:09:19.081979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4431/6712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:18 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1689 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:19.764512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c6227f-9b21-4f94-8068-b67d0905bafc", "name": "network-vif-deleted", "tag": "df4c13e0-844d-4ddc-9114-6a60da53730d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:19.777519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.778365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.779067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.796718 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] Creating event network-vif-deleted:df4c13e0-844d-4ddc-9114-6a60da53730d for instance f5c6227f-9b21-4f94-8068-b67d0905bafc on n-h2-831193-17 Oct 04 19:09:19.803759 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-41dfedb0-7828-4c99-9f75-d80130e68011 req-b76986e6-12f5-4dfd-87d1-5caf927d60f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048154 Oct 04 19:09:19.804411 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2282/6713] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:20.114622 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:20.115330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:20.122028 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.122528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.122954 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.123729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.124197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.125152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.163706 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.164278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.164997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.165465 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lazy-loading 'fault' on Instance uuid f5c6227f-9b21-4f94-8068-b67d0905bafc {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:09:20.210608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:20.219828 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eaa4ef55-2235-4678-af3b-b581ad50eea5 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 200 len: 1356 microversion: 2.1 time: 0.116666 Oct 04 19:09:20.220432 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4432/6714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:20 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.244953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.245807 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: f5c6227f-9b21-4f94-8068-b67d0905bafc] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.254110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.254831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.255538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.256856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.257786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.258661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.275196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] HTTP exception thrown: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Request method failure captured: Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc HTTP/1.1 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIN149M0YRYwkaKXmZLy6-lql7RvdxnkhEUAGWxbad1UF4y033nzOxL7K09ol9VKleGKt8Vh_103zQOlQd0qUEsULGnYTm177kSlD5YIb8kO1QPciSpdu9dK-nqbt1IBAGJdVrPQQ4GWKAUN4E1MWoX0hlZkjGZlBrYqw0QzpyYkRlE Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b8bb873e93f748c38823ac7262556d72 Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': 'f5c6227f-9b21-4f94-8068-b67d0905bafc'} Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:09:21.276917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Returning 404 to user: Instance f5c6227f-9b21-4f94-8068-b67d0905bafc could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2cfb7550-2e24-4b4a-86f3-dca7bcaaff45 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc" status: 404 len: 111 microversion: 2.1 time: 0.038259 Oct 04 19:09:21.282661 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2283/6715] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:21 2022] GET /compute/v2.1/servers/f5c6227f-9b21-4f94-8068-b67d0905bafc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:24.912588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b2b20400-e22a-4527-ab65-14a10ae5a2e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '.version_select at 0x7f6340deeca0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:24.936108 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b2b20400-e22a-4527-ab65-14a10ae5a2e9 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-104462878" status: 202 len: 0 microversion: 2.1 time: 0.027836 Oct 04 19:09:24.936740 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4433/6716] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 19:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-104462878 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:24.968648 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ac525a1e-7052-484c-9466-1e2855ecac0d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: .version_select at 0x7f6340f2c1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1659505446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHPiBxnXA82w26DIxwiqjV0AFWluZb751Ogl3IEz6mxHORq7S891G6On/IXAEXLGtaah4Zbqho8XNr2H324iimAmgEubiMT7Ge3qW0Vo6JU7ps8sflmVA/OJHFz24RwAw=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:24.985344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ac525a1e-7052-484c-9466-1e2855ecac0d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:24.991720 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-ac525a1e-7052-484c-9466-1e2855ecac0d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:25.015559 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ac525a1e-7052-484c-9466-1e2855ecac0d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050834 Oct 04 19:09:25.016169 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2284/6717] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:09:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:30.855332 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1559101542", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "networks": [{"uuid": "14ac01f8-2475-4d6d-86a4-d1c5fa45b38d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1659505446", "security_groups": [{"name": "tempest-secgroup-smoke-1150287382"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:30.869224 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:30.996436 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] validate_networks() for [('14ac01f8-2475-4d6d-86a4-d1c5fa45b38d', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:31.520553 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:31.520991 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:31.521707 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:31.522135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:31.522566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:31.533854 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.534526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.534986 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.535819 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.536618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.537134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.563965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:31.570079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Getting quotas for user b8bb873e93f748c38823ac7262556d72 and project b0f4f021f9b24cb195aeb38f03416101. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:31.589567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:31.592287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:31.657978 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-638eef87-8267-458c-860c-13e78dc3bb5e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806429 Oct 04 19:09:31.658483 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4434/6718] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:31.677746 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-88870a18-5fb7-4dc2-ba28-8e9685407b52 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:31.679354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-88870a18-5fb7-4dc2-ba28-8e9685407b52 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:31.682413 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=16 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:31.742207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-88870a18-5fb7-4dc2-ba28-8e9685407b52 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.750243 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-88870a18-5fb7-4dc2-ba28-8e9685407b52 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1267 microversion: 2.1 time: 0.083898 Oct 04 19:09:31.750838 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2285/6719] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:31 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:32.774720 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-42dba864-0eb0-4d80-b811-d61d61aadc7b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:32.775549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-42dba864-0eb0-4d80-b811-d61d61aadc7b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:32.847673 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-42dba864-0eb0-4d80-b811-d61d61aadc7b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.856486 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-42dba864-0eb0-4d80-b811-d61d61aadc7b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1267 microversion: 2.1 time: 0.086388 Oct 04 19:09:32.863111 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4435/6720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:32 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:33.881561 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63f38074-e087-41b1-ad90-c6febf54e6b4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.882799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-63f38074-e087-41b1-ad90-c6febf54e6b4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.947504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-63f38074-e087-41b1-ad90-c6febf54e6b4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:33.955450 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63f38074-e087-41b1-ad90-c6febf54e6b4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1267 microversion: 2.1 time: 0.078270 Oct 04 19:09:33.956443 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2286/6721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:34.980202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-22111806-e169-43f9-98d9-133e936e1bdb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:34.981170 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-22111806-e169-43f9-98d9-133e936e1bdb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.038868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-22111806-e169-43f9-98d9-133e936e1bdb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.046943 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-22111806-e169-43f9-98d9-133e936e1bdb tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1267 microversion: 2.1 time: 0.070715 Oct 04 19:09:35.048777 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4436/6722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:34 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:36.070922 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:36.071719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:36.079959 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.080611 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.081142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.081889 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.082383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.082822 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.154411 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.163278 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6d5abb11-0170-40de-afc9-fca4c950f7c8 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1271 microversion: 2.1 time: 0.096871 Oct 04 19:09:36.164206 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2287/6723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:36 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:37.186656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.187347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.195299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.195816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.196399 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.197129 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.197602 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.198047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.266703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.274760 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7f9117ba-76fb-4d3b-a38f-31fe3b2b32bd tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1325 microversion: 2.1 time: 0.092049 Oct 04 19:09:37.275562 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4437/6724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:38.266282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821c4b7a-eda2-4ef5-9350-90fe7ce908d4", "tag": "1484db85-8904-4adc-b924-4ba2bb014690"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:38.280935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.282346 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.283522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.301334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.302904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.307917 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] Creating event network-changed:1484db85-8904-4adc-b924-4ba2bb014690 for instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 on n-h1-831193-17 Oct 04 19:09:38.310751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.311315 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.313191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.313918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.314402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.316093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.318125 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a8632acc-aa0b-4a60-ad0a-7280eab7202f req-8c046631-6e72-4870-a679-ff93d8451d7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059971 Oct 04 19:09:38.325759 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2288/6725] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:38.469314 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:38.477647 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4233939d-b441-4078-a812-ed573a2fe11d tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.181633 Oct 04 19:09:38.478235 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4438/6726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:39.507373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.508129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.514782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.515323 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.516616 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.517186 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.517659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.518156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.659185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.668501 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c38e0bca-1232-435e-ad06-ac2a7c95fb4f tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.166202 Oct 04 19:09:39.669091 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2289/6727] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:39 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:40.692130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.692755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.700235 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.700732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.701178 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.701880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.702342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.702777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.847774 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.855918 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-4894e107-add1-49c7-8db2-fbb672d73e95 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.167622 Oct 04 19:09:40.856697 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4439/6728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.881429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.882062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.885095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:41.890839 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.891542 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.892066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.892782 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.893254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.893702 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.029947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.038020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4c276c9d-42a1-4159-b18e-53ef1f76fef4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.161024 Oct 04 19:09:42.038605 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2290/6729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:42.989541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:43.044093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c4b7a-eda2-4ef5-9350-90fe7ce908d4", "name": "network-vif-plugged", "status": "completed", "tag": "1484db85-8904-4adc-b924-4ba2bb014690"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:43.054605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.055143 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.055579 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.061964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.062772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.067812 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] Creating event network-vif-plugged:1484db85-8904-4adc-b924-4ba2bb014690 for instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 on n-h1-831193-17 Oct 04 19:09:43.069760 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.070338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.070866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.071698 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.072234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.072629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.073086 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4c07d5d5-b6a5-42f9-ae67-8e170c009388 req-c6cc16e3-f703-4ef4-ae80-9a64054822c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088002 Oct 04 19:09:43.076886 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4440/6730] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:43.216495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:43.224761 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-fac55e03-9673-4d97-b7e8-c49be7908543 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.166685 Oct 04 19:09:43.225339 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2291/6731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:44.249820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:44.250529 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:44.257926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.258434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.258893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.259635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.260101 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.260538 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.402131 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.410533 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1ffc0368-b1c3-46af-95d4-550408ff1110 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1393 microversion: 2.1 time: 0.166168 Oct 04 19:09:44.411139 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4441/6732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:44 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:45.434223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:45.434784 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:45.436650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=8 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:45.444479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.444987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.445445 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.446169 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.446791 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.447123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.583531 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.591511 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-276b52cd-59ce-43af-9dd5-87d843688d1c tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1565 microversion: 2.1 time: 0.161363 Oct 04 19:09:45.592094 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2292/6733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:45 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:45.615345 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:45.615965 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:45.618005 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:45.624756 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.625258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.625708 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.626420 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.626883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.627347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.765057 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.773447 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e334d99-d7e2-4dcc-a395-c9c49f223ec0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1565 microversion: 2.1 time: 0.162165 Oct 04 19:09:45.774026 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4442/6734] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:45 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:47.366228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.366859 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.369259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821c4b7a-eda2-4ef5-9350-90fe7ce908d4", "tag": "1484db85-8904-4adc-b924-4ba2bb014690"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:47.375550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.376433 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.377129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.378114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.378972 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.379533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.381846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.382337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.383407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.395338 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] Creating event network-changed:1484db85-8904-4adc-b924-4ba2bb014690 for instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 on n-h1-831193-17 Oct 04 19:09:47.400623 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4e4c7bdc-8713-4995-8228-6722adfb9f6d req-d5c3096a-b61d-47e9-9e65-ab89d5bb5135 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035302 Oct 04 19:09:47.401230 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4443/6735] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:47.532382 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:47.541138 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-66884b31-71d0-4167-9b39-0bcb7c9c8aa6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1565 microversion: 2.1 time: 0.178606 Oct 04 19:09:47.542109 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2293/6736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:47 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:08.805198 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:08.806023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=36 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:08.810212 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:08.812513 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:08.819959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.820455 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.820945 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.821633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.822187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.822522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.876524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-75a1e132-f715-487e-8190-256099c75012 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action" status: 200 len: 24574 microversion: 2.1 time: 0.073228 Oct 04 19:10:08.877172 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4444/6737] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:08 2022] POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:10:19.909877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:19.910450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:19.912717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=7 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:19.913594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=38 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:19.919395 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.919909 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.920365 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.921120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.921572 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.922019 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.945866 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lazy-loading 'flavor' on Instance uuid 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:20.014260 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1fc4443e-c94d-45c1-865c-456378e1532e tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action" status: 202 len: 0 microversion: 2.1 time: 0.108555 Oct 04 19:10:20.014906 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2294/6738] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:19 2022] POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:20.026595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:20.027355 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:20.030369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=4 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:20.031019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:20.039294 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.040094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.040500 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.041238 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.041719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.042148 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.189265 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.197262 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb0fdcd5-b67d-4b40-845d-97ee714a8479 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1691 microversion: 2.1 time: 0.175966 Oct 04 19:10:20.197840 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4445/6739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:20 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:21.225164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:21.225921 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:21.232404 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.232928 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.233383 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.234111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.234586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.235060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.373050 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.380970 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5f7b65fc-197d-4e6d-9800-0cbaadb3f4c0 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1674 microversion: 2.1 time: 0.161831 Oct 04 19:10:21.381545 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2295/6740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:21 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.477134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.480132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.494327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.494918 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.495519 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.496388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.497036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.497652 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.556180 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b02ad441-dbb8-4b64-a948-77af4d7991e4 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action" status: 200 len: 38344 microversion: 2.1 time: 0.084136 Oct 04 19:10:22.557018 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4446/6741] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action => generated 38344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:10:22.569665 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.570229 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.577224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.577730 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.578187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.578911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.579416 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.579864 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.651020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6108e737-78e6-47a8-a09d-558b43fb9b27 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action" status: 202 len: 0 microversion: 2.1 time: 0.085074 Oct 04 19:10:22.651693 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2296/6742] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:22.661507 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.662397 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.671755 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.672385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.673545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.674266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.674728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.675181 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.836967 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.845940 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bef45d6f-0c45-47d6-9059-c39cfb9d98f3 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1680 microversion: 2.1 time: 0.188749 Oct 04 19:10:22.846532 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4447/6743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:23.877327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.878614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.889060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.889924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.890710 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.891953 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.892770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.893544 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.061582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.069999 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ba8d2bf4-dda9-49aa-989d-e553a50b1c61 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1680 microversion: 2.1 time: 0.200280 Oct 04 19:10:24.070593 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2297/6744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:23 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:25.096252 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.096857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.103635 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.104147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.104603 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.105324 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.105824 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.106263 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.243231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:25.251524 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70c3f8e6-11bd-4804-a1a1-9c74cc84168b tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1683 microversion: 2.1 time: 0.159988 Oct 04 19:10:25.252102 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4448/6745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:25.358232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:25.361519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.368482 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.369128 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.369588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.370341 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.370977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.371742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.414654 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-23a0a384-9cc7-478b-a35b-e6b56faec237 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action" status: 200 len: 38344 microversion: 2.1 time: 0.061234 Oct 04 19:10:25.415341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2298/6746] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:25 2022] POST /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4/action => generated 38344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:10:26.420718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.421246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.423371 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821c4b7a-eda2-4ef5-9350-90fe7ce908d4", "tag": "1484db85-8904-4adc-b924-4ba2bb014690"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:26.430234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.430443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.430889 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.431644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.432268 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.432973 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.435207 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.435700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.436705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.453214 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] Creating event network-changed:1484db85-8904-4adc-b924-4ba2bb014690 for instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 on n-h1-831193-17 Oct 04 19:10:26.458826 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-45715cab-3991-4b17-8ba8-a31fb2042145 req-0568bb9d-429e-46e3-ba2a-3bdf0f0dc653 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040031 Oct 04 19:10:26.459562 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2299/6747] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:26.462799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:26.551305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-525ab60f-6419-44c5-aea0-e61c4f8533e2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 204 len: 0 microversion: 2.1 time: 0.134974 Oct 04 19:10:26.556652 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4449/6748] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:26 2022] DELETE /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:26.564567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.565684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.577697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.578747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.579540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.580575 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.581237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.581918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.728513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.737477 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-dac15609-1aaf-4718-9c32-9c4f04bba3d1 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1689 microversion: 2.1 time: 0.179199 Oct 04 19:10:26.738059 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2300/6749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:26 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:27.762724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:27.763473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:27.770280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.770782 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.771279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.771987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.772457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.772898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.911333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.919674 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d78537f1-14c3-4450-94a4-4ba0555ffbb2 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1689 microversion: 2.1 time: 0.161304 Oct 04 19:10:27.920254 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4450/6750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:27 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:28.630429 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c4b7a-eda2-4ef5-9350-90fe7ce908d4", "name": "network-vif-deleted", "tag": "1484db85-8904-4adc-b924-4ba2bb014690"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:28.645550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.645965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.646417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.659223 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] Creating event network-vif-deleted:1484db85-8904-4adc-b924-4ba2bb014690 for instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 on n-h1-831193-17 Oct 04 19:10:28.664172 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-64cbf904-0044-4789-b92a-2274b21ce0b7 req-3868b341-8b87-40bc-9f08-be8a7f5724c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037648 Oct 04 19:10:28.665361 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2301/6751] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:28.943304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:28.943940 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:28.951515 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.952024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.952470 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.953189 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.953649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.954876 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.994125 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.994634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.995102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.995571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lazy-loading 'fault' on Instance uuid 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:29.050330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bb873e93f748c38823ac7262556d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f021f9b24cb195aeb38f03416101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:29.059948 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1925671c-3c30-477b-b61f-477db6ec76e6 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 200 len: 1357 microversion: 2.1 time: 0.120583 Oct 04 19:10:29.060552 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4451/6752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:28 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:30.087244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:30.087994 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] [instance: 821c4b7a-eda2-4ef5-9350-90fe7ce908d4] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:30.094332 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.095554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.096302 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.096727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.097203 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.097649 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.111203 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] HTTP exception thrown: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Request method failure captured: Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 HTTP/1.1 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIN149M0YRYwkaKXmZLy6-lql7RvdxnkhEUAGWxbad1UF4y033nzOxL7K09ol9VKleGKt8Vh_103zQOlQd0qUEsULGnYTm177kSlD5YIb8kO1QPciSpdu9dK-nqbt1IBAGJdVrPQQ4GWKAUN4E1MWoX0hlZkjGZlBrYqw0QzpyYkRlE Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0f4f021f9b24cb195aeb38f03416101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: b0f4f021f9b24cb195aeb38f03416101 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-817510078 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: b8bb873e93f748c38823ac7262556d72 Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-817510078-project Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '821c4b7a-eda2-4ef5-9350-90fe7ce908d4'} Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:10:30.112917 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Returning 404 to user: Instance 821c4b7a-eda2-4ef5-9350-90fe7ce908d4 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7af99570-d185-430d-acbc-882254b29c36 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4" status: 404 len: 111 microversion: 2.1 time: 0.032752 Oct 04 19:10:30.117701 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2302/6753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:30 2022] GET /compute/v2.1/servers/821c4b7a-eda2-4ef5-9350-90fe7ce908d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:33.861475 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-88d4b2ee-4269-48cd-82d3-a23882107127 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] Calling method '.version_select at 0x7f6340bccd30>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:33.884928 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-88d4b2ee-4269-48cd-82d3-a23882107127 tempest-TestNetworkAdvancedServerOps-817510078 tempest-TestNetworkAdvancedServerOps-817510078-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659505446" status: 202 len: 0 microversion: 2.1 time: 0.026762 Oct 04 19:10:33.885693 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4452/6754] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 19:10:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659505446 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:45.192251 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=18 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:45.192750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:45.407799 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1505a4b0-f127-4d1a-b73b-c01b733c6427 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'create', calling method: .version_select at 0x7f63417abee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-232427237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnooZguusMfloHsJF0C0RTSOcSMyZJcIzwWOwUpJE91lL7nvTo4jqdlxcyyhtE6KAB/u3YQV6y52ERcPFN2CxKbZLfyc2XxD2NwLcibvkr59BXB8+sxrWD+9Jx+M3gxaQ=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:45.424438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1505a4b0-f127-4d1a-b73b-c01b733c6427 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for project 0e8b1042912a49c1b7b194675165bea4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:45.430867 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1505a4b0-f127-4d1a-b73b-c01b733c6427 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for user 2bada9540169440d8bed54249fda7405 and project 0e8b1042912a49c1b7b194675165bea4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:45.463722 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1505a4b0-f127-4d1a-b73b-c01b733c6427 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.279097 Oct 04 19:10:45.464341 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2303/6755] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:10:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:46.485792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:46.486647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:46.490743 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1313520209", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-232427237", "security_groups": [{"name": "tempest-secgroup-smoke-1785563807"}], "networks": [{"uuid": "b7f8ddaa-1ab3-4ba6-9e55-6279ce5f21c5"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:46.611431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] validate_networks() for [('b7f8ddaa-1ab3-4ba6-9e55-6279ce5f21c5', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:47.001433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:47.001862 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:47.002342 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:47.002752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:47.003247 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:47.013935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:47.015135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:47.016038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:47.017845 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:47.018650 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:47.019497 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:47.040728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for project 0e8b1042912a49c1b7b194675165bea4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:47.047927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for user 2bada9540169440d8bed54249fda7405 and project 0e8b1042912a49c1b7b194675165bea4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:47.061781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:47.064978 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:47.115969 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-913863e7-5c55-4fbf-8a0f-f86cd3938bc2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.631804 Oct 04 19:10:47.116979 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4453/6756] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:47.130079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-b9840d9d-955f-4f31-8679-738935688ac6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:47.131594 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-b9840d9d-955f-4f31-8679-738935688ac6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:47.209282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-b9840d9d-955f-4f31-8679-738935688ac6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:47.218308 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-b9840d9d-955f-4f31-8679-738935688ac6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1246 microversion: 2.1 time: 0.093704 Oct 04 19:10:47.219697 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2304/6757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:47 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:48.247443 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:48.248644 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:48.255823 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.256524 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.257149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.258187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.258657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.259279 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.336425 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:48.346151 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2a10cf08-d5b7-4424-8677-aea5db263d38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1298 microversion: 2.1 time: 0.103606 Oct 04 19:10:48.346878 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4454/6758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:48 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:49.370453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:49.371783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:49.384092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:49.385080 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:49.385947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:49.386955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:49.387633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:49.388081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:49.645421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:49.653765 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8831a952-44fd-41de-b195-464bd15407f3 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.287600 Oct 04 19:10:49.654715 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2305/6759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:49 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:50.367777 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:50.380526 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.381323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.381765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.394799 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] Creating event network-changed:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h2-831193-17 Oct 04 19:10:50.400301 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f25b0820-87f0-4a32-9a19-411c3d1e5c94 req-89bb154e-9c30-4e39-b677-eb3e0e78ae28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037490 Oct 04 19:10:50.400931 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4455/6760] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:50.677974 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:50.679303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:50.687505 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.688736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.689200 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.689943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.690419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.690862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.897623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:50.905867 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-71654d14-2c17-45c0-b7e4-4b21cd655f21 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.231898 Oct 04 19:10:50.906977 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2306/6761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:50 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:51.931614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:51.932946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:51.940208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.940709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.941369 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.941873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.942333 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.942766 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.175605 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:52.189245 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-9200fa48-61d9-4d1e-891f-356097bd5854 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.263128 Oct 04 19:10:52.190049 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4456/6762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:51 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.212797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:53.213432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:53.220586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.221095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.221577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.222303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.222763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.223249 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.358455 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.366943 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4f0789b5-bd9d-4e76-80a3-c9fbd83e3064 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.158078 Oct 04 19:10:53.367560 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2307/6763] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:53 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:54.392510 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.393063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.399539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.400033 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.400476 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.401185 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.401728 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.402123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.536809 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.545297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-858f7aa1-086b-4261-b168-0ed933f08a8c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.157404 Oct 04 19:10:54.545888 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4457/6764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:55.568598 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.569174 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.576123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.576618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.577068 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.577775 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.578764 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.579239 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.717458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:55.726098 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a43bc3b0-28bc-404a-be40-3a1ef7e24c7c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.161478 Oct 04 19:10:55.726678 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2308/6765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.587286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "name": "network-vif-plugged", "status": "completed", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:56.599347 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.599844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.600284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.613703 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] Creating event network-vif-plugged:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h2-831193-17 Oct 04 19:10:56.619056 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1c24042b-7f3a-4711-aca1-bad42c68750a req-d762cfdf-58e6-4249-b71c-9af7c721b8c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Oct 04 19:10:56.619688 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4458/6766] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:56.757797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:56.758431 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.766242 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.766797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.767285 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.768018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.768583 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.769027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.913312 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.921992 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9141a054-e43f-4589-9f82-91122091c40a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1372 microversion: 2.1 time: 0.168180 Oct 04 19:10:56.922583 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2309/6767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:56 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:57.943167 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:57.943868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:57.948908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:57.949623 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:57.956980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.957481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.957925 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.958649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.959140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.959577 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.173518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.181732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c4cf2877-bc77-411f-93fa-340ccefaa052 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1556 microversion: 2.1 time: 0.239611 Oct 04 19:10:58.182622 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4459/6768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:58.204677 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:58.205134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:58.207215 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:58.214013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.214522 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.214977 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.215757 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.216261 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.216708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.425906 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.434606 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-94cf4e79-abbc-401a-9109-923a0f974127 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1556 microversion: 2.1 time: 0.234009 Oct 04 19:10:58.435368 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2310/6769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:58 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.629240 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:00.638910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.639434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.639872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.651933 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] Creating event network-changed:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h2-831193-17 Oct 04 19:11:00.657024 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-2b8a136e-408d-4fdb-8230-574d733a6599 req-df00cc3c-7462-4672-9998-6736a336663e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117777 Oct 04 19:11:00.657711 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4460/6770] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:12:55.659504 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:12:55.660824 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:12:55.661374 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:55.662234 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=36 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:55.663318 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:12:55.663460 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action (ip 10.222.0.33) !!! Oct 04 19:12:55.664908 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:12:55.665051 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action (ip 10.222.0.33) !!! Oct 04 19:12:55.667014 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:12:55.667159 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action (ip 10.222.0.33) !!! Oct 04 19:12:55.671497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:55.672045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:55.690570 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.691088 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.691545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:55.692895 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.693373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.693816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:55.717523 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lazy-loading 'flavor' on Instance uuid 58397b33-17e3-4990-ae75-03bbab598462 {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:55.903148 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54daf7e4-6c05-4f29-91a2-96eaf0d218cb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action" status: 202 len: 0 microversion: 2.1 time: 0.245293 Oct 04 19:12:55.903761 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2311/6771] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:12:55 2022] POST /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:55.911423 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:12:55.912248 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:12:55.912929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:55.913883 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=32 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:55.916234 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:12:55.916466 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 (ip 10.222.0.33) !!! Oct 04 19:12:55.930984 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:55.932052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:55.944672 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.945596 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.946038 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:55.946744 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.947236 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.947663 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:56.155836 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:56.164453 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-83ed1e9b-ac6e-44cc-beb5-17aa42c25ee7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.255823 Oct 04 19:12:56.165236 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4461/6772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:55 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:57.190803 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:57.191504 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:57.201852 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:57.202355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:57.202808 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:57.203547 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:57.204014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:57.204454 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:57.208310 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33020. Oct 04 19:12:57.211384 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33018. Oct 04 19:12:57.340307 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:57.348425 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9b7b8f1d-b567-4eed-b78d-835cc1cea2f1 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.163157 Oct 04 19:12:57.348995 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2312/6773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:57 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:58.372306 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:58.372929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:58.381956 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:58.382456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:58.382908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:58.383659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:58.384130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:58.384571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:58.389276 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33024. Oct 04 19:12:58.392280 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33026. Oct 04 19:12:58.521944 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:58.529841 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-0f9a09ff-93b6-4b99-8675-e1ce05a0c5a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.161561 Oct 04 19:12:58.530428 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4462/6774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:58 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:59.554034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:59.554798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:59.562030 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:59.562533 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:59.562978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:59.563717 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:59.564181 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:59.564621 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:59.796741 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:59.804744 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9cad3fe9-2a39-4a70-a6ed-066e55fc9ff5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.254629 Oct 04 19:12:59.805419 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2313/6775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:59 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:00.829123 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:00.829871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:00.837431 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:00.837926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:00.838374 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:00.839107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:00.839575 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:00.840007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:00.970356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:00.978841 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5312a303-979b-45a2-ab2d-aff2e4c5693b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.153693 Oct 04 19:13:00.979450 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4463/6776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:00 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:02.001884 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:02.002497 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:02.010034 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:02.010529 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:02.010975 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:02.011696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:02.012161 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:02.012599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:02.142602 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:02.150765 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6f00f2f-9a8a-48ee-8d19-91555a5362eb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.152818 Oct 04 19:13:02.151377 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2314/6777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:01 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:03.176948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:03.178052 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:03.184923 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:03.185416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:03.185858 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:03.186593 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:03.187074 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:03.187514 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:03.323684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:03.331465 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-276fb727-613b-4f5d-8042-7dcbe997f16f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.158494 Oct 04 19:13:03.332035 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4464/6778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:03 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:04.354581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:04.355337 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:04.362387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:04.362950 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:04.363432 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:04.364146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:04.364608 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:04.365046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:04.498620 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:04.507010 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-15a9294c-757f-4d24-bad3-9f92d250a53f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.156426 Oct 04 19:13:04.507613 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2315/6779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:04 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:05.531951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:05.532732 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:05.540477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:05.540987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:05.541434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:05.542151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:05.542616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:05.543077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:05.679322 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:05.687251 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-def7f6bc-c939-4247-8117-52f9738dc08d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.159200 Oct 04 19:13:05.687835 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4465/6780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:05 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:06.709936 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:06.710601 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:06.717725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:06.718223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:06.718678 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:06.719442 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:06.719914 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:06.720355 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:06.855123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:06.862881 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-32bc6731-46b7-485b-bc3f-6bf639e4df1c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1701 microversion: 2.1 time: 0.156876 Oct 04 19:13:06.863492 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2316/6781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:06 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:07.887520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:07.888139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:07.895134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:07.895625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:07.896099 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:07.896791 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:07.897277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:07.897709 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:08.032147 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:08.041540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69d11e75-e2ea-449f-bf74-6b9a6b52f228 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.157903 Oct 04 19:13:08.042121 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4466/6782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:07 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:09.076686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:09.077965 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:09.087858 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:09.089214 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:09.090224 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:09.091584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:09.092299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:09.093002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:09.258469 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:09.267176 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7267e84f-8602-4e09-a66c-6863486daa36 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.196391 Oct 04 19:13:09.284006 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2317/6783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:09 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:10.293983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:10.294608 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:10.302901 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:10.303631 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:10.304715 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:10.305682 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:10.306359 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:10.307103 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:10.469280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:10.478780 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6c061c59-1e62-448f-b859-368b81c170e6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.188401 Oct 04 19:13:10.480235 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4467/6784] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:10 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:11.147099 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "name": "network-vif-plugged", "status": "completed", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:11.174512 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:11.175187 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:11.175705 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:11.202320 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] Creating event network-vif-plugged:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h2-831193-17 Oct 04 19:13:11.212968 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-227fc68f-ccdd-43ac-b232-d86e6b8418c4 req-cecfb88e-b5a8-4628-9790-eca6bccd9f77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071793 Oct 04 19:13:11.219213 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2318/6785] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:11.503749 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:11.504360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:11.513794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:11.514648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:11.515327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:11.516267 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:11.516939 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:11.517558 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:11.678187 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:11.687124 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ce4b9a27-17b0-40ac-9c43-b41883270752 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.187542 Oct 04 19:13:11.695900 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4468/6786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:11 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:12.713996 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:12.715474 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:12.723137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:12.724054 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:12.724699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:12.725766 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:12.726244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:12.726684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:12.887131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:12.895374 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0f28042e-f5c4-445e-b764-c6cbf4d4c682 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.185566 Oct 04 19:13:12.906732 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2319/6787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:12 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:13.919751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:13.920534 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:13.930293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:13.930898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:13.931350 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:13.932806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:13.933293 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:13.933736 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:14.092942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:14.102561 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62c3f764-3a36-49dd-819b-40259f0f3aae tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.186819 Oct 04 19:13:14.115780 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4469/6788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:13 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:15.129635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:15.130238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:15.137506 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:15.138012 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:15.138467 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:15.139213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:15.139688 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:15.140133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:15.305185 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:15.315722 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-54c39e8f-e442-4227-8586-5c159d863e61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.192060 Oct 04 19:13:15.316325 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2320/6789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:15 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:16.341175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:16.341835 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:16.350080 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:16.350587 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:16.351055 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:16.351793 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:16.352257 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:16.352718 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:16.519691 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:16.527625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fca416a0-52ea-45cc-a894-3b434c55c7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.190617 Oct 04 19:13:16.528257 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4470/6790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:16 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:17.552538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:17.553164 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:17.560165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:17.560664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:17.561114 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:17.561816 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:17.562281 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:17.562718 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:17.698278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:17.706249 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e834ff96-f2b4-4240-8154-fbf0cbdcfc46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1696 microversion: 2.1 time: 0.157642 Oct 04 19:13:17.706826 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2321/6791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:17 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:18.732335 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:18.732959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:18.740818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:18.741292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:18.741738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:18.742440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:18.742904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:18.743370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:18.875230 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:18.883185 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f9b4c4ef-17a8-46a5-a16c-fac625b35b38 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1678 microversion: 2.1 time: 0.154700 Oct 04 19:13:18.883765 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4471/6792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:18 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:19.906835 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:19.907719 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:19.916699 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:19.917762 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:19.918238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:19.918963 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:19.919468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:19.919912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:20.055679 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:20.063435 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-6b29cb22-43b5-49a5-a14a-5fb9bd669a3f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1681 microversion: 2.1 time: 0.160449 Oct 04 19:13:20.064011 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2322/6793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:19 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:20.086165 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:20.086781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:20.093687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:20.094202 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:20.094783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:20.095539 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:20.096016 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:20.096456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:20.140047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:13:20.213410 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:13:21.104309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "name": "network-vif-unplugged", "status": "completed", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:21.115540 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:21.116070 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:21.116541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:21.131633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.compute.server_external_events [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] Unable to find a host for instance 58397b33-17e3-4990-ae75-03bbab598462. Dropping event network-vif-unplugged {{(pid=128771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:13:21.132572 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-891fca0d-1452-472b-9ac1-99b45f7f3e15 req-86a0ed02-e224-4f92-a7fc-7b48aed573af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032290 Oct 04 19:13:21.133171 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2323/6794] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:13:21.219935 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [9f5132cc-fc2c-4556-9fea-21524d6435f3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33130. Oct 04 19:13:21.223219 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a01640f3-0873-4198-a55c-9cb9c73d82bb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action" status: 202 len: 0 microversion: 2.1 time: 1.140981 Oct 04 19:13:21.224444 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4472/6795] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:13:20 2022] POST /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462/action => generated 0 bytes in 1143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:13:21.232459 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:21.233089 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:21.239111 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:21.239686 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:21.240211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:21.240929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:21.241405 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:21.241853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:21.383331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:21.391081 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a8ec2a61-66f6-4b37-91ef-dc548c5e7012 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1629 microversion: 2.1 time: 0.162490 Oct 04 19:13:21.391655 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2324/6796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:21 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:22.417339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:22.417873 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:22.424968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:22.425456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:22.425896 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:22.426592 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:22.427711 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:22.428144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:22.569076 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:22.576873 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f8c4ca80-6017-41ee-8aac-8b98e18c270b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.164582 Oct 04 19:13:22.577458 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4473/6797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:22 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:23.355636 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:23.367212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:23.367707 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:23.368157 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:23.379263 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] Creating event network-changed:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h1-831193-17 Oct 04 19:13:23.384455 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-3b6e40ab-5e12-4a08-950e-9e459c132751 req-0d169dd1-144b-43ca-a495-9a0d08868c11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032498 Oct 04 19:13:23.385062 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2325/6798] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:23.601144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:23.601765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:23.608571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:23.609071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:23.609522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:23.610234 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:23.610702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:23.611162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:23.755428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:23.763765 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e166f497-9432-47e2-8ac5-696b49a99abf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.167059 Oct 04 19:13:23.764356 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4474/6799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:23 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:24.791280 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:24.792167 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:24.799137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:24.799659 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:24.800105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:24.800863 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:24.801336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:24.802440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:24.951599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:24.964676 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a46d1398-773b-4455-9ead-67e0f4c8780b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.179832 Oct 04 19:13:24.965277 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2326/6800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:24 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:25.991521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:25.992385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:25.995722 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:26.001266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:26.001857 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:26.002517 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:26.003346 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:26.003886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:26.004398 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:26.008864 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:26.158482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:26.168292 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6629b796-faf4-4ee3-9c64-f1227ba7721e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.182278 Oct 04 19:13:26.174359 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4475/6801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:25 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:27.194020 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:27.194643 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:27.197539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=33 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:27.204456 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:27.204961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:27.205408 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:27.206142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:27.206604 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:27.207078 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:27.209880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:27.370079 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:27.383055 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4ab3f0a0-1dab-4fb6-b23a-8650dad424df tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.194078 Oct 04 19:13:27.383902 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2327/6802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:27 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:28.408159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:28.409032 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:28.416426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:28.416934 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:28.417383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:28.418098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:28.418564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:28.418998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:28.563837 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:28.573126 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-a5720210-4a75-4fe9-bef9-3eeff458ac12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.168863 Oct 04 19:13:28.574028 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4476/6803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:28 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:29.597831 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:29.598499 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:29.606196 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:29.606695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:29.607176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:29.607892 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:29.608361 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:29.608798 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:29.757840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:29.770000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9c9c2092-d6f6-4bb5-a5f8-cfa3a42d6e7b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.176053 Oct 04 19:13:29.771168 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2328/6804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:29 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:30.794677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:30.795371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:30.811281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:30.812353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:30.812968 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:30.813904 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:30.814702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:30.815300 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:30.969063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:30.979234 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-af4a24a6-f72a-447c-b3c8-5d46adcd5a44 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.188246 Oct 04 19:13:30.980075 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4477/6805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:30 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:32.003893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:32.004527 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:32.012083 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.012577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.013029 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.013736 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.014211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.014652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.149841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:32.157813 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1d1bc858-0fc7-43e9-991b-357e5d2d0c8a tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.157830 Oct 04 19:13:32.158409 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2329/6806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:31 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:33.182405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:33.182985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:33.189737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:33.190225 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:33.190658 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:33.191389 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:33.191843 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:33.192868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:33.324772 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:33.332540 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7acccb85-f91d-454a-80d0-a0060681b7d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.154140 Oct 04 19:13:33.333118 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4478/6807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:33 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:34.356201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:34.356926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:34.364221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:34.364935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:34.365271 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:34.366053 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:34.367095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:34.367609 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:34.561614 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:34.570293 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f758f55d-32e0-47fc-9e73-1d0961420982 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.217996 Oct 04 19:13:34.570910 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2330/6808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:34 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:35.593806 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:35.594407 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:35.602151 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:35.602647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:35.603113 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.603817 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:35.604285 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:35.604716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.765053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:35.775566 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1245d6e7-fc3f-4db4-85a7-4231750ae591 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.185533 Oct 04 19:13:35.776468 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4479/6809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:35 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:36.254630 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "name": "network-vif-plugged", "status": "completed", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:36.265507 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:36.266000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:36.266657 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:36.278705 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] Creating event network-vif-plugged:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h1-831193-17 Oct 04 19:13:36.283793 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-c05e503c-214e-44d7-9601-9e40ee3a9884 req-5059d154-c014-423f-86ee-7d97a09e395e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Oct 04 19:13:36.284390 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2331/6810] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:36.800730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:36.801311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:36.808246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:36.808747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:36.809199 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:36.809910 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:36.810383 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:36.810852 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:36.947386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:36.955215 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c73fe277-a082-4248-a43e-af90927bc850 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.158484 Oct 04 19:13:36.955797 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4480/6811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:36 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:37.980940 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:37.981666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:37.988729 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:37.989131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:37.989585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:37.990326 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:37.990797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:37.991269 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:38.129175 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:38.138420 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7d21083f-b17b-413f-9015-50eebba1cc50 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1687 microversion: 2.1 time: 0.163160 Oct 04 19:13:38.139048 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2332/6812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:37 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:13:39.164219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:39.165140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:39.172102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.172595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.173036 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.173733 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.174191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.174619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.303309 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:39.311607 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e5cfa597-75f5-4868-9f35-1b7e9f1acdaa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1674 microversion: 2.1 time: 0.151896 Oct 04 19:13:39.312184 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4481/6813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:39 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:49.247832 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=11 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:49.248656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=13 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:49.249942 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=41 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:49.251027 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=31 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:49.251181 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:14:49.251366 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:14:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 19:14:49.256254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:49.258763 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:49.259327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:49.267918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:49.268797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:49.269352 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:49.269726 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:49.269938 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:49.270363 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:49.270530 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:49.271142 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:49.271599 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:49.283625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] Creating event network-changed:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h1-831193-17 Oct 04 19:14:49.290911 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-4d4c78f2-91ec-457f-b4b4-66e912a24ab7 req-49c19565-a21b-4ff8-809e-5886393fd8ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043990 Oct 04 19:14:49.295310 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4482/6814] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:14:49.303918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:14:49.395217 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e54b00ab-923a-4a1b-849e-f224fee23c81 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "DELETE /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 204 len: 0 microversion: 2.1 time: 0.150315 Oct 04 19:14:49.396296 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2333/6815] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:14:49 2022] DELETE /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:14:49.405276 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:49.406405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:49.413897 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:49.414670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:49.415506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:49.416311 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:49.416754 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:49.417139 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:49.579951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:49.589356 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-2d020df2-4298-41fb-9911-b92bc8a6eada tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.188684 Oct 04 19:14:49.590481 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4483/6816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:49 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:50.616770 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:50.617495 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:50.626107 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:50.627126 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:50.627706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:50.628517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:50.629131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:50.629584 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:50.778955 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:50.789397 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca16215f-c521-46af-af70-74fecba30c4c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 200 len: 1680 microversion: 2.1 time: 0.177782 Oct 04 19:14:50.790346 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2334/6817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:50 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:51.307905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58397b33-17e3-4990-ae75-03bbab598462", "name": "network-vif-deleted", "tag": "7e426a3c-b3c7-4915-a4b2-c703bc5d554c"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:51.319694 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:51.320192 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:51.320826 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:51.332713 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] Creating event network-vif-deleted:7e426a3c-b3c7-4915-a4b2-c703bc5d554c for instance 58397b33-17e3-4990-ae75-03bbab598462 on n-h1-831193-17 Oct 04 19:14:51.338134 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-ccdb952e-2f7f-44a7-bb2d-c4b59b6de409 req-31f6326d-9fc7-4023-9293-9816b536a819 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Oct 04 19:14:51.338751 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4484/6818] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:51.816438 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:51.817101 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: 58397b33-17e3-4990-ae75-03bbab598462] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:51.825559 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:51.826002 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:51.826452 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:51.827368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:51.828635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:51.829715 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:51.845419 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.wsgi [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] HTTP exception thrown: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Request method failure captured: Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: request: GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 HTTP/1.1 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Accept: application/json Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Accept-Encoding: identity Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Connection: close Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Content-Length: 0 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Content-Type: application/json Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Host: 10.222.0.33 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: Openstack-System-Scope: None Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Auth-Token: gAAAAABjPIUvGjEFlifCezlj-dLOixBnrFzS5PkYJcMPEJA1onpto6fNPfODJ5v6Vzxs5U6_Yp6c7Z5SO46a4b1WI5cX0V4eKopAOZLTrTc0VW7zPetRtj-GjVsMXqAMp7373bCv-zwE55z01Bk5bl3Ix70csandY5wVHnB9EJKUsEW83P0Xw0M Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Id: None Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Domain-Name: None Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Identity-Status: Confirmed Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Is-Admin-Project: True Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Id: default Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Domain-Name: Default Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Id: 0e8b1042912a49c1b7b194675165bea4 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Project-Name: tempest-TestShelveInstance-1504347416 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Role: reader,member Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Roles: reader,member Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant: tempest-TestShelveInstance-1504347416 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Id: 0e8b1042912a49c1b7b194675165bea4 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-Tenant-Name: tempest-TestShelveInstance-1504347416 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-User: tempest-TestShelveInstance-1504347416-project Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Id: default Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-User-Domain-Name: Default Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-User-Id: 2bada9540169440d8bed54249fda7405 Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: X-User-Name: tempest-TestShelveInstance-1504347416-project Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: method: > Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: exception: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: action_args: {'id': '58397b33-17e3-4990-ae75-03bbab598462'} Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:51.847204 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: ERROR nova.api.openstack.wsgi Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Returning 404 to user: Instance 58397b33-17e3-4990-ae75-03bbab598462 could not be found. {{(pid=128771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2d66a5f2-e79b-40e1-958b-58f754ae7b61 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462" status: 404 len: 111 microversion: 2.1 time: 0.036974 Oct 04 19:14:51.852461 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2335/6819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:51 2022] GET /compute/v2.1/servers/58397b33-17e3-4990-ae75-03bbab598462 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:14:52.024780 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6749eb9d-cdb0-4e3e-ad48-b770c4c3173e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '.version_select at 0x7f63419f29d0>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:52.068120 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6749eb9d-cdb0-4e3e-ad48-b770c4c3173e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-232427237" status: 202 len: 0 microversion: 2.1 time: 0.049729 Oct 04 19:14:52.069140 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4485/6820] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 19:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-232427237 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:14:52.095821 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-1f19e2a2-be53-4467-806c-78efd5b0b339 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'create', calling method: .version_select at 0x7f6341f54c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-297396394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXxzVdGY68P1P5VOr67jT7FgvZ+zzFAO+TzOdT99drHfEctIG/HnPy3jecuWsIXZPhXJlIP3t5floxjiJrQft8798p3awSQ0yGw9IJYqjONd92+hL0nmd9Q3at/Bs4XMA=="}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:52.113973 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1f19e2a2-be53-4467-806c-78efd5b0b339 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for project 0e8b1042912a49c1b7b194675165bea4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:14:52.120096 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-1f19e2a2-be53-4467-806c-78efd5b0b339 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for user 2bada9540169440d8bed54249fda7405 and project 0e8b1042912a49c1b7b194675165bea4. Resources: {'key_pairs'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:14:52.151369 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-1f19e2a2-be53-4467-806c-78efd5b0b339 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.059855 Oct 04 19:14:52.152172 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2336/6821] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:14:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:09.528675 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=10 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:09.529434 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:09.533530 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-713059105", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-297396394", "security_groups": [{"name": "tempest-secgroup-smoke-1529588386"}], "networks": [{"uuid": "b7f8ddaa-1ab3-4ba6-9e55-6279ce5f21c5"}], "block_device_mapping_v2": [{"uuid": "113ec937-f0ab-4a95-94e5-4afb14194df8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:09.650196 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] validate_networks() for [('b7f8ddaa-1ab3-4ba6-9e55-6279ce5f21c5', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:10.070379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:10.070816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:10.071339 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:10.071761 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:10.072191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:10.081664 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:10.082152 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:10.082597 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:10.083385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:10.083828 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:10.084260 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:10.104747 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for project 0e8b1042912a49c1b7b194675165bea4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:10.110636 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Getting quotas for user 2bada9540169440d8bed54249fda7405 and project 0e8b1042912a49c1b7b194675165bea4. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:10.169738 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:10.172045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='113ec937-f0ab-4a95-94e5-4afb14194df8',volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:10.311153 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-707fefd5-3f55-4062-a207-aa5517a50421 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784252 Oct 04 19:15:10.311836 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4486/6822] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:10.321253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:10.321946 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=4 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:10.322751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:10.326961 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7eb9e07c-f6fa-4844-8ee7-08f0d626140c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:10.327627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7eb9e07c-f6fa-4844-8ee7-08f0d626140c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:10.389286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7eb9e07c-f6fa-4844-8ee7-08f0d626140c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:10.396390 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7eb9e07c-f6fa-4844-8ee7-08f0d626140c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1087 microversion: 2.1 time: 0.077230 Oct 04 19:15:10.396989 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2337/6823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:10 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:11.420814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:11.421444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:11.428144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:11.428649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:11.429094 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:11.429808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:11.430272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:11.430868 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:11.503331 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:11.511291 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-23a9503f-1316-4720-ac1d-7661d3d29dbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1203 microversion: 2.1 time: 0.096057 Oct 04 19:15:11.512728 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4487/6824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:11 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:12.535564 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:12.536464 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:12.544916 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:12.545668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:12.546121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:12.547121 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:12.547392 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:12.548000 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:12.760062 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:12.769628 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4335c603-4759-48e2-8d06-d0d012e52329 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1271 microversion: 2.1 time: 0.237671 Oct 04 19:15:12.770333 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2338/6825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:12 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:12.987704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:13.001444 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:13.001935 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:13.002914 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:13.016333 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] Creating event network-changed:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h2-831193-17 Oct 04 19:15:13.021477 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-8b18c347-2014-4991-ae77-fbc52be42003 req-6e312663-9274-4a36-a4aa-e259037af75a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108692 Oct 04 19:15:13.022289 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4488/6826] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:13.794435 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:13.795125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:13.802390 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:13.803513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:13.803964 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:13.804681 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:13.805146 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:13.805587 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:13.968668 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:13.976581 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ca2cfd4f-7873-4120-b440-69b1534e5ec5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1271 microversion: 2.1 time: 0.187227 Oct 04 19:15:13.977163 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2339/6827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:13 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:15.001712 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:15.002504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:15.008943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:15.009441 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:15.009887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:15.010604 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:15.011089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:15.011528 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:15.148764 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:15.157323 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-eb1af04a-dd19-4320-bb94-406fd1391f33 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1271 microversion: 2.1 time: 0.161215 Oct 04 19:15:15.157914 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4489/6828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:14 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:16.181650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:16.182340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:16.191123 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.191631 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.192077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.192797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:16.193296 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:16.194056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:16.333727 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:16.341943 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-db19640c-a0c0-4fb0-9749-54b6a31571cd tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1271 microversion: 2.1 time: 0.164589 Oct 04 19:15:16.342580 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2340/6829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:16 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:17.365853 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:17.366481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:17.374024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.374516 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.374964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.375700 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:17.376166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:17.376595 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:17.505266 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:17.513621 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30a4613e-08bc-4082-83dd-0dbef51b95ac tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.151690 Oct 04 19:15:17.514197 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4490/6830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:17 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:18.536911 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:18.537453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:18.544667 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.545165 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.545618 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.546327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:18.546841 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:18.547274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:18.687627 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:18.695322 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-c16f3c99-e9ae-4818-8e4b-da78a9b8bb12 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.162485 Oct 04 19:15:18.695896 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2341/6831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:18 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:19.718163 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:19.718781 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:19.725651 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.726137 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.726582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.727318 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:19.727779 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:19.728209 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:19.858655 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:19.866847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-59d7b915-0be7-4f65-a7ac-66b3481e8290 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.152695 Oct 04 19:15:19.867455 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4491/6832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:19 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:20.890652 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:20.891309 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:20.894059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:20.899563 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:20.900060 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:20.900515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:20.901225 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:20.901696 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:20.902138 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:21.353552 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:21.361883 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6fc2c7b-1442-4c8d-b70d-832d3622fbdf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.475293 Oct 04 19:15:21.362462 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2342/6833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:20 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:22.385463 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:22.386024 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:22.388025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:22.388818 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:22.395435 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:22.395927 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:22.396366 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:22.397061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:22.397520 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:22.397947 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:22.530506 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:22.538472 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-bf9e565a-3904-46c8-bea6-3b075662904f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.157040 Oct 04 19:15:22.539067 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4492/6834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:22 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:23.561917 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:23.562535 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:23.569479 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:23.569971 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:23.570419 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:23.571155 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:23.571619 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:23.572055 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:23.707345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:23.715228 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-26af8c94-5709-4829-97e4-d417daeb6b29 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.157285 Oct 04 19:15:23.716401 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2343/6835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:23 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:24.738376 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:24.738990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:24.745893 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:24.746382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:24.746849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:24.747583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:24.748045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:24.748481 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:24.882970 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:24.890850 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5ed34bfc-1aab-49be-92fd-00ac0f79d815 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.156359 Oct 04 19:15:24.891471 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4493/6836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:24 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:25.824578 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "name": "network-vif-plugged", "status": "completed", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:25.835680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:25.836176 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:25.836623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:25.847660 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] Creating event network-vif-plugged:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h2-831193-17 Oct 04 19:15:25.852734 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-44352011-c5c0-43e0-b2b3-5edf5924c400 req-2a3cae3c-c736-4ba4-a5a0-760a88a6eb99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092087 Oct 04 19:15:25.853392 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2344/6837] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:25.915292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:25.915911 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:25.923499 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:25.923998 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:25.924440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:25.925769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:25.926275 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:25.926902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:26.089207 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:26.097625 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c0d37ed9-1e53-4573-8618-09592dc76abb tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1259 microversion: 2.1 time: 0.186588 Oct 04 19:15:26.098204 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4494/6838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:25 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:15:27.121189 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:27.122393 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:27.128777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:27.129331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:27.129845 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:27.130556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:27.131022 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:27.131484 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:27.266358 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:27.274256 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a6c7518d-e85a-439f-96c6-2ca01ff19156 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1444 microversion: 2.1 time: 0.158340 Oct 04 19:15:27.274936 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2345/6839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:27 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:27.296545 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:27.297159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:27.303943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:27.304430 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:27.304875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:27.305563 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:27.306023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:27.306451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:27.441077 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:27.448907 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e09c9155-80ec-4832-88cd-c3dffe993b3e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1444 microversion: 2.1 time: 0.156203 Oct 04 19:15:27.449485 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4495/6840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:27 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:29.055359 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:29.066137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:29.066725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:29.067294 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:29.079194 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] Creating event network-changed:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h2-831193-17 Oct 04 19:15:29.084911 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-1bbbf52b-90bd-4582-a3a7-7611f1584d01 req-48bca00b-5aca-483b-ae6e-bc16325e9fa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Oct 04 19:15:29.085606 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2346/6841] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:25.333253 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:17:25.334218 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:17:25.334999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:25.335905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=52 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:25.336865 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:17:25.337038 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action (ip 10.222.0.33) !!! Oct 04 19:17:25.338492 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:17:25.338492 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action (ip 10.222.0.33) !!! Oct 04 19:17:25.440325 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:25.440872 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:25.447458 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.447946 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.448385 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.449079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.449598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.450047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.472491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.objects.instance [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lazy-loading 'flavor' on Instance uuid b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 {{(pid=128770) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:17:25.543967 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-69bb75fe-ef36-4016-84a4-82b577a6660c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action" status: 202 len: 0 microversion: 2.1 time: 0.213145 Oct 04 19:17:25.544560 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4496/6842] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:17:25 2022] POST /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:17:25.551773 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:17:25.552611 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:17:25.553221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:25.553978 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=46 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:25.554929 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:17:25.555097 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 (ip 10.222.0.33) !!! Oct 04 19:17:25.556630 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:17:25.556800 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 (ip 10.222.0.33) !!! Oct 04 19:17:25.561923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.562641 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:25.573833 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.574335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.574787 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.575538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.576011 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.576453 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.714887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:25.722990 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-a07e4513-6088-4fd0-910c-1f4bacb5632d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.173626 Oct 04 19:17:25.723681 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2347/6843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:25 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:26.748243 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:26.748948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:26.757974 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:26.758457 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:26.758895 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:26.759614 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:26.760069 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:26.760491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:26.765186 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33566. Oct 04 19:17:26.765889 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33564. Oct 04 19:17:26.897079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:26.905207 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-df0cccf9-0f90-419a-a0b1-f8a5cb983a56 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.162954 Oct 04 19:17:26.905929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4497/6844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:26 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:27.931256 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:27.931878 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:27.943235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:27.943747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:27.944318 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:27.945353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:27.945553 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:27.946003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:27.953878 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33570. Oct 04 19:17:27.967720 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33572. Oct 04 19:17:28.082110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:28.090020 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f91e61c0-4c1e-4c19-821f-ab61cffea465 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.162696 Oct 04 19:17:28.090592 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2348/6845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:27 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:17:29.114491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:29.115065 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:29.121990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:29.122489 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:29.122937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:29.123748 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:29.124211 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:29.124648 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:29.262102 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:29.269962 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-fdfeb6bd-82c3-45ac-bfd8-72181feb78d6 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.160042 Oct 04 19:17:29.270537 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4498/6846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:29 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:30.293498 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:30.294133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:30.301097 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:30.301593 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:30.302041 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:30.302751 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:30.303248 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:30.303690 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:30.435016 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:30.444000 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-2929dd3c-0796-4766-a5b4-a988bbf472f2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.154644 Oct 04 19:17:30.444583 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2349/6847] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:30 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:31.467451 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:31.468067 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:31.474990 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:31.475504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:31.475943 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:31.476634 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:31.477093 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:31.477523 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:31.613197 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:31.621703 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d8f8843f-9d68-422a-acc0-1bf7b02edb17 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.158201 Oct 04 19:17:31.622604 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4499/6848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:31 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:32.646003 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:32.646554 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:32.653633 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:32.654127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:32.654574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:32.655311 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:32.655777 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:32.656213 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:32.789797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:32.797876 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f76bb38c-f004-4432-9891-b22d5e41081b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.156018 Oct 04 19:17:32.798458 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2350/6849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:32 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:33.821891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:33.822571 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:33.829695 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:33.830184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:33.830625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:33.831358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:33.831820 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:33.832251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:33.966995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:33.976113 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5df74d55-bcb9-4e0e-8b05-43569eb9d312 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.158129 Oct 04 19:17:33.976710 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4500/6850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:33 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:35.000458 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:35.001081 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:35.008639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:35.009133 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:35.009581 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:35.010282 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:35.010748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:35.011232 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:35.142898 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:35.151651 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-665b0c9a-90ca-4e3c-8a4e-37654470a70b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.155193 Oct 04 19:17:35.152221 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2351/6851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:34 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:36.176014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:36.177289 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:36.184752 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:36.185254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:36.185704 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:36.186433 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:36.186900 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:36.187370 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:36.637144 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:36.645419 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-30ac8d4a-a87a-4c10-bb51-8935a8a204ef tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.472924 Oct 04 19:17:36.646009 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4501/6852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:36 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:37.669072 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:37.669689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:37.677557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:37.678147 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:37.678525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:37.679368 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:37.679924 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:37.680276 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:37.811645 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:37.819610 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-ec32c68b-9713-40f5-b2ae-646be0fedf35 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.154660 Oct 04 19:17:37.820193 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2352/6853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:37 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:38.843452 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:38.844079 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:38.851987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:38.852496 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:38.852951 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:38.853932 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:38.854405 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:38.854844 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:38.996134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:39.004297 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3f01f4b8-294d-49e6-8f05-dc9824b3f38d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.164862 Oct 04 19:17:39.005123 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4502/6854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:38 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:40.028592 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:40.029212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:40.036697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.037192 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.037931 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.038638 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.039125 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.039566 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.182156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:40.197585 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-068a1021-1a0b-4d6d-8d31-48515ff0859c tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1570 microversion: 2.1 time: 0.172989 Oct 04 19:17:40.198176 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2353/6855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:40 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:40.220790 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:40.221591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:40.228890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.229388 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.229839 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.230742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.231330 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.231769 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.264799 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128770) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:17:40.336847 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-93474711-9c05-42de-b8a0-77151fff8047 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "POST /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action" status: 202 len: 0 microversion: 2.1 time: 0.119859 Oct 04 19:17:40.337744 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4503/6856] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:17:40 2022] POST /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:17:40.345899 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:40.346538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:40.352985 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.353492 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.353945 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.354664 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.355198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.355728 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.541277 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "name": "network-vif-unplugged", "status": "completed", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:40.554875 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:40.555815 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:40.556522 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:40.562709 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:40.572903 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bc1ea60e-90cb-45d7-82bc-b2005f547906 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1518 microversion: 2.1 time: 0.230842 Oct 04 19:17:40.573508 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2354/6857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:40 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:40.579232 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.compute.server_external_events [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] Unable to find a host for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9. Dropping event network-vif-unplugged {{(pid=128770) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:17:40.579232 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-e6d0ef31-0a3d-4712-919d-66459c2cf6e1 req-81ddc016-d5d7-4dd7-aeb4-21510acbc158 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042786 Oct 04 19:17:40.579232 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4504/6858] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 19:17:41.597031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:41.597684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:41.605047 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:41.605537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:41.605979 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:41.606705 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:41.607278 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:41.607710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:41.752869 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:41.760790 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-7a954daf-3bb8-4a1f-9296-8cc0f2de3636 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1520 microversion: 2.1 time: 0.167713 Oct 04 19:17:41.761576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4505/6859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:41 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:42.784703 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:42.785339 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:42.793450 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:42.793894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:42.794354 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:42.795092 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:42.795571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:42.796018 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:42.929254 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:42.937663 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8587ca1e-39a5-46a8-b907-70f30a6a56aa tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1520 microversion: 2.1 time: 0.156924 Oct 04 19:17:42.938247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2355/6860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:42 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:17:43.962002 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:43.962625 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:43.969792 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:43.970287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:43.970737 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:43.971482 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:43.971948 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:43.972381 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:44.121251 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:44.129366 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-133732f3-09f5-4c11-8dae-15754636dd06 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1520 microversion: 2.1 time: 0.171831 Oct 04 19:17:44.135190 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4506/6861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:43 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:45.153231 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:45.153771 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:45.161300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:45.161796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:45.162246 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:45.162949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:45.163440 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:45.163879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:45.306084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:45.314418 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4953680b-4977-4e6b-a4bd-dd87a858fdbc tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1520 microversion: 2.1 time: 0.165220 Oct 04 19:17:45.315018 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2356/6862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:45 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:46.339786 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:46.340414 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:46.347460 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:46.347999 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:46.349166 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:46.349886 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:46.350351 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:46.350787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:46.481961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:46.490443 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c64eefc-e43f-4b5a-90f4-c9e4a2f3bf75 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.155010 Oct 04 19:17:46.491050 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4507/6863] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:46 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:47.150750 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:47.161137 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.161635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.162335 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.173904 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] Creating event network-changed:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h1-831193-17 Oct 04 19:17:47.179124 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-5eb67cee-f34f-4b5e-ac10-28687d9ea3b0 req-031efad5-7ff5-4b7f-9ed4-c99a116e106f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084520 Oct 04 19:17:47.179737 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2357/6864] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:47.513961 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:47.514591 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:47.521989 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.522484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.522929 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.523661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.524130 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.524562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.663619 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:47.671726 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e36a39f2-6a3e-40a4-ae76-b22221da303b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.161755 Oct 04 19:17:47.672303 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4508/6865] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:47 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:48.696853 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:48.697713 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:48.704064 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:48.704490 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:48.704943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:48.705650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:48.706119 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:48.706567 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:48.842443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:48.850846 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f546fcfc-2d80-4ebc-acd0-9ddbfae08900 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.159399 Oct 04 19:17:48.851617 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2358/6866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:48 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:49.874620 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:49.875272 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:49.882701 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:49.883229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:49.883684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:49.884384 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:49.884849 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:49.885281 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.020518 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:50.028473 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ab5accd0-85a5-411a-ae86-4d56a0cbf166 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.157838 Oct 04 19:17:50.029047 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4509/6867] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:49 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:51.052947 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:51.053574 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:51.060515 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:51.061013 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:51.061468 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:51.062173 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:51.062644 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:51.063120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:51.193642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:51.201499 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-d9efa0b7-7c23-438c-a251-c0972111074d tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.153073 Oct 04 19:17:51.202071 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2359/6868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:51 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:52.226421 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:52.227056 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:52.234287 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:52.234776 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:52.235244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:52.235941 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:52.236396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:52.236830 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:52.240807 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:52.374484 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:52.382444 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5e23c4ec-96d6-49a9-a7d4-4fe533cee26e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.161516 Oct 04 19:17:52.383024 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4510/6869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:52 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:53.406373 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:53.407004 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:53.413926 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:53.414427 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:53.414879 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:53.415894 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:53.416364 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:53.416806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:53.546802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:53.554802 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-04f7539a-114c-4c0e-a71c-9cd3e83dbc8b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.152458 Oct 04 19:17:53.555419 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2360/6870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:53 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:54.578669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:54.579254 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:54.586208 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:54.586703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:54.587183 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:54.587888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:54.588353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:54.588787 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:54.721710 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:54.729517 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-841ac32f-3930-49a3-8e06-4ad76ba785a2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.154913 Oct 04 19:17:54.730160 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4511/6871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:54 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:55.755135 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:55.756476 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:55.760660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=29 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:55.764700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:55.765340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:55.765903 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:55.766984 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:55.767556 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:55.768074 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:55.773549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=81 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:55.920956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:55.929391 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7adaf125-1ad6-4cac-a3ae-a894caa837bf tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.179360 Oct 04 19:17:55.929967 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2361/6872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:55 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:56.953649 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:56.954301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:56.956368 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:56.961803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:56.962304 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:56.963140 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:56.963891 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:56.964358 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:56.964822 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:57.156386 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:57.164773 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5f3b266b-3339-40a4-9964-020ebc2e1834 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.215299 Oct 04 19:17:57.165391 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4512/6873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:56 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:57.651582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "name": "network-vif-plugged", "status": "completed", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:57.663190 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:57.663706 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:57.664156 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:57.675902 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] Creating event network-vif-plugged:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h1-831193-17 Oct 04 19:17:57.684777 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-81b0d3b5-e94d-46f4-a1a6-43ff7bafe536 req-cdbc9831-de97-468d-afe8-1180b3993f1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Oct 04 19:17:57.685356 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2362/6874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:58.189671 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:58.190219 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:58.197730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:58.198221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:58.198661 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:58.199402 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:58.199885 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:58.200317 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:58.335416 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:58.343568 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-6e4635c6-e7b7-4c3e-9dad-f3d9a6b93fb2 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1576 microversion: 2.1 time: 0.157831 Oct 04 19:17:58.344154 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4513/6875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:58 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:59.369635 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:59.370367 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:59.376695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:59.377195 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:59.377651 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:59.378363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:59.378840 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:59.379331 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:59.525586 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:59.533665 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5caae0a6-8edf-4eb9-a340-0d09415ab90f tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1563 microversion: 2.1 time: 0.170367 Oct 04 19:17:59.534247 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2363/6876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:59 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:15.980258 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:15.981616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=22 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:15.987247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:15.987742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:15.987742 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:15.993127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=5 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:15.994295 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=13 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:15.995128 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:15.995633 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:15.996091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:15.996795 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:15.997491 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:15.997926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.002744 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:16.003274 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:16.003725 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.015629 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] Creating event network-changed:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h1-831193-17 Oct 04 19:19:16.021215 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-6432805d-ffbb-4663-ae6c-47fa28ce5270 req-6e8faa9f-1762-431f-be3b-84f0532d11d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039538 Oct 04 19:19:16.021879 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2364/6877] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:16.025023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:19:16.113357 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c68b26f-705f-4bcb-8df9-f89b790610ff tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 204 len: 0 microversion: 2.1 time: 0.134574 Oct 04 19:19:16.113967 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4514/6878] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:19:15 2022] DELETE /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:19:16.124291 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:16.125550 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:16.132201 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:16.132708 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:16.133394 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.134122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:16.134597 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:16.135301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.328143 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:16.336293 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-5657c666-45f6-4339-b3a8-9dcce47abe71 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.217109 Oct 04 19:19:16.336902 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2365/6879] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:16 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:17.361590 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:17.362286 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:17.369647 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:17.370136 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:17.370574 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:17.371301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:17.371798 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:17.372284 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:17.513657 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:17.522377 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-5c3f32bf-28ca-4e0a-8402-555cb517ef46 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1569 microversion: 2.1 time: 0.165111 Oct 04 19:19:17.522954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4515/6880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:17 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:18.102182 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9066d38-7a03-4ee7-9cea-c1bc6a3903b9", "name": "network-vif-deleted", "tag": "dc4119c7-0c37-43c9-a0cd-70385860603d"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:18.116059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.116555 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.117001 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.131095 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] Creating event network-vif-deleted:dc4119c7-0c37-43c9-a0cd-70385860603d for instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 on n-h1-831193-17 Oct 04 19:19:18.136464 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-33ee92d2-2eb3-4240-8ae5-58b7f26addfc req-9d80c9c1-876b-46bd-b057-b9b9b0b0c9d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Oct 04 19:19:18.137063 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2366/6881] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:18.546261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:18.546888 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:18.554264 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.554851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.555629 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.556371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.556983 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.557419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.621299 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:18.629354 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d3f326cd-5d9a-4d57-9f3b-9c8bb17f839b tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1218 microversion: 2.1 time: 0.087165 Oct 04 19:19:18.629929 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4516/6882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:18 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:19.653877 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:19.654589 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:19.662127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:19.662623 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:19.663091 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:19.663796 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:19.664266 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:19.664802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:19.735127 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:19.743467 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-90ec46bf-da4d-4937-bee2-a446f69723a7 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1218 microversion: 2.1 time: 0.093861 Oct 04 19:19:19.744083 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2367/6883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:19 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:20.767361 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:20.768100 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:20.775419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:20.775928 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:20.776371 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.777089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:20.777612 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:20.777985 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.841902 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:20.850763 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-747ba605-f79f-4195-9b68-c77505da95b5 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1218 microversion: 2.1 time: 0.087901 Oct 04 19:19:20.851373 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4517/6884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:20 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:21.873666 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:21.874797 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:21.882112 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.882617 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.883095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:21.883817 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.884379 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.884772 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:21.954508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada9540169440d8bed54249fda7405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8b1042912a49c1b7b194675165bea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:21.963157 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-4d747048-bfc0-4c79-bab3-0b7b1565d69e tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 200 len: 1218 microversion: 2.1 time: 0.093378 Oct 04 19:19:21.963841 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2368/6885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:21 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:22.986987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:22.987567 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] [instance: b9066d38-7a03-4ee7-9cea-c1bc6a3903b9] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:22.994308 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.994810 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.995280 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.995997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.996464 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.996898 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:23.014385 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] HTTP exception thrown: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Request method failure captured: Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 HTTP/1.1 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIUvGjEFlifCezlj-dLOixBnrFzS5PkYJcMPEJA1onpto6fNPfODJ5v6Vzxs5U6_Yp6c7Z5SO46a4b1WI5cX0V4eKopAOZLTrTc0VW7zPetRtj-GjVsMXqAMp7373bCv-zwE55z01Bk5bl3Ix70csandY5wVHnB9EJKUsEW83P0Xw0M Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 0e8b1042912a49c1b7b194675165bea4 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestShelveInstance-1504347416 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e8b1042912a49c1b7b194675165bea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestShelveInstance-1504347416 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 0e8b1042912a49c1b7b194675165bea4 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestShelveInstance-1504347416 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestShelveInstance-1504347416-project Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 2bada9540169440d8bed54249fda7405 Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestShelveInstance-1504347416-project Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': 'b9066d38-7a03-4ee7-9cea-c1bc6a3903b9'} Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:19:23.016646 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Returning 404 to user: Instance b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-f933cb14-0308-40cf-9704-0e84fd70b972 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9" status: 404 len: 111 microversion: 2.1 time: 0.036193 Oct 04 19:19:23.021442 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4518/6886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:22 2022] GET /compute/v2.1/servers/b9066d38-7a03-4ee7-9cea-c1bc6a3903b9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:19:23.194106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-63a1abb5-946e-4e12-993e-96e04e82fb03 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] Calling method '.version_select at 0x7f6340eaf4c0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:23.226216 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-63a1abb5-946e-4e12-993e-96e04e82fb03 tempest-TestShelveInstance-1504347416 tempest-TestShelveInstance-1504347416-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-297396394" status: 202 len: 0 microversion: 2.1 time: 0.036120 Oct 04 19:19:23.235058 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2369/6887] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 19:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-297396394 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:19:40.649959 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:40.650716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:40.852668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-1c6eb5b4-c6d8-4da9-aedb-0048a7029eee tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Action: 'create', calling method: .version_select at 0x7f6341c415e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-128967899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqLAFxnxNw5z17vdXmxkptVEwp43qios8luZntdT+0CAmFF47YOeYc6+Q/xWes9WdQD6AgwMqd2hiZEayci0aDy0K0PbJuAH6dvmp9iaHDJbh8KhTyKi68vU+bSn10CgA=="}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:40.871616 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1c6eb5b4-c6d8-4da9-aedb-0048a7029eee tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:40.878814 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-1c6eb5b4-c6d8-4da9-aedb-0048a7029eee tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for user 3d5ee58a9a6f4b14ad8c41f4e7e09d58 and project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'key_pairs'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:40.920543 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-1c6eb5b4-c6d8-4da9-aedb-0048a7029eee tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.275622 Oct 04 19:19:40.921433 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4519/6888] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 19:19:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:41.943487 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.944684 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.948811 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-474836611", "imageRef": "fde43323-6d3d-41e0-8fc0-c7db4539b857", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-128967899", "security_groups": [{"name": "tempest-secgroup-smoke-708529511"}], "networks": [{"uuid": "59f8aee1-f5b3-46e6-8c1b-b7cd91e6a142"}]}} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:42.078110 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.network.neutron [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] validate_networks() for [('59f8aee1-f5b3-46e6-8c1b-b7cd91e6a142', None, None, None, None, None)] {{(pid=128771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:19:42.616923 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Flavor limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:19:42.617347 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Image limits 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:19:42.617987 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Flavor pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:19:42.618336 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Image pref 0:0:0 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:19:42.618759 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.virt.hardware [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:19:42.629258 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.629765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.630220 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.631077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.631557 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.631999 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.652403 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:42.658462 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.quota [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for user 3d5ee58a9a6f4b14ad8c41f4e7e09d58 and project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'instances', 'cores', 'ram'} {{(pid=128771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:42.680576 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Going to run 1 instances... {{(pid=128771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:19:42.682992 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde43323-6d3d-41e0-8fc0-c7db4539b857',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:19:42.735644 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-907cfca6-e1ca-4f97-9f4c-8a14d29933c6 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793882 Oct 04 19:19:42.743349 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2370/6889] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:19:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:19:42.747803 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-80994e6d-e2d6-40b3-8e9c-0b334af39f61 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:42.749618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-80994e6d-e2d6-40b3-8e9c-0b334af39f61 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:42.834668 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-80994e6d-e2d6-40b3-8e9c-0b334af39f61 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:42.844275 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-80994e6d-e2d6-40b3-8e9c-0b334af39f61 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1247 microversion: 2.1 time: 0.100244 Oct 04 19:19:42.844875 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4520/6890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:42 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:43.871144 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:43.872541 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:43.882008 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.882700 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.883300 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.884496 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.885014 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.886037 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.007632 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:44.022767 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-e7c4b78b-9f26-40fc-a123-457e32d23262 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1307 microversion: 2.1 time: 0.156930 Oct 04 19:19:44.024069 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2371/6891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:43 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:45.050801 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:45.051480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:45.058767 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.059581 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.060031 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.060765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.061231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.062229 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.303794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:45.315750 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3ffcc4c7-c267-4577-ae45-ad1d85aeae09 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1372 microversion: 2.1 time: 0.268831 Oct 04 19:19:45.318735 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4521/6892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:45 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:45.593800 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:45.604843 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.605595 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.606212 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.617527 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] Creating event network-changed:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:19:45.623735 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-ac8ab74b-10b5-493b-99ec-37ca376b8414 req-478e47fd-fea8-4b31-b514-52423f2c97cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 Oct 04 19:19:45.624386 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2372/6893] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:19:46.342859 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:46.343730 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:46.352255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.353053 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.353255 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.354025 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.354544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.354980 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.501473 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:46.509289 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-510825da-2620-4d2c-85d7-0f7e61b31094 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1372 microversion: 2.1 time: 0.170689 Oct 04 19:19:46.509871 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4522/6894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:46 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:47.533640 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:47.534387 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:47.540753 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.541193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.541912 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:47.542629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.543134 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.543582 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:47.691466 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:47.699793 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-f4945529-2412-4a22-9a3c-cd6c82be6be7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1372 microversion: 2.1 time: 0.171833 Oct 04 19:19:47.700392 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2373/6895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:47 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:48.727356 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:48.728081 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:48.736656 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.737175 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.737615 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.738334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.738802 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.739288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.884905 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:48.893452 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c143474c-ac41-4f80-976b-52785968a879 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1372 microversion: 2.1 time: 0.173302 Oct 04 19:19:48.894346 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4523/6896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:48 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:49.230801 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "name": "network-vif-plugged", "status": "completed", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:49.242067 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.242588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.243098 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.255256 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] Creating event network-vif-plugged:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:19:49.260599 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-101f3c7b-0f38-4e40-ab12-f13a33707300 req-b42384eb-a884-4b32-92bf-806d5029b785 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Oct 04 19:19:49.261259 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2374/6897] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:49.916950 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:49.917570 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:49.924681 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.925186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.925637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.926377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.926842 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.927344 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.064521 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:50.072388 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-e9004b84-0510-46c6-beed-0584a51403cc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1372 microversion: 2.1 time: 0.159602 Oct 04 19:19:50.072911 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4524/6898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:49 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:51.096272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:51.096982 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:51.103247 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.103742 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.104188 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.104882 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.105345 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.105786 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.242237 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:51.250152 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-bd3d3249-5564-4fae-b11e-97fcd8cc351e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1556 microversion: 2.1 time: 0.159021 Oct 04 19:19:51.250724 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2375/6899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:51 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:51.272716 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:51.273340 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:51.280794 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.281283 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.281724 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.282419 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.282880 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.283337 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.422997 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:51.431116 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ddf05906-c76a-4126-b040-e6ed0e603072 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1556 microversion: 2.1 time: 0.162196 Oct 04 19:19:51.431701 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4525/6900] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:51 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:53.106938 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:53.113695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:53.114376 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=6 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:53.121697 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:53.122194 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:53.122639 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:53.135080 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] Creating event network-changed:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:19:53.140412 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9cfbc6d6-af9e-43da-83d7-e0f7b55f2886 req-a6280213-f5f8-4da6-b4dd-4a485a1c6a46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037261 Oct 04 19:19:53.141618 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2376/6901] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:48.089810 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:21:48.090662 n-d-831193-17 devstack@n-api.service[128770]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:21:48.091326 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:48.092250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:48.092958 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=30 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:48.094414 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:21:48.094582 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b/action (ip 10.222.0.33) !!! Oct 04 19:21:48.101512 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-609820598"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:48.104424 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:48.118379 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.118887 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.119382 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.120703 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.121176 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.121610 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.324206 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-ea214c58-6436-4b1f-89c5-26eb46b012f2 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "POST /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.236176 Oct 04 19:21:48.324874 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4526/6902] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:21:48 2022] POST /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:21:51.804097 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:21:51.809419 n-d-831193-17 devstack@n-api.service[128771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:21:51.810695 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:51.811689 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=26 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:51.814463 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:21:51.814624 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:21:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 19:21:51.907856 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "name": "network-vif-plugged", "status": "completed", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:51.919738 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.920585 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.921035 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:51.932196 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] Creating event network-vif-plugged:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:21:51.938899 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-9028eefb-fff5-4b36-a255-c2c66b45719b req-c519c4bb-0653-422c-a40b-b88cf183b919 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137038 Oct 04 19:21:51.939560 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2377/6903] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:01.891395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:01.892184 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:01.898061 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-189047528", "imageRef": "0a1c33b5-3243-432b-81fb-0472058e7fed", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-128967899", "security_groups": [{"name": "tempest-secgroup-smoke-708529511"}], "networks": [{"uuid": "59f8aee1-f5b3-46e6-8c1b-b7cd91e6a142"}]}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:01.925862 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3faeba8-2cdc-4806-bd5b-ec04c6f2619c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34066. Oct 04 19:22:01.927441 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d6d863e-8c16-4dbc-b9fb-8c60873bfef6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34064. Oct 04 19:22:02.013692 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.network.neutron [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] validate_networks() for [('59f8aee1-f5b3-46e6-8c1b-b7cd91e6a142', None, None, None, None, None)] {{(pid=128770) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:22:02.763301 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Flavor limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:22:02.763831 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Image limits 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:22:02.764312 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Flavor pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:22:02.764731 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Image pref 0:0:0 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:22:02.765149 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.virt.hardware [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128770) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:22:02.774952 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:02.775477 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:02.776502 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:02.777531 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:02.777995 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:02.778428 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:02.796261 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:22:02.801541 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.quota [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Getting quotas for user 3d5ee58a9a6f4b14ad8c41f4e7e09d58 and project 4a7848d8a60f44b689ada52dca5f30d6. Resources: {'instances', 'cores', 'ram'} {{(pid=128770) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:22:02.814191 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Going to run 1 instances... {{(pid=128770) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:22:02.816763 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a1c33b5-3243-432b-81fb-0472058e7fed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128770) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:22:02.881712 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-699fdf9d-0b83-4308-8b01-d17a3ea27d49 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.994116 Oct 04 19:22:02.882385 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4527/6904] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 19:22:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:22:02.894893 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-19420c1f-1934-42a5-a216-e444debad70e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:02.896434 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-19420c1f-1934-42a5-a216-e444debad70e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:02.904040 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:02.904962 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:02.935545 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0d4b738-6c63-41f1-9b7b-a4b04a5f8b8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34082. Oct 04 19:22:02.936296 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6e27294-4928-47f1-9b46-a490ceb2a61c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34080. Oct 04 19:22:02.969588 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-19420c1f-1934-42a5-a216-e444debad70e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:02.977960 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-19420c1f-1934-42a5-a216-e444debad70e tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1247 microversion: 2.1 time: 0.087354 Oct 04 19:22:02.978538 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2378/6905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:02 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:04.002097 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:04.002746 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:04.009687 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.010188 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.010865 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.011618 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.012090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.012569 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.078669 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:04.087768 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-113a164d-5d5e-48f3-9be4-597c0cd65841 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1305 microversion: 2.1 time: 0.090695 Oct 04 19:22:04.088954 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4528/6906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:03 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:05.113887 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:05.114520 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:05.122954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.123518 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.124193 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.125120 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.125603 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.126049 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.272033 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:05.280961 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-013fd903-141f-4bf4-8cda-b9b2f2e25b99 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.170995 Oct 04 19:22:05.281558 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2379/6907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:05 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:05.804916 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "name": "network-vif-unplugged", "status": "completed", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:05.818223 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.819194 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.819908 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.838863 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] Creating event network-vif-unplugged:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:22:05.844501 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-19b68cde-3d18-4d67-a620-4e430c9c8637 req-b831120e-c61a-4ad9-bedc-2120732ffe4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044081 Oct 04 19:22:05.845799 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4529/6908] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:06.306340 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:06.307680 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:06.315228 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.315747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.316208 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.316943 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.317417 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.318059 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.498084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:06.506270 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-cab8a13a-d1db-4f06-8c60-a9e5810e2553 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.204122 Oct 04 19:22:06.507217 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2380/6909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:06 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:07.532119 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:07.533686 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:07.540544 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:07.541400 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:07.542360 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:07.543210 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:07.543751 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:07.544448 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:07.715613 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:07.726305 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-186d5c83-5372-4575-b0ea-97366f3ddf51 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.200037 Oct 04 19:22:07.742200 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4530/6910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:07 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:08.750131 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:08.750692 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:08.758084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:08.758084 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:08.758549 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:08.759315 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:08.759780 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:08.760263 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:08.927045 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:08.935709 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-149cbade-7aa9-4db7-851e-fcebea90adb1 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.189598 Oct 04 19:22:08.936313 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2381/6911] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:08 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:09.959274 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:09.959915 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:09.970026 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:09.970632 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:09.971226 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:09.972039 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:09.972583 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:09.973091 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:10.124418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:10.132958 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-54dc608d-7549-4d40-9c22-888e0a7bce13 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.177705 Oct 04 19:22:10.136538 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4531/6912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:09 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:11.157485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:11.158198 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:11.165463 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.165988 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.167051 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.168077 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.168642 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.169095 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.320420 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:11.329172 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-40af4299-75cc-47b2-afc3-72b4bc97179a tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.175571 Oct 04 19:22:11.330092 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2382/6913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:11 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:12.352964 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:12.354186 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:12.361349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.361846 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.362292 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.363013 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.363504 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.363937 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.520062 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:12.530732 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-b8a44633-d667-4fdd-ab9e-ef2042c0d1cb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.181683 Oct 04 19:22:12.531710 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4532/6914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:12 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:13.109605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:13.117278 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell0:SELECT=2 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:13.125607 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:13.126353 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:13.126802 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:13.139697 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] Creating event network-changed:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:22:13.144962 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-66477899-eb68-46c2-8098-5c7cab16f889 req-7fec81c0-f168-4b46-8920-83d9ef178046 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039073 Oct 04 19:22:13.145962 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2383/6915] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:13.556090 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:13.557377 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:13.559456 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:13.560288 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell0:SELECT=6 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:13.567089 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:13.567617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:13.568174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:13.568884 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:13.569353 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:13.569851 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:13.707418 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:13.715117 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-3466fd2d-b205-4bb5-a6a5-839ec8604c83 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.163105 Oct 04 19:22:13.715695 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4533/6916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:13 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:14.738545 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:14.739221 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.748613 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.749303 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.749765 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.750685 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.750956 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.751426 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.897009 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:14.905442 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-71606709-af7c-4f09-a2e1-a33308806bdb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.171314 Oct 04 19:22:14.906029 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2384/6917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:14 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:15.930480 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:15.931174 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:15.939375 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.939890 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.940702 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.941132 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.941565 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.941963 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.078562 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:16.086564 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-669dad16-df31-4f2e-97fd-67608ad3a3c7 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.160478 Oct 04 19:22:16.087162 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4534/6918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:15 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:16.951122 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "name": "network-vif-plugged", "status": "completed", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:16.962538 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.963066 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.963517 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.975009 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] Creating event network-vif-plugged:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:22:16.980807 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-f1b52865-f5f3-446b-9640-3c93a727afd0 req-32c96aed-73c7-471f-9b92-faedcd394829 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Oct 04 19:22:16.981659 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2385/6919] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:17.110107 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:17.110719 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:17.117637 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.118135 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.118582 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.119976 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.120440 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.120877 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.259239 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:17.266956 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-70934804-4578-4433-a12a-ce9554734ccb tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1372 microversion: 2.1 time: 0.160802 Oct 04 19:22:17.267576 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4535/6920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:17 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:18.291406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:18.292508 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:18.299344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.299849 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.300301 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.301058 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.301534 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.301976 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.441338 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:18.449379 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-de88de29-a994-425a-aca7-6b6a308d4453 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1556 microversion: 2.1 time: 0.163179 Oct 04 19:22:18.450038 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2386/6921] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:18 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:18.471689 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:18.472323 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:18.480142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.480690 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.481670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.482395 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.482861 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.483327 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.630993 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:18.639762 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-d15e33de-c720-43ec-906b-f486a35e2364 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1556 microversion: 2.1 time: 0.171555 Oct 04 19:22:18.640332 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4536/6922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:18 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:20.311748 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:20.321826 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.322421 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.322935 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.335219 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] Creating event network-changed:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:22:20.340378 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-78aaaab4-ed09-4c65-9014-1de4bdba997e req-3adb35b2-1d29-4159-aea5-4b27af774674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090073 Oct 04 19:22:20.341136 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2387/6923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:41.870023 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:41.870808 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=52 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:41.871973 n-d-831193-17 devstack@n-api.service[128770]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:23:41.872173 n-d-831193-17 devstack@n-api.service[128770]: Tue Oct 4 19:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e/action (ip 10.222.0.33) !!! Oct 04 19:23:41.877987 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1534572740"}} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:41.880391 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:41.890926 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:41.891438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:41.891879 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:41.892584 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:41.893042 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:41.893472 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:42.293729 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-c8b1ead9-f20f-41fe-92dc-64dbb310493d tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "POST /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e/action" status: 202 len: 0 microversion: 2.1 time: 0.425555 Oct 04 19:23:42.294399 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4537/6924] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:41 2022] POST /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:23:47.402934 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_api:SELECT=22 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:47.405406 n-d-831193-17 devstack@n-api.service[128771]: DEBUG dbcounter [-] [128771] Writing DB stats nova_cell1:SELECT=42 {{(pid=128771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:47.407085 n-d-831193-17 devstack@n-api.service[128771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:23:47.407578 n-d-831193-17 devstack@n-api.service[128771]: Tue Oct 4 19:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 19:23:47.416253 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "name": "network-vif-plugged", "status": "completed", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:47.428918 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:47.429629 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:47.432979 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:47.448041 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] Creating event network-vif-plugged:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:23:47.453706 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-a3844cac-83c0-4d52-86ca-c347b691a1ce req-8db21799-a6e2-4f7d-a5c2-64ef38b6878e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057763 Oct 04 19:23:47.454916 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2388/6925] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:57.386696 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_api:SELECT=2 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:57.387537 n-d-831193-17 devstack@n-api.service[128770]: DEBUG dbcounter [-] [128770] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:57.392783 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:57.393426 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:57.395129 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:57.403564 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.404071 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.404874 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.405773 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.406406 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.407246 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.408548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.409322 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.409862 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.424207 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] Creating event network-changed:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:23:57.430339 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-258b36f3-66d2-4aa3-a700-4a87dfdd9226 req-315d441a-204e-4ce0-a9fb-336e0d4dde82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042882 Oct 04 19:23:57.431532 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2389/6926] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:57.438098 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Going to try to terminate instance {{(pid=128770) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:23:57.543595 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-45d31e4f-fa12-4aa0-9db6-6d99dfcccbdd tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 204 len: 0 microversion: 2.1 time: 0.158354 Oct 04 19:23:57.544422 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4538/6927] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:23:57 2022] DELETE /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:23:57.554930 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:57.555683 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:57.562238 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.562747 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.563218 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.564105 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.564568 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.565171 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.714650 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:57.722707 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-7db24de9-2a17-4acf-b5c6-d4b8c38624bc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1680 microversion: 2.1 time: 0.172847 Oct 04 19:23:57.723365 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2390/6928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:57 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:58.746394 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:58.747162 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:58.754250 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:58.754684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:58.755159 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.755871 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:58.756334 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:58.756765 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.898557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:58.906630 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-12ac3551-a87e-409e-8a29-e8427090c035 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1680 microversion: 2.1 time: 0.164535 Oct 04 19:23:58.907465 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4539/6929] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:58 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:59.360244 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "name": "network-vif-unplugged", "status": "completed", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:59.376286 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.377327 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.377861 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.394977 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.compute.server_external_events [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] Creating event network-vif-unplugged:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:23:59.403920 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [req-b7a67c59-a571-4b67-b637-3c75a681b177 req-fc92688a-cb8f-4ff2-bed9-263465334743 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048803 Oct 04 19:23:59.405852 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2391/6930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:59.663142 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744d0c56-aab2-4044-89ca-ca863679115e", "name": "network-vif-deleted", "tag": "db60f976-966d-488c-b802-5f344a2e3215"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:59.674007 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.674598 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.675645 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.686772 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] Creating event network-vif-deleted:db60f976-966d-488c-b802-5f344a2e3215 for instance 744d0c56-aab2-4044-89ca-ca863679115e on n-h1-831193-17 Oct 04 19:23:59.692434 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-f85ea246-da4c-4726-bd1b-85e2de3f867d req-fe69bc11-7be7-4b20-b391-bc156b75868c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091172 Oct 04 19:23:59.693287 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4540/6931] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:59.930399 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:59.931299 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:59.937828 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.938344 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.938806 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.939577 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.940056 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.941046 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.978539 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.979106 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.979513 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.980042 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lazy-loading 'fault' on Instance uuid 744d0c56-aab2-4044-89ca-ca863679115e {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:24:00.048235 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:00.061327 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-9a8cd6b1-d969-46a4-b589-b12e57b67d54 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 200 len: 1337 microversion: 2.1 time: 0.134835 Oct 04 19:24:00.062332 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2392/6932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:59 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 1337 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:01.087855 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:01.088549 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 744d0c56-aab2-4044-89ca-ca863679115e] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:01.095045 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.095566 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.096019 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.097259 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.097729 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.098172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.113229 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] HTTP exception thrown: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Request method failure captured: Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e HTTP/1.1 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIdHF3DEThPW9eUdf5xv8SszqjObkvpd-fLIYihCWRU0IlnSejB6kVDTpQ3o8zw2f-9Rg6cHO6RM2i2vffIPSpG9hDPFgEpy0DZmjLewRzCeTrnBupDvDAX5AYVsnhzJ2Nyh7VMi5lmjU18o-nnbQOoDtQ7C0oAY-S1fjnEQqHYEPhs Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 4a7848d8a60f44b689ada52dca5f30d6 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 4a7848d8a60f44b689ada52dca5f30d6 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestSnapshotPattern-1019635441-project Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3d5ee58a9a6f4b14ad8c41f4e7e09d58 Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestSnapshotPattern-1019635441-project Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '744d0c56-aab2-4044-89ca-ca863679115e'} Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:01.114957 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Returning 404 to user: Instance 744d0c56-aab2-4044-89ca-ca863679115e could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-908f5f2b-3f77-4c6d-ba68-4943f3ed5554 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e" status: 404 len: 111 microversion: 2.1 time: 0.034033 Oct 04 19:24:01.121064 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4541/6933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:01 2022] GET /compute/v2.1/servers/744d0c56-aab2-4044-89ca-ca863679115e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:24:02.555836 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:02.556363 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:02.558474 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:02.563571 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.564087 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.564548 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.565279 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.566783 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.567272 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.570557 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.571588 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.572134 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.585141 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] Creating event network-changed:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:24:02.590616 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-743f1101-6e89-4260-86ff-45a600a9bf31 req-da888b18-a5ad-4a68-8590-beda675d0010 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036317 Oct 04 19:24:02.592015 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4542/6934] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:24:02.598660 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Going to try to terminate instance {{(pid=128771) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:24:02.695969 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-53656d74-dad2-4634-bc0c-c8627bbfcfb8 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 204 len: 0 microversion: 2.1 time: 0.145545 Oct 04 19:24:02.696928 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2393/6935] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 19:24:02 2022] DELETE /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:24:02.705832 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:02.706758 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:02.714063 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.714659 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.715221 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.716009 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.716547 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.717138 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.877677 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.policy [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128770) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:02.885942 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-62ba43e4-9fe6-4690-bc2a-331e60e8df27 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1681 microversion: 2.1 time: 0.184519 Oct 04 19:24:02.886520 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4543/6936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:02 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:03.910233 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:03.910939 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:03.917025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:03.917525 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:03.918241 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:03.918949 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:03.919443 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:03.919880 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.091752 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:04.100616 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-0a741753-cfac-4eff-9847-3cf6192382f3 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1681 microversion: 2.1 time: 0.194915 Oct 04 19:24:04.101427 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2394/6937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:03 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:04.760231 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aae555-807e-4f35-8898-1c0177775f2b", "name": "network-vif-deleted", "tag": "f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df"}]} {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:04.776816 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:04.777684 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:04.778438 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.797818 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.compute.server_external_events [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] Creating event network-vif-deleted:f8f37aa5-2c05-40e1-a6a5-e512fdc9b1df for instance 97aae555-807e-4f35-8898-1c0177775f2b on n-h2-831193-17 Oct 04 19:24:04.803631 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [req-1e0704e4-1d22-4a0b-bac5-059b70d4878d req-9778f110-f8d0-425d-94ab-efcbe3afe429 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050902 Oct 04 19:24:04.804193 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4544/6938] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:05.128929 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:05.129605 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.compute.api [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128771) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:05.136519 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:05.137025 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:05.137485 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.138211 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:05.138687 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:05.139223 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.177205 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:05.177721 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:05.178275 n-d-831193-17 devstack@n-api.service[128771]: DEBUG oslo_concurrency.lockutils [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.178754 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.objects.instance [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lazy-loading 'fault' on Instance uuid 97aae555-807e-4f35-8898-1c0177775f2b {{(pid=128771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:24:05.226954 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.policy [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5ee58a9a6f4b14ad8c41f4e7e09d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7848d8a60f44b689ada52dca5f30d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128771) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:05.235647 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-8ff837a4-436c-4fc8-973f-5df61a7feadc tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 200 len: 1337 microversion: 2.1 time: 0.111641 Oct 04 19:24:05.236249 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2395/6939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:05 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 1337 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:06.262479 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '>' {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:06.263396 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.compute.api [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] [instance: 97aae555-807e-4f35-8898-1c0177775f2b] Fetching instance by UUID {{(pid=128770) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:06.271109 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.271617 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.272172 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.272785 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Acquiring lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.273244 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.273670 n-d-831193-17 devstack@n-api.service[128770]: DEBUG oslo_concurrency.lockutils [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Lock "1e3715f3-b416-44ed-969d-2dded84eaf0f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.292083 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.wsgi [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] HTTP exception thrown: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Request method failure captured: Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: request: GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b HTTP/1.1 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Accept: application/json Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Accept-Encoding: identity Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Connection: close Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Content-Length: 0 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Content-Type: application/json Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Host: 10.222.0.33 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: Openstack-System-Scope: None Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: User-Agent: python-urllib3/1.26.12 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Auth-Token: gAAAAABjPIdHF3DEThPW9eUdf5xv8SszqjObkvpd-fLIYihCWRU0IlnSejB6kVDTpQ3o8zw2f-9Rg6cHO6RM2i2vffIPSpG9hDPFgEpy0DZmjLewRzCeTrnBupDvDAX5AYVsnhzJ2Nyh7VMi5lmjU18o-nnbQOoDtQ7C0oAY-S1fjnEQqHYEPhs Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Id: None Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Domain-Name: None Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Identity-Status: Confirmed Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Is-Admin-Project: True Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Id: default Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Domain-Name: Default Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Id: 4a7848d8a60f44b689ada52dca5f30d6 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Project-Name: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Role: reader,member Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Roles: reader,member Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a7848d8a60f44b689ada52dca5f30d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Id: 4a7848d8a60f44b689ada52dca5f30d6 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-Tenant-Name: tempest-TestSnapshotPattern-1019635441 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-User: tempest-TestSnapshotPattern-1019635441-project Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Id: default Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Domain-Name: Default Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Id: 3d5ee58a9a6f4b14ad8c41f4e7e09d58 Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: X-User-Name: tempest-TestSnapshotPattern-1019635441-project Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: method: > Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: exception: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: action_args: {'id': '97aae555-807e-4f35-8898-1c0177775f2b'} Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: {{(pid=128770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:06.294014 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: ERROR nova.api.openstack.wsgi Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: DEBUG nova.api.openstack.wsgi [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Returning 404 to user: Instance 97aae555-807e-4f35-8898-1c0177775f2b could not be found. {{(pid=128770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: INFO nova.api.openstack.requestlog [None req-610f50dd-8ee6-49ef-b4f6-ab31b1e7662b tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b" status: 404 len: 111 microversion: 2.1 time: 0.039335 Oct 04 19:24:06.301349 n-d-831193-17 devstack@n-api.service[128770]: [pid: 128770|app: 0|req: 4545/6940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:06 2022] GET /compute/v2.1/servers/97aae555-807e-4f35-8898-1c0177775f2b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:24:06.471321 n-d-831193-17 devstack@n-api.service[128771]: DEBUG nova.api.openstack.wsgi [None req-89ccbbac-3dd6-48b3-8fb8-72b8460ec687 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] Calling method '.version_select at 0x7f63419ef9d0>' {{(pid=128771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:06.498035 n-d-831193-17 devstack@n-api.service[128771]: INFO nova.api.openstack.requestlog [None req-89ccbbac-3dd6-48b3-8fb8-72b8460ec687 tempest-TestSnapshotPattern-1019635441 tempest-TestSnapshotPattern-1019635441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-128967899" status: 202 len: 0 microversion: 2.1 time: 0.030853 Oct 04 19:24:06.498864 n-d-831193-17 devstack@n-api.service[128771]: [pid: 128771|app: 0|req: 2396/6941] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 19:24:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-128967899 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)